[5/16] Speed test Silence9 vs SilenceX vs Mighty5 vs SSK2.0 vs STOCK vs Others!

[selytch]

Last update 5/16 4:30pm PST
We have a new champion - SilenceRomX 6.1 lite! Thanks, Silence for great work!

Please help testing ROMs - contribute to PPCGeeks community
Detailed instructions:
http://forum.ppcgeeks.com/showthread...d=1#post917246

There are many claims that one ROM is faster/better than the other one.
I took several current (as of 5/13/09) ROMs and ran through some basic tests.
All ROMs were installed from SD card.

1. First boot to screen calibration
2. Duration of customization
3. Second boot to start menu (to minimize CHome/TF3D difference)
4. Third boot to usable TF3D (I don't like CHome)
5. Free memory at this point
6. Opera version and time to open http://www.ibm.com/us/en (no affiliation here)
7. Test divx in core player (1 minute 720x320 DIVX car chase scene from "Gone in 60 seconds") (clip on SD card) (download http://badikoff.com/test_clip.divx - 12M)
8. I wanted to test filesystem speed (read/write) but found it too boring - and the above results reflect this anyway.


(sorted by overall performance, less is better. Underscored times are not precise.)
(3rd boot given 2x weight for its importance. Video playback is not included in overall score)

Observations:
- Speed test on coreplayer <99% makes video watching almost unusable.
- Silence9 has nice custom taskbar icons by default
- Juicy7 pagepool seems to be huge without any performance gain
- Opera 16277 is 25%! slower than 15954 (or is it ROM?)
- Psyki3 has tsowen taskbar icons, S2U and nice custom fonts - but the ROM is slow and large space bar is a waste of screen space
- SSK2 may be my new favorite (after Silence9) - but it lacks personality
- Longhorn, 4min customization, stuck soft buttons in TF3D, no touch keyboard, slow video playback - I want to like your ROM!
- Star 1.6a feel very inconsistent, like a pile of stuff and S2U pops up annoyingly
- RSTG 05 & 19 have very nice themes, 19 installs fast, both are very loaded but naming is confusing and disappointing performance
- SrX WM6.5v2 is going now head-to-head with Mighty5! Both much slower than 21042 though...
- The startup performance correlates well with CorePlayer benchmark - so if a ROM takes forever to boot up, it's likely not to be a good one
- STOCK has some interesting numbers:
a. the load time and video performance are hideous
b. internet speed is higher! not sure if it is a new day, updated PRL or what...?

Conclusion:
- If you want a fast and stable 6.1 ROM - go for SilenceX Lite
- For stable 6.5 ROM (fancy themes/start menu) - Mighty5 is the way to go
Rhodium Manila (TF3Dv2) unfortunately still buggy, wait for XBMOD from XDA to port final version.

Links:
SilenceX http://forum.ppcgeeks.com/showthread.php?t=68403
Mighty5 http://forum.ppcgeeks.com/showthread.php?t=52695
SSK2.0 http://forum.ppcgeeks.com/showthread.php?t=68075
Longhorn http://forum.ppcgeeks.com/showthread.php?p=866844
Silence9 http://forum.ppcgeeks.com/showthread.php?t=60375
Juicy7 http://forum.ppcgeeks.com/showthread.php?t=58002
Psyki3 http://forum.ppcgeeks.com/showthread.php?t=66993
Copper 0001 http://forum.ppcgeeks.com/showthread.php?t=64242
Star 1.6a http://forum.ppcgeeks.com/showthread.php?t=63044
RSTG http://forum.ppcgeeks.com/showthread.php?t=62786
Sprint Stock http://forum.ppcgeeks.com/showthread.php?t=42741

[psyki]

Interesting test but those numbers don't really mean that much in terms of reliability, usability out of the box, performance after 2 weeks of no resetting etc. And where's PsykiROM on the list?

[scrosler]

Originally Posted by psyki

Interesting test but those numbers don't really mean that much in terms of reliability, usability out of the box, performance after 2 weeks of no resetting etc. And where's PsykiROM on the list?

Wheres my ROM ;c(

WOuld you mind testing my latest SSK 2.0 out for this test. I would love to see how it stacked up.

[selytch]

Originally Posted by psyki

Interesting test but those numbers don't really mean that much in terms of reliability, usability out of the box, performance after 2 weeks of no resetting etc. And where's PsykiROM on the list?

Most of the ROMs are pretty much the same once you get certain level of quality. The difference is whether google maps/facebook/pocketrar are installed (which I really don't care, I got all the cab I need on SD card with updated versions).

I use my pocket pc for medical software, internet/email and as media player. I want it to boot fast from soft reset and to do hard reset fast as well (if I run into serious trouble).

More ROM testing is coming up!

[Nygel]

Originally Posted by selytch

Most of the ROMs are pretty much the same once you get certain level of quality. The difference is whether google maps/facebook/pocketrar are installed (which I really don't care, I got all the cab I need on SD card with updated versions).

I use my pocket pc for medical software, internet/email and as media player. I want it to boot fast from soft reset and to do hard reset fast as well (if I run into serious trouble).

More ROM testing is coming up!

my wife is gettin ginto medical coding and I will like to get her some medical software can you point me int he right direction plesase

thanks

[selytch]

Originally Posted by Nygel

my wife is gettin ginto medical coding and I will like to get her some medical software can you point me int he right direction plesase

thanks

I use disease/drugs references, not so much coding. Haven't seen a good program for billing yet. Otherwise - Sanford (antibiotics), Lexi (drugs and labs), Skyscape (OCM/medconsul/Ferri CA).

[wwjd4pk]

Can you add Merdin roms?

[temperamentalman]

How about a test of Fallen 2.1??? I know I'm not in the same league with some of the other chefs...but I'd love a comparison like this.

Thanks for all your hard work...

[mlin]

Originally Posted by selytch

Most of the ROMs are pretty much the same once you get certain level of quality.

From what I can tell, you are using these ROMs for only a few minutes at a time, and based on this, I have to disagree you that all ROMs are pretty much the same... Longevity and lasting stability is something to consider and that not every ROM has. My experience is in order to get a thorough feel for a ROMs speed and stability, you have to use it for more than a few minutes IMHO. Thanks for the testing though, I think the numbers are... well not sure, but thanks anyways.

[selytch]

Originally Posted by mlin

From what I can tell, you are using these ROMs for only a few minutes at a time, and based on this, I have to disagree you that all ROMs are pretty much the same... Longevity and lasting stability is something to consider and that not every ROM has. My experience is in order to get a thorough feel for a ROMs speed and stability, you have to use it for more than a few minutes IMHO. Thanks for the testing though, I think the numbers are... well not sure, but thanks anyways.

I have used these ROMs in the past for at least a day each. I cannot call this an extensive testing, but they all are pretty usable.

I wanted to get over claims "my rom is the fastest" (nothing personal ). Though this would be a good objective measure.