[ROM SHOWDOWN] [UPDATE 5/15] (RAM-Benchmarks-ROM) **Objective Analysis**

[mlin]

Originally Posted by raidzero

Thanks mlin! its cool to see how your ROM stack up against others from an unbiased perspective. the question now is, what exactly is SPB benchmark score (I know was SPB benchmark is, I have run it myself..) and why is malrom like twice as high as all the others? seems like when there is one piece of data that is totally inconsistent with the others it should be reconsidered?

I'd like to improve by score in the benchmark category but to get nearly TWICE as high seems impossible. I was thinking maybe a few percent...

edit: it will be impossible to test stability

The SPB Benchmark score is just a number used to compare devices based on the amount of time it takes to perform a series of tasks. If you take a look at the 'Benchmark Examples' in the OP you will see a breakdown of the scoring. I agree it is peculiar that MalROM scores so high, but if you look at each of his entries, you'll notice that all of his ROMs score high in the SPB Benchmark score.

Anyhow, I'm glad like the thread and the results. Your Baseline 002 ROM almost swept the category, if only MalROM didn't get such high marks in SPB Benchmark...

[mlin]

I have updated with the most recent results I have, including testing of some Titanium ROMs. I will be using my TP2 for a little while and may resume testing later though a date is yet to be determined. Enjoy!

[eatbuckshot]

SPB benchmark consists of a battery of tests. I'm wondering what is causing the spikes to around a thousand and if the attribute tested is something that relates more to more real world performance. Speaking of real world performance, benchmarks are dandy and all, but I wish there were a way to compare the responsiveness and fluidity of interaction with the UI. It's usually all the slight freezes and slow downs that reflect negatively on the "experience." I have these little annoyances all the time, but they add up, leading me to become desperate for something that just doesn't slow down, something that makes things happen as soon as it should happen.

Perhaps my expectations are just way too high for winmo 6.5 on the tp2. However, considering the specifications of the tp2, it should beat out my 6800 and my 6700. Though those had perks making them pretty responsive. I overclocked my 6700 to 600mhz along with the bus and ram speeds, made it actually usable. I put nuerom on the 6800 which surprised me with its speeds despite being 6.5... matching my 6700 and both best my tp2 with any rom...(though tried android out, it seems quite promising)
/rant

[ymarker]

This is great. Could you please add in comparison for the new sprint 6.5 rom. If there was an automated utility, then everyone could run it and report the results, that way you don't have to work on every iteration that comes out - just a thought.

In the meanwhile, thanks for keeping this list updated. Eye candy aside, day to day usage is about nuts and bolts and performance becomes key. This objective benchmark helps.

[burtonsnow8]

thanks for the tests, the info is greatly appreciated. I linked over at xda because people always are asking "whats the fastest rom". do you mind?

[pimpol10]

What about the new Official Sprint 6.5 Rom? Anyway you can compare it???? How fast is it compare to the other ROMs? Thanks Mike

[jrad]

Really nice info i would like to try of few of those

[mlin]

Originally Posted by ymarker

This is great. Could you please add in comparison for the new sprint 6.5 rom. If there was an automated utility, then everyone could run it and report the results, that way you don't have to work on every iteration that comes out - just a thought.

In the meanwhile, thanks for keeping this list updated. Eye candy aside, day to day usage is about nuts and bolts and performance becomes key. This objective benchmark helps.

I have updated the list with the new Sprint ROM and a few others and will post the updated file soon.

Originally Posted by burtonsnow8

thanks for the tests, the info is greatly appreciated. I linked over at xda because people always are asking "whats the fastest rom". do you mind?

Good to know, thanks for posting a link at xda.

Originally Posted by pimpol10

What about the new Official Sprint 6.5 Rom? Anyway you can compare it???? How fast is it compare to the other ROMs? Thanks Mike

On its way, see above.

Originally Posted by jrad

Really nice info i would like to try of few of those

Thanks, I'm glad you guys are finding this information useful.

[pimpol10]

So what's your personal best CUSTOM ROM overall? After seening your, [ROM SHOWDOWN] [3/18] (RAM-Benchmarks-ROM ,it helped me pick my first custom Rom Mr. X 2.5 6.5. and I love it a lot. Thanks so much for the GREAT info. Please keep it up! But what's your favorite Rom??????? Thanks Mike

[bsmoove386]

Will there be new testing? Im interested in seeing which rom works best with MaxManilla cooked in.