[ROM SHOWDOWN] [UPDATE 5/15] (RAM-Benchmarks-ROM) **Objective Analysis**

[raidzero]

Thanks mlin! its cool to see how your ROM stack up against others from an unbiased perspective. the question now is, what exactly is SPB benchmark score (I know was SPB benchmark is, I have run it myself..) and why is malrom like twice as high as all the others? seems like when there is one piece of data that is totally inconsistent with the others it should be reconsidered?

I'd like to improve by score in the benchmark category but to get nearly TWICE as high seems impossible. I was thinking maybe a few percent...

edit: it will be impossible to test stability

[mlin]

Originally Posted by raidzero

Thanks mlin! its cool to see how your ROM stack up against others from an unbiased perspective. the question now is, what exactly is SPB benchmark score (I know was SPB benchmark is, I have run it myself..) and why is malrom like twice as high as all the others? seems like when there is one piece of data that is totally inconsistent with the others it should be reconsidered?

I'd like to improve by score in the benchmark category but to get nearly TWICE as high seems impossible. I was thinking maybe a few percent...

edit: it will be impossible to test stability

The SPB Benchmark score is just a number used to compare devices based on the amount of time it takes to perform a series of tasks. If you take a look at the 'Benchmark Examples' in the OP you will see a breakdown of the scoring. I agree it is peculiar that MalROM scores so high, but if you look at each of his entries, you'll notice that all of his ROMs score high in the SPB Benchmark score.

Anyhow, I'm glad like the thread and the results. Your Baseline 002 ROM almost swept the category, if only MalROM didn't get such high marks in SPB Benchmark...

[fastmike]

Originally Posted by raidzero

and why is malrom like twice as high as all the others? seems like when there is one piece of data that is totally inconsistent with the others it should be reconsidered?

Interesting question, I was thinking the same thing. I use the example benchmark score and it looks like a single test which are throwing off the average composite score

Mighty actually showed better across the board except that one test!

• Arkaball
  • Mighty 141 fps
  • Mal 71 fps
• Directory listing
  • Mighty 1104 ms
  • MalRom 366 ms

Here's a reverse sort of the Mighty times vs the Malrom times (more neg=Mighty faster):

Graphics -149% Arkaball -95% Read -28% Write -16% Memory -15% Write -14% CPU -14% CPU -14% CPU -14% Copy -13% Decompress -12% Copy -11% Graphics -10% Compress -9% Graphics -7% Internal -3% Read -1% Directory 67%

[RE90]

would it be pointless to ask for verizon's stock roms (6.1 and 6.5?) because we already have sprint's?