[Comparison] How the Diamond roms stack up! (6 different roms)

ajm144k · #1 (**permalink**) 01-05-2009, 04:35 AM

for those that havent used spb benchmark, it basically does a bunch of the basic operations you use on your phone and then charts the results based against the ipaq 3650. just a good way of getting some real numbers to compare.
want to try this for yourself? Get SPB Benchmark

here is the process i took before running the benchmark program:
1) make sure the pagepool is set to 20
2) flash, and let customizations run.
3) once everything was set, with tf3d and whatever else is set by default to run (but no other apps running), i waited about a minute then took down the memory numbers (avail, in use, free)
4) connected the phone to my comp and installed spb benchmark to the phone
5) ran it, while still connected via usb to my computer.

mightyrom 3.9

Code:

*20 mb pagepool
 -total: 196
 -in use: 68
 -free: 128


Spb Benchmark index 474.88 (iPAQ 3650 scored 1000) 
CPU index 2230.69 (iPAQ 3650 scored 1000) 
File system index 197.46 (iPAQ 3650 scored 1000) 
Graphics index 1594.67 (iPAQ 3650 scored 1000) 

Test Time Speed % of iPAQ 3650* speed 
Write 1 MB file  588 ms  1741 KB/sec  219%  
Read 1 MB file  36 ms  27.8 MB/sec  153%  
Copy 1 MB file  754 ms  1358 KB/sec  172%  
Write 10 KB x 100 files  4393 ms  233 KB/sec  42%  
Read 10 KB x 100 files  352 ms  2.84 MB/sec  45%  
Copy 10 KB x 100 files  4161 ms  246 KB/sec  52%  
Directory list of 2000 files  1240 ms  1.61 thousands of files/sec  1%  
Internal database read  636 ms  1573 records/sec  373%  
Graphics test: DDB BitBlt  6.35 ms  157 frames/sec  585%  
Graphics test: DIB BitBlt  24.6 ms  40.6 frames/sec  301%  
Graphics test: GAPI BitBlt  5.71 ms  175 frames/sec  81%  
Compress 1 MB file using ZIP  2688 ms  377 KB/sec  355%  
Decompress 1024x768 JPEG file  419 ms  671 KB/sec  210%  
Arkaball frames per second  8.57 ms  117 frames/sec  108%  
CPU test: Whetstones MFLOPS  3645 ms  0.102 Mop/sec  221%  
CPU test: Whetstones MOPS  1025 ms  61.4 Mop/sec  180%  
CPU test: Whetstones MWIPS  7295 ms  6.85 Mop/sec  230%  
Memory test: copy 1 MB using memcpy  8.86 ms  113 MB/sec  160%

juicy 4.4

Code:

*20 mb pagepool
 -total: 204
 -in use: 76
 -free: 128

Spb Benchmark index 493.79 (iPAQ 3650 scored 1000) 
CPU index 2267.54 (iPAQ 3650 scored 1000) 
File system index 206.05 (iPAQ 3650 scored 1000) 
Graphics index 1653.22 (iPAQ 3650 scored 1000) 

Test Time Speed % of iPAQ 3650* speed 
Write 1 MB file  577 ms  1776 KB/sec  224%  
Read 1 MB file  36.9 ms  27.1 MB/sec  149%  
Copy 1 MB file  748 ms  1369 KB/sec  173%  
Write 10 KB x 100 files  4080 ms  251 KB/sec  45%  
Read 10 KB x 100 files  187 ms  5.34 MB/sec  84%  
Copy 10 KB x 100 files  3904 ms  262 KB/sec  55%  
Directory list of 2000 files  1249 ms  1.6 thousands of files/sec  1%  
Internal database read  673 ms  1486 records/sec  353%  
Graphics test: DDB BitBlt  4.66 ms  215 frames/sec  797%  
Graphics test: DIB BitBlt  24.1 ms  41.5 frames/sec  307%  
Graphics test: GAPI BitBlt  5.68 ms  176 frames/sec  82%  
Compress 1 MB file using ZIP  2633 ms  385 KB/sec  363%  
Decompress 1024x768 JPEG file  410 ms  685 KB/sec  215%  
Arkaball frames per second  8.42 ms  119 frames/sec  110%  
CPU test: Whetstones MFLOPS  3609 ms  0.103 Mop/sec  223%  
CPU test: Whetstones MOPS  1008 ms  62.5 Mop/sec  183%  
CPU test: Whetstones MWIPS  7208 ms  6.94 Mop/sec  233%  
Memory test: copy 1 MB using memcpy  8.76 ms  114 MB/sec  162%

alltel stock rom:

Code:

*20 mb pagepool
 -total: 204
 -in use: 65
 -free: 138

Spb Benchmark index 418.81 (iPAQ 3650 scored 1000) 
CPU index 2253.03 (iPAQ 3650 scored 1000) 
File system index 170.05 (iPAQ 3650 scored 1000) 
Graphics index 1615.87 (iPAQ 3650 scored 1000) 

Test Time Speed % of iPAQ 3650* speed 
Write 1 MB file  606 ms  1691 KB/sec  213%  
Read 1 MB file  39.3 ms  25.4 MB/sec  140%  
Copy 1 MB file  758 ms  1351 KB/sec  171%  
Write 10 KB x 100 files  6205 ms  165 KB/sec  29%  
Read 10 KB x 100 files  421 ms  2.38 MB/sec  37%  
Copy 10 KB x 100 files  6104 ms  168 KB/sec  35%  
Directory list of 2000 files  1395 ms  1.43 thousands of files/sec  1%  
Internal database read  654 ms  1529 records/sec  363%  
Graphics test: DDB BitBlt  6.2 ms  161 frames/sec  599%  
Graphics test: DIB BitBlt  24.4 ms  41 frames/sec  303%  
Graphics test: GAPI BitBlt  5.64 ms  177 frames/sec  82%  
Compress 1 MB file using ZIP  2683 ms  378 KB/sec  356%  
Decompress 1024x768 JPEG file  414 ms  678 KB/sec  212%  
Arkaball frames per second  8.43 ms  119 frames/sec  110%  
CPU test: Whetstones MFLOPS  3674 ms  0.101 Mop/sec  219%  
CPU test: Whetstones MOPS  1010 ms  62.4 Mop/sec  183%  
CPU test: Whetstones MWIPS  7232 ms  6.91 Mop/sec  232%  
Memory test: copy 1 MB using memcpy  8.74 ms  114 MB/sec  163%

grooveROM 2.8 (w/o TF3D)

Code:

SYS/OS 20954
16MB PP

Total: 200.84MB
In Use: 50.93MB
Free: 149.91MB

Spb Benchmark index 487.03 (iPAQ 3650 scored 1000) 
CPU index 2212.09 (iPAQ 3650 scored 1000) 
File system index 203.89 (iPAQ 3650 scored 1000) 
Graphics index 1560.87 (iPAQ 3650 scored 1000) 

Test Time Speed % of iPAQ 3650* speed 
Write 1 MB file  591 ms  1734 KB/sec  218%  
Read 1 MB file  36.5 ms  27.4 MB/sec  150%  
Copy 1 MB file  771 ms  1328 KB/sec  168%  
Write 10 KB x 100 files  4203 ms  244 KB/sec  43%  
Read 10 KB x 100 files  191 ms  5.24 MB/sec  83%  
Copy 10 KB x 100 files  3905 ms  262 KB/sec  55%  
Directory list of 2000 files  1262 ms  1.59 thousands of files/sec  1%  
Internal database read  671 ms  1489 records/sec  353%  
Graphics test: DDB BitBlt  6.5 ms  154 frames/sec  572%  
Graphics test: DIB BitBlt  25.1 ms  39.9 frames/sec  295%  
Graphics test: GAPI BitBlt  5.84 ms  171 frames/sec  80%  
Compress 1 MB file using ZIP  2702 ms  375 KB/sec  354%  
Decompress 1024x768 JPEG file  421 ms  668 KB/sec  209%  
Arkaball frames per second  8.6 ms  116 frames/sec  107%  
CPU test: Whetstones MFLOPS  3710 ms  0.1 Mop/sec  217%  
CPU test: Whetstones MOPS  1037 ms  60.8 Mop/sec  178%  
CPU test: Whetstones MWIPS  7392 ms  6.76 Mop/sec  227%  
Memory test: copy 1 MB using memcpy  8.96 ms  112 MB/sec  159%

conflipper 12/21

Code:

*20 mb pagepool:
 -total: 196
 -in use: 66
 -free: 130

Spb Benchmark index 495.96 (iPAQ 3650 scored 1000) 
CPU index 2255.25 (iPAQ 3650 scored 1000) 
File system index 200 (iPAQ 3650 scored 1000) 
Graphics index 4109.82 (iPAQ 3650 scored 1000) 

Test Time Speed % of iPAQ 3650* speed 
Write 1 MB file  590 ms  1736 KB/sec  219%  
Read 1 MB file  37.7 ms  26.5 MB/sec  146%  
Copy 1 MB file  755 ms  1357 KB/sec  172%  
Write 10 KB x 100 files  4698 ms  218 KB/sec  39%  
Read 10 KB x 100 files  206 ms  4.87 MB/sec  77%  
Copy 10 KB x 100 files  4470 ms  229 KB/sec  48%  
Directory list of 2000 files  1263 ms  1.58 thousands of files/sec  1%  
Internal database read  714 ms  1401 records/sec  332%  
Graphics test: DDB BitBlt  6.21 ms  161 frames/sec  598%  
Graphics test: DIB BitBlt  24.2 ms  41.4 frames/sec  306%  
Graphics test: GAPI BitBlt  1.29 ms  775 frames/sec  360%  
Compress 1 MB file using ZIP  2747 ms  369 KB/sec  348%  
Decompress 1024x768 JPEG file  409 ms  687 KB/sec  215%  
Arkaball frames per second  3.74 ms  267 frames/sec  247%  
CPU test: Whetstones MFLOPS  3596 ms  0.103 Mop/sec  224%  
CPU test: Whetstones MOPS  1009 ms  62.4 Mop/sec  183%  
CPU test: Whetstones MWIPS  7195 ms  6.95 Mop/sec  233%  
Memory test: copy 1 MB using memcpy  8.72 ms  115 MB/sec  163%

BuildOS 20931 (with only very basic apps):

Code:

*20 mb dynamic pagepool
 -total: 196
 -in use: 59
 -free: 137

Spb Benchmark index 450.69 (iPAQ 3650 scored 1000) 
CPU index 2259.42 (iPAQ 3650 scored 1000) 
File system index 184.96 (iPAQ 3650 scored 1000) 
Graphics index 1672.74 (iPAQ 3650 scored 1000) 

Test Time Speed % of iPAQ 3650* speed 
Write 1 MB file  585 ms  1750 KB/sec  220%  
Read 1 MB file  36.8 ms  27.2 MB/sec  149%  
Copy 1 MB file  749 ms  1367 KB/sec  173%  
Write 10 KB x 100 files  4530 ms  226 KB/sec  40%  
Read 10 KB x 100 files  350 ms  2.86 MB/sec  45%  
Copy 10 KB x 100 files  4377 ms  234 KB/sec  49%  
Directory list of 2000 files  1342 ms  1.49 thousands of files/sec  1%  
Internal database read  692 ms  1445 records/sec  343%  
Graphics test: DDB BitBlt  4.74 ms  211 frames/sec  785%  
Graphics test: DIB BitBlt  24.2 ms  41.3 frames/sec  306%  
Graphics test: GAPI BitBlt  5.59 ms  179 frames/sec  83%  
Compress 1 MB file using ZIP  2684 ms  377 KB/sec  356%  
Decompress 1024x768 JPEG file  410 ms  686 KB/sec  215%  
Arkaball frames per second  8.39 ms  119 frames/sec  110%  
CPU test: Whetstones MFLOPS  3590 ms  0.104 Mop/sec  224%  
CPU test: Whetstones MOPS  1008 ms  62.5 Mop/sec  183%  
CPU test: Whetstones MWIPS  7203 ms  6.94 Mop/sec  233%  
Memory test: copy 1 MB using memcpy  8.77 ms  114 MB/sec  162%

king_tee · #2 (**permalink**) 01-05-2009, 05:56 AM

Good Post

**indagroove** · #3 (**permalink**) 01-05-2009, 06:03 AM

Here's the benchmarks for the upcoming grooveROM 2.8 w/o TF3D:

SYS/OS 20954
16MB PP

Total: 200.84MB
In Use: 50.93MB
Free: 149.91MB

Code:

Spb Benchmark index 487.03 (iPAQ 3650 scored 1000) 
CPU index 2212.09 (iPAQ 3650 scored 1000) 
File system index 203.89 (iPAQ 3650 scored 1000) 
Graphics index 1560.87 (iPAQ 3650 scored 1000) 

Test Time Speed % of iPAQ 3650* speed 
Write 1 MB file  591 ms  1734 KB/sec  218%  
Read 1 MB file  36.5 ms  27.4 MB/sec  150%  
Copy 1 MB file  771 ms  1328 KB/sec  168%  
Write 10 KB x 100 files  4203 ms  244 KB/sec  43%  
Read 10 KB x 100 files  191 ms  5.24 MB/sec  83%  
Copy 10 KB x 100 files  3905 ms  262 KB/sec  55%  
Directory list of 2000 files  1262 ms  1.59 thousands of files/sec  1%  
Internal database read  671 ms  1489 records/sec  353%  
Graphics test: DDB BitBlt  6.5 ms  154 frames/sec  572%  
Graphics test: DIB BitBlt  25.1 ms  39.9 frames/sec  295%  
Graphics test: GAPI BitBlt  5.84 ms  171 frames/sec  80%  
Compress 1 MB file using ZIP  2702 ms  375 KB/sec  354%  
Decompress 1024x768 JPEG file  421 ms  668 KB/sec  209%  
Arkaball frames per second  8.6 ms  116 frames/sec  107%  
CPU test: Whetstones MFLOPS  3710 ms  0.1 Mop/sec  217%  
CPU test: Whetstones MOPS  1037 ms  60.8 Mop/sec  178%  
CPU test: Whetstones MWIPS  7392 ms  6.76 Mop/sec  227%  
Memory test: copy 1 MB using memcpy  8.96 ms  112 MB/sec  159%

**conflipper** · #4 (**permalink**) 01-05-2009, 10:56 AM

mind testing out mine and throwing it up there. it would be interesting to see. if you have time.

mnassoiy · #5 (**permalink**) 01-05-2009, 11:13 AM

Nice work! This is great seeing all of the hard data comparisons....

**MightyMike** · #6 (**permalink**) 01-05-2009, 01:06 PM

Good stuff

ajm144k · #7 (**permalink**) 01-05-2009, 02:58 PM

Quote:

Originally Posted by conflipper

mind testing out mine and throwing it up there. it would be interesting to see. if you have time.

i actually had yours done before, but then something went wrong with my phone (i described it in your thread) so then i lost the resutls! but i plan on doing it again.

and maybe calcu's too.. soon as i try to figure out all his kitchens and sys's and stuff

ajm144k · #8 (**permalink**) 01-05-2009, 03:04 PM

Quote:

Originally Posted by indagroove

Here's the benchmarks for the upcoming grooveROM 2.8 w/o TF3D:

hey ill put this into the first post. seems like it belongs there?

i can only use roms that can run on alltel, so if anyone else wants to follow groove's path and get the results for their rom, i can also put your results on that first post with all the others. (to keep it fair/even, try and keep the pagepool around 20)

Glossman · #9 (**permalink**) 01-05-2009, 03:40 PM

I'd love to see how my Blue ROM stacks up against the rest of these great ROMs. That is, if it's not too much trouble!

Thanks for the informative post!

ajm144k · #10 (**permalink**) 01-05-2009, 04:11 PM

Quote:

Originally Posted by Glossman

I'd love to see how my Blue ROM stacks up against the rest of these great ROMs. That is, if it's not too much trouble!

Thanks for the informative post!

well, i probably would have it up there already.....but, i dont have Sprint or Telus! i cant run your rom..