PPCGeeks Forums HTC Arrive HTC HD2 HTC Thunderbolt HTC Touch Pro 2 HTC Evo 4G HTC Evo 3D Samsung Galaxy S II Motorola Droid X Apple iPhone Blackberry
Go Back   PPCGeeks > Windows Mobile > WM HTC Devices > HTC Touch Pro
Register Community Search

Notices


Reply
 
LinkBack Thread Tools Display Modes
  #31 (permalink)  
Old 02-03-2009, 06:00 AM
VreebieZ's Avatar
Lurker
Offline
Pocket PC: Apache, Mogul, Touch Pro
Carrier: Sprint
 
Join Date: Jul 2007
Posts: 16
Reputation: 65
VreebieZ is becoming a great contributor
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Lightbulb Comparison Benchmark

As requested, here you go. Spent hours flash and reflash my TP numerous times for this comparison. Hope it helps:

Fresh Benchmark
Flash > AutoReset+Init > Install VSBenchmark to Main Memory > Hard Reset > Run Benchmark (on level surface,all cables disconnected)

JUICY 47 Herman
2223 - 2111 - 2234 [GRAPHICS]
2573 - 2609 - 2613 [OTHERS]
4769 - 4769 - 4835 [JPEG]
1786 - 1786 - 1822 [GAMES]
1064 - 1054 - 1053 [SOUNDS]
2484 - 2464 - 2511 [SCORE]

MIGHTY v4.9.2
2321 [Graphics]
2227 [Others]
4613 [Jpeg]
1996 [Games]
0939 [Sounds]
2419 [SCORE]

KEVAN-K Loaded v1.2
2297 - 2268 [Graphics]
2640 - 2702 [Others]
4691 - 4732 [Jpeg]
1967 - 1969 [Games]
1142 - 0948 [Sounds]
2547 - 2523 [SCORE]
*Lots of useful apps

KEVAN-K Loaded v1.3
2294 - 2312 [Graphics]
2737 - 2625 [Others]
4779 - 4743 [Jpeg]
1989 - 1988 [Games]
0932 - 0943 [Sounds]
2546 - 2522 [SCORE]
*Lots of useful apps


CALKULIN v1.31 Clean
2248 - 2235 - 2247 [Graphics]
2496 - 2471 - 2503 [Others]
26174 - 26174 - 26174 [Jpeg]
1821 - 1813 - 1813 [Games]
1054 - 1057 - 1057 [Sounds]
6758 - 6750 - 6758 [SCORE]
* Very Responsive StartMenu
* JPG Score flies because it's broken -bug?

GC v2.1.4
2314 [Graphics]
2773 [Others]
4712 [Jpeg]
1982 [Games]
0939 [Sounds]
2544 [SCORE]
* TouchFlo not installed

SSK v1.4
2234 [Graphics]
2116 [Others]
26174 [Jpeg]
1800 [Games]
1057 [Sounds]
6676 [SCORE]
* Probably has the same display problem
* Still have verizon reference in the 'Sprint' ver

eRice - CLEAN
2286 [Graphics]
2724 [Others]
4865 [Jpeg]
2024 [Games]
0937 [Sounds]
2567 [SCORE]

I guess my fave overall for ready to use ROM is KevanK's. I really hope there is a Kitchen for it.
-V
Reply With Quote
This post has been thanked 7 times.
  #32 (permalink)  
Old 02-03-2009, 08:02 AM
Maxx134's Avatar
VIP Member
Offline
Pocket PC: Epic Touch 4G
Carrier: Spint
Location: NYC
 
Join Date: Jan 2007
Posts: 1,272
Reputation: 4320
Maxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributionsMaxx134 should be added to the payroll for their contributions
Mentioned: 2 Post(s)
Tagged: 0 Thread(s)
Re: VS Benchmark

Merdins Rom V3.4
touchPro
config:Heavy, activesync srewed my pim with 2215contacts before test
Grafics:2230
others:2020
Jpeg:26174
Games:1801
Sound:1254
Final Score:6695

EDIT: my other results with kk1.3 rom were less than VreebieZ, but ran slightly better in some ways than this nicer looking one, my two favorites, so yes the test results do not reflect the experience of playing with the rom.
Boils down to preference...
Attached Images
File Type: jpg vsb2007-1.jpg (21.4 KB, 9 views) Click for barcode!

Last edited by Maxx134; 02-04-2009 at 07:46 AM.
Reply With Quote
  #33 (permalink)  
Old 02-03-2009, 09:44 AM
schettj's Avatar
morsus mihi
Offline
Pocket PC: iPhone 4
Carrier: AT&T
Location: Not from around these parts
 
Join Date: Oct 2006
Posts: 3,017
Reputation: 3616
schettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIP
Mentioned: 2 Post(s)
Tagged: 0 Thread(s)
Re: VS Benchmark

Guys, all this shows is that the benchmark isn't valid

Post #31 at least tried multiple runs on the same rom/hardware, and various roms on the same hardware.

The only way to make the benchmark meaningful is to control for every variable (ie, every reg setting that changes the score)

Once we have a set of reg settings that we all agree on, and a test procedure we all agree on, then we can generate meaningful numbers (looks like +/- 1% across trials for normal variance) and compare them. That will tell you which rom OS is performing better or worse - likely the results will vary just above the noise (maybe 5% spread.)

Me personally, I don't care But seriously if you want to do this that's the way, and VreebieZ has generated the most useful data so far. Note how all his "good" results were in the ballpark of 2500 (+/- 50, or 2%) - you'd be REALLY hard pressed to notice one device being 2% faster then another as a user.
__________________
Reply With Quote
This post has been thanked 1 times.
  #34 (permalink)  
Old 02-03-2009, 10:10 AM
Isriam's Avatar
PPCGeeks Regular
Offline
Pocket PC: evo 4g
Carrier: boost
 
Join Date: Sep 2007
Posts: 168
Reputation: 145
Isriam is keeping up the good workIsriam is keeping up the good work
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Re: VS Benchmark

I tested VSBenchmark with various reg settings and my score stayed between 2389 and 2396 on over 10 different tests. I agree after playing with this for hours it is worthless.
Reply With Quote
  #35 (permalink)  
Old 02-03-2009, 10:22 AM
BLawicki's Avatar
PPCGeeks Regular
Offline
Pocket PC: Sprint 4G EVO
Carrier: Sprint
Location: South Carolina
 
Join Date: Dec 2008
Posts: 199
Reputation: 185
BLawicki is keeping up the good workBLawicki is keeping up the good work
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Re: VS Benchmark

I think this is great effort for sure. Anyone have linkage to that ATI Driver? Thanks in advance....
__________________
SPRINT 4G EVO
I now know why the female reps have been all annoyed with me for all those "image" apps I downloaded.
Reply With Quote
  #36 (permalink)  
Old 02-04-2009, 04:35 PM
scrosler's Avatar
VIP Member
Offline
Pocket PC: EVO 3D
Carrier: Sprint
Location: Fargo ND
 
Join Date: Aug 2007
Posts: 5,114
Reputation: 20875
scrosler can't get a higher reputation levelscrosler can't get a higher reputation levelscrosler can't get a higher reputation levelscrosler can't get a higher reputation levelscrosler can't get a higher reputation levelscrosler can't get a higher reputation levelscrosler can't get a higher reputation levelscrosler can't get a higher reputation levelscrosler can't get a higher reputation levelscrosler can't get a higher reputation levelscrosler can't get a higher reputation level
Mentioned: 8 Post(s)
Tagged: 0 Thread(s)
Re: Comparison Benchmark

Quote:
Originally Posted by VreebieZ View Post
As requested, here you go. Spent hours flash and reflash my TP numerous times for this comparison. Hope it helps:

Fresh Benchmark
Flash > AutoReset+Init > Install VSBenchmark to Main Memory > Hard Reset > Run Benchmark (on level surface,all cables disconnected)

JUICY 47 Herman
2223 - 2111 - 2234 [GRAPHICS]
2573 - 2609 - 2613 [OTHERS]
4769 - 4769 - 4835 [JPEG]
1786 - 1786 - 1822 [GAMES]
1064 - 1054 - 1053 [SOUNDS]
2484 - 2464 - 2511 [SCORE]

MIGHTY v4.9.2
2321 [Graphics]
2227 [Others]
4613 [Jpeg]
1996 [Games]
0939 [Sounds]
2419 [SCORE]

KEVAN-K Loaded v1.2
2297 - 2268 [Graphics]
2640 - 2702 [Others]
4691 - 4732 [Jpeg]
1967 - 1969 [Games]
1142 - 0948 [Sounds]
2547 - 2523 [SCORE]
*Lots of useful apps

KEVAN-K Loaded v1.3
2294 - 2312 [Graphics]
2737 - 2625 [Others]
4779 - 4743 [Jpeg]
1989 - 1988 [Games]
0932 - 0943 [Sounds]
2546 - 2522 [SCORE]
*Lots of useful apps


CALKULIN v1.31 Clean
2248 - 2235 - 2247 [Graphics]
2496 - 2471 - 2503 [Others]
26174 - 26174 - 26174 [Jpeg]
1821 - 1813 - 1813 [Games]
1054 - 1057 - 1057 [Sounds]
6758 - 6750 - 6758 [SCORE]
* Very Responsive StartMenu
* JPG Score flies because it's broken -bug?

GC v2.1.4
2314 [Graphics]
2773 [Others]
4712 [Jpeg]
1982 [Games]
0939 [Sounds]
2544 [SCORE]
* TouchFlo not installed

SSK v1.4
2234 [Graphics]
2116 [Others]
26174 [Jpeg]
1800 [Games]
1057 [Sounds]
6676 [SCORE]
* Probably has the same display problem
* Still have verizon reference in the 'Sprint' ver

eRice - CLEAN
2286 [Graphics]
2724 [Others]
4865 [Jpeg]
2024 [Games]
0937 [Sounds]
2567 [SCORE]

I guess my fave overall for ready to use ROM is KevanK's. I really hope there is a Kitchen for it.
-V
How come I score in the 6K along with Caulkin but the rest score in the 2K area? Is that a typo? Sorry dont have time to read the thread. will catch up when I am not at work.

Also, have you tried this bench using the SPB app? Just curious.

EDIT: And where did you see the VZW reference?

Thanks!

EDIT2: Nevermind. i ddi the math. Ignore first question. Hehehe
__________________


Donations always accepted but never expected!

Last edited by scrosler; 02-04-2009 at 06:02 PM.
Reply With Quote
  #37 (permalink)  
Old 02-04-2009, 06:44 PM
Hidavi's Avatar
Regular 'Geeker
Offline
Pocket PC: Touch Pro2
Carrier: Sprint
 
Join Date: Apr 2008
Posts: 309
Reputation: 305
Hidavi is becoming a PPCGeeks regularHidavi is becoming a PPCGeeks regularHidavi is becoming a PPCGeeks regularHidavi is becoming a PPCGeeks regular
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Re: VS Benchmark

Quote:
Originally Posted by schettj View Post
Guys, all this shows is that the benchmark isn't valid
Thats not what it means at all. There is always a margin of error with experimentation which is why experiments are always done in multiple trials.

I think a better procedure would be to take three trials of each one and average the results. Lots of work though so I don't blame anyone for not doing it
Reply With Quote
  #38 (permalink)  
Old 02-04-2009, 09:41 PM
schettj's Avatar
morsus mihi
Offline
Pocket PC: iPhone 4
Carrier: AT&T
Location: Not from around these parts
 
Join Date: Oct 2006
Posts: 3,017
Reputation: 3616
schettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIPschettj is still contributing even after becoming a VIP
Mentioned: 2 Post(s)
Tagged: 0 Thread(s)
Re: Comparison Benchmark

Quote:
Originally Posted by scrosler View Post
How come I score in the 6K along with Caulkin but the rest score in the 2K area? Is that a typo? Sorry dont have time to read the thread. will catch up when I am not at work.
26174 [Jpeg]

There is some "bug" in some of the custom roms that give a wildly high score on the Jpeg test, and end up giving you an impressively invalid total score
Reply With Quote
  #39 (permalink)  
Old 02-07-2009, 06:15 AM
EtherealRemnant's Avatar
*SCREEEEEECH*
Offline
Pocket PC: Touch Pro2
Carrier: Sprint
Location: Lakewood/Morrison CO
 
Join Date: Jan 2007
Posts: 2,044
Reputation: 589
EtherealRemnant knows their stuffEtherealRemnant knows their stuffEtherealRemnant knows their stuffEtherealRemnant knows their stuffEtherealRemnant knows their stuffEtherealRemnant knows their stuff
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Re: VS Benchmark

2727 on MightyROM 4.9.4
__________________
***If I've helped you, don't forget to click the http://67.228.199.237/forum.ppcgeeks...ost_thanks.gif button!***

Comcast EXTREME:

http://www.speedtest.net/result/584166480.png
Reply With Quote
  #40 (permalink)  
Old 02-07-2009, 01:52 PM
Hidavi's Avatar
Regular 'Geeker
Offline
Pocket PC: Touch Pro2
Carrier: Sprint
 
Join Date: Apr 2008
Posts: 309
Reputation: 305
Hidavi is becoming a PPCGeeks regularHidavi is becoming a PPCGeeks regularHidavi is becoming a PPCGeeks regularHidavi is becoming a PPCGeeks regular
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Re: VS Benchmark

Quote:
Originally Posted by EtherealRemnant View Post
2727 on MightyROM 4.9.4
what subcategory? (graphics, other, etc)
Reply With Quote
Reply

  PPCGeeks > Windows Mobile > WM HTC Devices > HTC Touch Pro


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


All times are GMT -4. The time now is 04:39 PM.


Powered by vBulletin® ©2000 - 2025, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO 3.6.0
©2012 - PPCGeeks.com