PPCGeeks

PPCGeeks (http://forum.ppcgeeks.com/index.php)
-   Android On TP2 (http://forum.ppcgeeks.com/forumdisplay.php?f=179)
-   -   Need files to trace OpenGl (http://forum.ppcgeeks.com/showthread.php?t=125379)

newkidd 06-29-2010 03:23 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1840823)
Here is a quick update. I havent solved the puzzle yet, but i have been working with some of the blackstone devs since they have a 3d issue as well. We figured comparing clock values would help. Turns out the dlls values on both black and rhod are identical. This is disappointing since i figured maybe the clocks were wrong and thats why it was not working.

.text:10004CE8 ; =============== S U B R O U T I N E =======================================
.text:10004CE8
.text:10004CE8
.text:10004CE8 sub_10004CE8 ; CODE XREF: sub_10004EC4+430p
.text:10004CE8 ; DATA XREF: .pdata:10008348o
.text:10004CE8 STMFD SP!, {R4,LR}
.text:10004CEC CMP R0, #0
.text:10004CF0 BEQ loc_10004DB8
.text:10004CF4 LDR R4, =unk_100071DC
.text:10004CF8 MOVL R1, 0x11F
.text:10004D00 LDR R2, [R4,#8]
.text:10004D04 MOV R0, #2
.text:10004D08 LDR R3, [R2,#0x208]
.text:10004D0C ORR R3, R3, #0x20
.text:10004D10 STR R3, [R2,#0x208]
.text:10004D14 LDR R2, [R4,#8]
.text:10004D18 LDR R3, [R2,#0x214]
.text:10004D1C ORR R3, R3, #0x20000
.text:10004D20 STR R3, [R2,#0x214]
.text:10004D24 LDR R3, [R4,#8]
.text:10004D28 STR R1, [R3,#0x284]
.text:10004D2C BL sub_10004CAC
.text:10004D30 LDR R2, [R4,#8]
.text:10004D34 LDR R3, [R2,#0x84]
.text:10004D38 ORR R3, R3, #0x800
.text:10004D3C STR R3, [R2,#0x84]
.text:10004D40 LDR R2, [R4,#8]
.text:10004D44 LDR R3, [R2,#0x84]
.text:10004D48 ORR R3, R3, #0x80
.text:10004D4C STR R3, [R2,#0x84]
.text:10004D50 LDR R2, [R4,#8]
.text:10004D54 LDR R3, [R2,#0x84]
.text:10004D58 ORR R3, R3, #0x200
.text:10004D5C STR R3, [R2,#0x84]
.text:10004D60 LDR R2, [R4,#8]
.text:10004D64 LDR R3, [R2]
.text:10004D68 ORR R3, R3, #8
.text:10004D6C STR R3, [R2]
.text:10004D70 LDR R2, [R4,#8]
.text:10004D74 LDR R3, [R2,#0x290]!
.text:10004D78 BIC R3, R3, #4
.text:10004D7C STR R3, [R2]
.text:10004D80 LDR R2, [R4]
.text:10004D84 LDR R3, [R2,#0x80]
.text:10004D88 BIC R3, R3, #1
.text:10004D8C STR R3, [R2,#0x80]
.text:10004D90 LDR R2, [R4,#8]
.text:10004D94 LDR R3, [R2,#0x208]
.text:10004D98 BIC R3, R3, #0x20
.text:10004D9C STR R3, [R2,#0x208]
.text:10004DA0 LDR R2, [R4,#8]
.text:10004DA4 LDR R3, [R2,#0x214]
.text:10004DA8 BIC R3, R3, #0x20000
.text:10004DAC STR R3, [R2,#0x214]
.text:10004DB0 LDMFD SP!, {R4,LR}
.text:10004DB4 BX LR

All those values above can be found on our kernel which now makes me think i have to look at something else. The weird thing is that when we dump clocks from haret, it does not match the above values .. lol so we have asm that is lying? or there is another call we are missing and not analysing . Whatever it is, the search continues.

what about tricking the 3d chip. if 3d was activated through a program that activated hw3d, then booted haret, tell android that hw3d is already initialized, then give it the call to turn it off.

since im backtracking through the IRC logs and everything else i dont know what you have tried and havent tried.

[ACL] 06-29-2010 03:57 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by newkidd (Post 1844071)
what about tricking the 3d chip. if 3d was activated through a program that activated hw3d, then booted haret, tell android that hw3d is already initialized, then give it the call to turn it off.

since im backtracking through the IRC logs and everything else i dont know what you have tried and havent tried.

That actually has been tried many times in the past by the other devs. I tried it myself just incase, and no results.

I'm going to explain what happens during boot so everyone can understand why this is a pain.

Once haret loads, wince is no longer in-charge of the device. We must enable and disable everything.. kernel starts loading and it loads the appropriate drivers. The kernel also has to re-enable all the clocks needed for regular function. There are tons of clocks, but the ones we were concentrating on are the gpu clocks. Ok, so we set the clocks according to the assembly dump you see. Now once Linux is up (not android since thats just a layer above which we arent worried about yet) we should be able to run basic GL test applications. I have written a few that work on other devices, so they are valid apps. When we run these apps on the tp2, the gpu does not respond.

The gpu has an interrupt assigned to it. So lets say we have an app that uses 3d, the gpu should respond back and do its magic. Right now for us it does not. So all the test applications just loop and loop not actually showing anything on screen.

You can verify this by typing "cat /proc/interrupts" and looking for hw3d and a nice fat 0 next to it. Right now the Rhod and Topaz are the only ones suffering from this.

Hope that makes sense.

Also if you are interested in seeing how that ASM relates to the .c file in the kerne. Take a look at what is being done now. You will notice the values are the same.

REG_OR( MSM_AXI_RESET, 0x20 );
REG_OR( MSM_ROW_RESET, 0x20000 );
REG_SET( MSM_VDD_GRP_GFS_CTL, 0x11f );
REG_OR( MSM_GRP_NS_REG, 0x800 );
REG_OR( MSM_GRP_NS_REG, 0x80 );
REG_OR( MSM_GRP_NS_REG, 0x200 );
REG_OR( MSM_CLK_CTL_BASE, 0x8 ); // grp idx
REG_AND( MSM_RAIL_CLAMP_IO, 0x4 );
REG_AND( MSM_PRPH_WEB_NS_REG, 0x1 ); // Suppress bit 0 of grp MD
REG_AND( MSM_AXI_RESET, 0x20 );
REG_AND( MSM_ROW_RESET, 0x20000 );

[ACL] 07-03-2010 04:30 PM

Re: Need files to trace OpenGl
 
Got plenty of work to do. Can anyone compare to see if there are binary differences between ddi.dll from rhod to lets say a (kovsky or blackstone)?

veeeee 07-03-2010 06:34 PM

Re: Need files to trace OpenGl
 
1 Attachment(s)
I compared the blackstone ddi.dll to the rhodium ddi.dll and there are differences. I am attaching the .dll's in case you want to inspect them yourself.

[ACL] 07-03-2010 08:55 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by veeeee (Post 1850594)
I compared the blackstone ddi.dll to the rhodium ddi.dll and there are differences. I am attaching the .dll's in case you want to inspect them yourself.

Awesome.. thanks man.

i wont be able to do much tonight.. maybe the other guys here can help disassemble and check out the differences?.

ill definitely take a look tomorrow.

[ACL] 07-04-2010 08:55 PM

Re: Need files to trace OpenGl
 
how do i see these files ? i see just bunch of s00X stuff.. i need the dlls itself.

WoZZeR999 07-04-2010 11:28 PM

Re: Need files to trace OpenGl
 
1 Attachment(s)
Quote:

Originally Posted by [ACL] (Post 1851588)
how do i see these files ? i see just bunch of s00X stuff.. i need the dlls itself.


They need to be recmodded. Here they are.

[ACL] 07-05-2010 03:47 AM

Re: Need files to trace OpenGl
 
thanks man. I compared them and they are way different. Too different for me to even tell whats going on.

reason i wanted to compare was because the blacstone currently has a working interrupt while we dont. Unfortunately i dont know enough about arm asm to tell whats going on. i'll need to hand this over to some of the asm gurus.

In other news, i got AhiEnableSoftInterrupt to run on both wince and android. Unfortunately after testing it turns out it was already enabled on android. So why dont we have 3d? it boggles the mind i tell you. It looks like that calls is only for the driver itself .. it doesnt make any calls to the system to actually enable interrupts.

newkidd 07-05-2010 11:28 AM

Re: Need files to trace OpenGl
 
ill pull them both apart and see if there are any major differences worth finding. ive been needing to boot back to windows and reformat a hard drive to use on my Wii, i was just looking for a reason :)


so the interrupts were already in place? thats a positive, although it confuses me. was it not already running in wince?

i was thinking the other day, probaly going around in circles, but it made me wonder on something you said.

Quote:

Originally Posted by [ACL
]Once haret loads, wince is no longer in-charge of the device. We must enable and disable everything.. kernel starts loading and it loads the appropriate drivers.

so what happens on other devices, where we had to make a phone call and then boot haret. was it much easier to initiate phone audio with it already "running" or what?

also, can you do me a favor whenever you get the chance? can you send me some logs in wince when you are doing several procedures? initiate a game that uses hw3d, a game that doesnt activate 3d, and when playing back a video recorded by the phone through windows media player.

just looking at a few things, but really anyone can do this. what would really help is to get the boot logs from several native android devices, and maybe some logs using hw3d. it really doesnt matter which device, as essentially initiating the drivers and calling them should correlate.

[ACL] 07-05-2010 01:14 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by newkidd (Post 1851965)
ill pull them both apart and see if there are any major differences worth finding. ive been needing to boot back to windows and reformat a hard drive to use on my Wii, i was just looking for a reason :)


so the interrupts were already in place? thats a positive, although it confuses me. was it not already running in wince?

i was thinking the other day, probably going around in circles, but it made me wonder on something you said.



so what happens on other devices, where we had to make a phone call and then boot haret. was it much easier to initiate phone audio with it already "running" or what?

also, can you do me a favor whenever you get the chance? can you send me some logs in wince when you are doing several procedures? initiate a game that uses hw3d, a game that doesnt activate 3d, and when playing back a video recorded by the phone through windows media player.

just looking at a few things, but really anyone can do this. what would really help is to get the boot logs from several native android devices, and maybe some logs using hw3d. it really doesnt matter which device, as essentially initiating the drivers and calling them should correlate.

Well, phone call stuff works since its all done by A9. we really dont need ot do anything. Its handled internally. Things like 3d, need calls to be made to enable and disable it.

Android devices are completely different. For example all their clocks are also handled internally not like wince that has to set its own stuff. So once haret boots, no one is there to handle it any-more. I'm interested to see what would happen with a Rhod that has no 3d. We have everything in theory ready to turn on 3d, maybe the fact that its enabled messes it up. Dont know at this stage

Wince logs are useless. But here is a full boot log to show you what happens as soon as the device turns on, to when it begins activating 3d for manila.

http://pastebin.com/M1Ad4YMv

Also i put my own debug lines on the kernel to get more logging. So logs from android devices wont help since they dont tell the whole story.

newkidd 07-05-2010 04:48 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1852052)
Well, phone call stuff works since its all done by A9. we really dont need ot do anything. Its handled internally. Things like 3d, need calls to be made to enable and disable it.

Android devices are completely different. For example all their clocks are also handled internally not like wince that has to set its own stuff. So once haret boots, no one is there to handle it any-more. I'm interested to see what would happen with a Rhod that has no 3d. We have everything in theory ready to turn on 3d, maybe the fact that its enabled messes it up. Dont know at this stage

Wince logs are useless. But here is a full boot log to show you what happens as soon as the device turns on, to when it begins activating 3d for manila.

http://pastebin.com/M1Ad4YMv

Also i put my own debug lines on the kernel to get more logging. So logs from android devices wont help since they dont tell the whole story.


i was mainly trying to get the wince logs for my personal uses, but i can grab it whenever i boot back over to ubuntu.

what else uses the 3d chip? maybe something is configured wrong with the setup and its keeping the calls from working?

[ACL] 07-05-2010 05:14 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by newkidd (Post 1852268)
i was mainly trying to get the wince logs for my personal uses, but i can grab it whenever i boot back over to ubuntu.

what else uses the 3d chip? maybe something is configured wrong with the setup and its keeping the calls from working?

Well.. Manila has 3d wide open. its always on. If you turn off 3d, then manila becomes useless. It would be nice if we had someone with a vanilla rom who can try out 3d. Im wondering if having it enabled is causing the issue.

As a test i ran haret with the lcd off since thats when everything is off. Android doesnt boot. It loops because 3d on the animation screen tries to wake up the lcd but it cant.

WoZZeR999 07-05-2010 06:50 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1852291)
Well.. Manila has 3d wide open. its always on. If you turn off 3d, then manila becomes useless. It would be nice if we had someone with a vanilla rom who can try out 3d. Im wondering if having it enabled is causing the issue.

As a test i ran haret with the lcd off since thats when everything is off. Android doesnt boot. It loops because 3d on the animation screen tries to wake up the lcd but it cant.


You can try just disabling Manila as a today plug-in. That should keep it from starting up. That might help you out. I can also find a sprint rom and cook you a HTC-less rom.

[ACL] 07-05-2010 08:02 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by WoZZeR999 (Post 1852422)
You can try just disabling Manila as a today plug-in. That should keep it from starting up. That might help you out. I can also find a sprint rom and cook you a HTC-less rom.

we need a guinea pig .. lol

kroewe 07-05-2010 08:34 PM

Re: Need files to trace OpenGl
 
i turned off sense/manila and adroid wouldnt boot at all
tried several different times, switching back to sense it would boot, disable it, wont boot.

[ACL] 07-06-2010 12:42 AM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by kroewe (Post 1852529)
i turned off sense/manila and adroid wouldnt boot at all
tried several different times, switching back to sense it would boot, disable it, wont boot.

holy crap really? thats odd actually.

You happen to have any kernel logs or adb logs ? without it we cant really tell why its failing.

newkidd 07-06-2010 01:46 AM

Re: Need files to trace OpenGl
 
yeah noticed the same thing. starts to load, then does a 7s before reboot. tried 4 times. running mp4 through windows media however allow it to boot. same with having doom running, then hitting start and running my haret shortcut allows it to boot as well. fyi

[ACL] 07-07-2010 01:26 AM

Re: Need files to trace OpenGl
 
Thats odd. I disabled manila (i think i did at least) and put the default winmo crap and my android still boots. Did you guys do anything different? Do i actually have to remove sense out of the phone. I'm interested in seeing why it does not load for you guys.

WoZZeR999 07-07-2010 03:10 AM

Re: Need files to trace OpenGl
 
I'll run some tests tomorrow. I'm assuming this rom: RaidZero*Android Loader does not have manila on it, so it should not make a difference.

[ACL] 07-07-2010 09:18 AM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by WoZZeR999 (Post 1854402)
I'll run some tests tomorrow. I'm assuming this rom: RaidZero*Android Loader does not have manila on it, so it should not make a difference.

yeah.. and if it does.. can you get some logs? if you got your kernel compiled already. Enable ramconsole since by defaul its disabled. This way you can always get a copy of your boot log incase there is a crash :-)

sebbo90 07-07-2010 09:41 AM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1854342)
Thats odd. I disabled manila (i think i did at least) and put the default winmo crap and my android still boots. Did you guys do anything different? Do i actually have to remove sense out of the phone. I'm interested in seeing why it does not load for you guys.

I have just the energy titanium rom on so no manila and android boots up totally fine haven't had a problem

newkidd 07-07-2010 01:58 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1854342)
Thats odd. I disabled manila (i think i did at least) and put the default winmo crap and my android still boots. Did you guys do anything different? Do i actually have to remove sense out of the phone. I'm interested in seeing why it does not load for you guys.


i was running maxsense (bignadad's rom), but i flashed NRG's max sense and it did the same thing.

what rom are you running?

maybe the clocks are set with the idea that hw3d is already enabled, however if hw3d isnt already enabled and running, it crashes because the clocks arent right for that session?

[ACL] 07-08-2010 08:44 AM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by newkidd (Post 1854911)
i was running maxsense (bignadad's rom), but i flashed NRG's max sense and it did the same thing.

what rom are you running?

maybe the clocks are set with the idea that hw3d is already enabled, however if hw3d isnt already enabled and running, it crashes because the clocks arent right for that session?


Hard to say .. without logs, i cant tell why its not working for you.

Here is an idea. Can you dump your clocks with haret? we can compare to see what your rom does different than the manila one.

newkidd 07-08-2010 01:58 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1856087)
Hard to say .. without logs, i cant tell why its not working for you.

Here is an idea. Can you dump your clocks with haret? we can compare to see what your rom does different than the manila one.



sure!


...how exactly do i do that with haret?

[ACL] 07-08-2010 04:18 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by newkidd (Post 1856620)
sure!


...how exactly do i do that with haret?

you need to connect to haret using haret console. quick search on google will show how.

Once you connect, you will need to type

pd 0xA8600000 0x400

And you will get a bunch of numbers. Sample of the output is on the bottom of the wiki .

http://www.htc-linux.org/wiki/index.php?title=MSM_CLK

NeoMatrixJR 07-08-2010 05:10 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1854342)
Thats odd. I disabled manila (i think i did at least) and put the default winmo crap and my android still boots. Did you guys do anything different? Do i actually have to remove sense out of the phone. I'm interested in seeing why it does not load for you guys.

do they have the cmdline option to enable hw3d? I *think* if you enable it in startup.txt, but shutdown manilla (3d in WinMo) you have this problem.

[ACL] 07-08-2010 06:19 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by NeoMatrixJR (Post 1856965)
do they have the cmdline option to enable hw3d? I *think* if you enable it in startup.txt, but shutdown manilla (3d in WinMo) you have this problem.

Even without that option, the software renderer will work and android should start with no issues. From the description it looks like they are having issues during boot.

rov120 07-08-2010 10:09 PM

Re: Need files to trace OpenGl
 
I have noticed that if I shut down Sense and do not start default WM screen, and just have the blank home screen, then try to boot into android, there is an error and the phone resets. Once it resets, if I try to boot into android it works fine.

[ACL] 07-09-2010 05:06 PM

Re: Need files to trace OpenGl
 
ive been testing and i guess i can replicate your error if i launch haret with the lcd off or if reset clocks early in the kernel. Part of the issue i think is we rely heavily on how Wince leaves the state of the clocks. So we need to learn how to check all of these and enable them if they arent where they supposed to be

newkidd 07-10-2010 02:19 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1858539)
ive been testing and i guess i can replicate your error if i launch haret with the lcd off or if reset clocks early in the kernel. Part of the issue i think is we rely heavily on how Wince leaves the state of the clocks. So we need to learn how to check all of these and enable them if they arent where they supposed to be



ill get the logs for you as soon as i get completely unpacked. my computer is still in a box somewhere.

[ACL] 07-12-2010 03:09 AM

Re: Need files to trace OpenGl
 
Found out why its bombing out when manila is disabled. Once you disable it 2 values in memory change.

0xA860010C and 0xA8600084

However, once you reboot it looks like the values return to how they should be. I still yet to find out why its crashing. I did notice that if you shut down manila, and you run a 3d app, the values fix themselves.

The actual call that crashes the system is the get_clk_khz(); in the clock_late_init. This call is somewhat useless right now so i commented it out on my kernel and was able to boot.

Unfortunately none of this got 3d working. The hunt continues ..

[ACL] 07-15-2010 07:07 PM

Re: Need files to trace OpenGl
 
haven't been able to put time in this week. Anyone at least get their kernel up ? lol

i rewrote most of wince-clocks based on the outputs i get from dumping the clocks from wince. I know our code matches the asm 100 percent but it doesnt match what we dump. So i wrote it to match what we have in the current code and so far still no irqs. So i think its no longer a clock or grp rail issue. We are in fact enabling grp rail since the bits match wince.

electrikjesus 07-16-2010 12:41 AM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1867629)
haven't been able to put time in this week. Anyone at least get their kernel up ? lol

i rewrote most of wince-clocks based on the outputs i get from dumping the clocks from wince. I know our code matches the asm 100 percent but it doesnt match what we dump. So i wrote it to match what we have in the current code and so far still no irqs. So i think its no longer a clock or grp rail issue. We are in fact enabling grp rail since the bits match wince.

Awesome. It is so good of you to be doing this for our devices. Can't wait to see what comes from it all.

Lioric HTC 07-19-2010 09:02 PM

Re: Need files to trace OpenGl
 
if its not a grp rail or clk issue, are sure we have the correct amss? can't we flash other from a known hw3d working device to test and compare?

[ACL] 07-20-2010 12:06 AM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by Lioric HTC (Post 1874307)
if its not a grp rail or clk issue, are sure we have the correct amss? can't we flash other from a known hw3d working device to test and compare?

Correct amss? you wanna flash your phone be my guest :-)

If you look at the clock dumps on the wiki vs the asm posted earlier, you will see that they really dont match up 100%. This is why clocks have been a concern for me.

If you have a dev env ready we can begin testing further (the more help the better). I havent been able to trace everything but i'm pretty sure about what ddi and ahi2dati does when initialising for 3d. DDI is just a wrapper for ahi2dati, when it's ready it calls the AhiInit function which will eventually call clk_regime_msm_enable and pass a value of 0x36 (enable grp). When you disect the clkregim.dll thats when all the clocks/rail are enabled. We posted that asm earlier.

What i havent done yet is actually get haret dumps when disabling and re-enabling via that function to see what other areas in memory are changed. I can write the app quickly, but i just dont have time to keep dumping and comparing the values.

Someone also suggested in maybe turning off the grp/rail before we launch android so we can enable it completely ourselves instead of relying on winmo to leave it enabled.

newkidd 07-21-2010 07:59 PM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by [ACL] (Post 1861577)
Found out why its bombing out when manila is disabled. Once you disable it 2 values in memory change.

0xA860010C and 0xA8600084

However, once you reboot it looks like the values return to how they should be. I still yet to find out why its crashing. I did notice that if you shut down manila, and you run a 3d app, the values fix themselves.

The actual call that crashes the system is the get_clk_khz(); in the clock_late_init. This call is somewhat useless right now so i commented it out on my kernel and was able to boot.

Unfortunately none of this got 3d working. The hunt continues ..


more or less it sounds like clocks are set with 3d boot already enabled, and its doing a hand off.

ill more or less be your testing peon as soon as my new hard drive shows up. one i had got left behind in the move then damaged during shipping to me.

[ACL] 07-26-2010 05:54 PM

Re: Need files to trace OpenGl
 
Do any of you guys have a full dev environment for wince? We need some apps compiled and i just want to make sure im not the only one who can do it ..

Lioric HTC 07-26-2010 08:58 PM

Re: Need files to trace OpenGl
 
yep, vs2008 + 6.5 sdk

[ACL] 07-27-2010 02:06 AM

Re: Need files to trace OpenGl
 
Quote:

Originally Posted by Lioric HTC (Post 1884594)
yep, vs2008 + 6.5 sdk

awesome.. i just compiled some stuff for Jonpry and i'll be at work tomorrow. It would be awesome if someone else was able to compile for him as well. Take a look at the sound thread in case we need your help.

Thanks.

Viper786 08-26-2010 04:39 PM

Re: Need files to trace OpenGl
 
Now that we have sound, i'm assuming this will be worked on next???


All times are GMT -4. The time now is 02:46 PM.

Powered by vBulletin® ©2000 - 2025, Jelsoft Enterprises Ltd.
©2012 - PPCGeeks.com


Content Relevant URLs by vBSEO 3.6.0