Did a re-test to be sure...
Opened up "Albums" and scrolled around a bit.
Took memory down to 59mb.
Cleaned with ClearTemp.
Back to 64mb.
Scrolled in Albums again, let more images load, and flipped through a slide show
Memory at 53.19mb
Clean with ClearTemp; 11.2mb cleared
Memory check = 64.40mb
Only programs I opened/used was the Album and ClearTemp....nothing else was in use. So it looks like the Albums cache is the culprit. So with ClearTemp (which should be free, though I don't remember where I got it...it's been a while), set one of your custom folders to \Application Data\HTC\HTC Album\Cache. Hit "Menu", then "Apply Settings". Then you should be set. On that same screen I also have the "Cache Folder" and "Mail Attachments" options set to Windows, but I really don't what that does, if anything.
But by all means, PPC gurus, if this isn't right and I'm actually screwing up my phone, for the love HTC PLEASE tell me! I'm no computer expert; I just messed around til I found something that worked!