Wirelessly posted (htc Vogue: Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 7.11) Sprint MP6950SP)
Yeah, you could have a bad battery.
I say turn it off and plug in the charger and let it charge up. Then see if it still does it right away or it starts after a while.