Here is a redneck fix for your issue. Take a 1" piece of black tape. Fold it over on itself. Remove the battery, insert one edge of the take into the top of the battery housing. Re-seat the battery. This will cause the battery to shift just enough to fix the mute button issue, and prevent the battery falling out so easily. It does not effect thy dynamics of the case.
