That has happens on every phone with a stylus if you have any sort of finger nail "which is needed to get stylus out" Normal wear and tear....At night time i fumble around trying to pull it out or put it in, so that's one reason i have the same effect you have.
No phone will stay perfect :0