Uncharged rechargeable batteries are not good things to have, and various PSP models have a habit of getting a bit puffy and not working any longer. Equally as they are quite custom some models are getting harder and harder to find decent ones of.
So yeah stick a note on your calendar to just charge it up every month or so. Probably don't even need to do it that often but it is not going to hurt either.