oops misread. changing the cmos battery will require you to open the PS4 and dissemble it.
Not sure if leaving it powered is a good idea?
If you're worried, might as well open it, clean it, replace thermal paste and battery. PS4 is not that hard to dissemble imo.