A similar occurrence just happened to me, accept I wasn't climbing a tree. When this occurred for you, did fps eventually restore back to 'normal'? ...Cemu seems to be locked in this state for me.
Mine went from 30fps to 0.13 - 0.14fps instantly, whilst I was happily playing, and had been for...