Problem solved! I was having a somewhat similar problem with Moonlight, in which one of the users found a solution from yet another similar problem with Retroarch.
https://gbatemp net/threads/problem-with-retroarch-and-sd2vita.488547/
Hey OP, if you're using MLTHaku, that is likely the cause...