Mouse automatically reverts back to center of my dual display when I navigate from one monitor to another in my remote machine

I have dual monitor setup, I didn't face this issue before one week, it was working perfectly. This doesn't happen in my local machine, this happens only when I take remote desktop of my office machine. Check the below gif. This is really making my wfh life hell. How to fix this ?

OS : Windows 10