Okay, I just confirmed one strange behaviour of my Logitech mouse. When I restart my M1 Mac, the lag vanishes away and mouse works perfectly fine as it would on a Windows PC. Just after a few hours, the stutter is back.
Cheers!
Cheers!