Besides the stuttering problem, I was also getting flickering issues issues. First it only happened when I played in full screen but then I reinstalled by drivers and it also happened on windowed.
The solution to my flickering was going to nvidia control panel switch the "Vulkan/OpenGL present method" to native. It also improved by performance and reduced my stuttering. I also left v-sync on from nvidia control panel though I don't think that's relevant.
Edit: Another setting that fixes the issue is OpenGL GDI Compability from nvidia control panel. Switching to Prefer compatible also fixes the issue but performance worsens and stutters increase. I don't recommend switching this setting.
output_2.mp4