CUDA Toolkit 11.1 & VS2019

Has anyone had issues with the latest CUDA toolkit and Visual studio? Everytime I install the latest version my intellisense stops working, I also can’t expand or collapse codeblocks, visual studio becomes very slow, etc.

I only ask here because I reinstalled VS and everything worked again but then installed the toolkit and it all started happening again. I had to again reinstall VS and revert back to cuda toolkit 10.2 for my codebase. Does anyone know what’s going on here?

Sidenote: I plan to upgrade my codebase for the new 3080 and thus need the latest toolkit but that’s not possible if visual studio stops loading symbols and I can’t step into code for debug.