If anyone with the same problem reads this, it turns out that none of the suggestions thus far solved the problem. It’s still not completely dedicated - Xorg is still somehow connected to both cards and if an issue happens, it’s still impossible to reset the CUDA card without Xorg restart.
I have opened a new thread about it (thus far without a solution but if anything is discovered, I’ll write it there):