@seiazetsu I installed the stable-diffusion stuff on top of l4t-ml container, which has PyTorch installed from here:
The PyTorch wheels from that topic were built with CUDA enabled.
I would recommend using a container for experimenting with this stuff to keep your environment clean.