Hi,
Please export the compat folder to use a newer CUDA version.
export PATH=/usr/local/cuda-12/bin:${PATH}
export LD_LIBRARY_PATH=/usr/local/cuda-12.0/compat
But our PyTorch is built with default CUDA 11.4.
If you want to use a newer CUDA version, please build it from the source.
The instructions can be found in the below topic:
Thanks.