# Installing pytorch - /usr/local/cuda/lib64/libcudnn.so: error adding symbols: File in wrong format collect2: error: ld returned 1 exit status **URL:** \ **Category:** Jetson TX2\ **Tags:** pytorch\ **Created:** [January 19, 2022, 9:43am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976 "2022-01-19T09:43:21Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [January 19, 2022, 9:43am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/1 "2022-01-19T09:43:21Z")
Links i have consulted, but no avail - [(SOLVED)libcudart.so: error adding symbols: File in wrong format - #9 by imugly1029](https://forums.developer.nvidia.com/t/solved-libcudart-so-error-adding-symbols-file-in-wrong-format/71084/9) - [Dji Manifold2-G、Jetson TX2源码编译安装pytorch - 代码先锋网](https://codeleading.com/article/66694568504/) - [subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '7']' returned non-zero exit status 1 · Issue #20420 · pytorch/pytorch · GitHub](https://github.com/pytorch/pytorch/issues/20420) What i ran ```auto USE_MKLDNN=0 USE_QNNPACK=0 USE_NNPACK=0 USE_DISTRIBUTED=0 BUILD_TEST=0 python setup.py bdist_wheel ``` using [Dji Manifold2-G、Jetson TX2源码编译安装pytorch - 代码先锋网](https://codeleading.com/article/66694568504/) this as a guide. Errros are as follows ```auto /usr/local/cuda/lib64/libcudnn.so: error adding symbols: File in wrong format collect2: error: ld returned 1 exit status caffe2/CMakeFiles/torch_global_deps.dir/build.make:104: recipe for target 'lib/libtorch_global_deps.so' failed make[2]: *** [lib/libtorch_global_deps.so] Error 1 CMakeFiles/Makefile2:2295: recipe for target 'caffe2/CMakeFiles/torch_global_deps.dir/all' failed make[1]: *** [caffe2/CMakeFiles/torch_global_deps.dir/all] Error 2 make[1]: *** Waiting for unfinished jobs.... ``` and also ```auto Makefile:145: recipe for target 'all' failed make: *** [all] Error 2 Traceback (most recent call last): File "setup.py", line 745, in build_deps() File "setup.py", line 311, in build_deps build_caffe2(version=version, File "/media/dji/80GBstore/pyenvs/newpy38/pytorch1.5/tools/build_pytorch_libs.py", line 62, in build_caffe2 cmake.build(my_env) File "/media/dji/80GBstore/pyenvs/newpy38/pytorch1.5/tools/setup_helpers/cmake.py", line 339, in build self.run(build_args, my_env) File "/media/dji/80GBstore/pyenvs/newpy38/pytorch1.5/tools/setup_helpers/cmake.py", line 141, in run check_call(command, cwd=self.build_dir, env=env) File "/usr/lib/python3.8/subprocess.py", line 364, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '6']' returned non-zero exit status 2. ``` Other system information ```auto DJI Manifold 2 Distributor ID: Ubuntu Description: Ubuntu 16.04.7 LTS Release: 16.04 Codename: xenial 8 GB memory NVIDIA Jetson TX2 ARMv8 Processor rev 3 (v8l) × 4 ARMv8 Processor rev 0 (v8l) × 2 NVIDIA Tegra X2 (nvgpu)/integrated 64-bit ``` deviceQuery output ```auto /usr/local/cuda/samples/1_Utilities/deviceQuery$ ./deviceQuery ./deviceQuery Starting... CUDA Device Query (Runtime API) version (CUDART static linking) Detected 1 CUDA Capable device(s) Device 0: "NVIDIA Tegra X2" CUDA Driver Version / Runtime Version 9.0 / 9.0 CUDA Capability Major/Minor version number: 6.2 Total amount of global memory: 7839 MBytes (8219348992 bytes) ( 2) Multiprocessors, (128) CUDA Cores/MP: 256 CUDA Cores GPU Max Clock rate: 1301 MHz (1.30 GHz) Memory Clock rate: 1600 Mhz Memory Bus Width: 128-bit L2 Cache Size: 524288 bytes Maximum Texture Dimension Size (x,y,z) 1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384) Maximum Layered 1D Texture Size, (num) layers 1D=(32768), 2048 layers Maximum Layered 2D Texture Size, (num) layers 2D=(32768, 32768), 2048 layers Total amount of constant memory: 65536 bytes Total amount of shared memory per block: 49152 bytes Total number of registers available per block: 32768 Warp size: 32 Maximum number of threads per multiprocessor: 2048 Maximum number of threads per block: 1024 Max dimension size of a thread block (x,y,z): (1024, 1024, 64) Max dimension size of a grid size (x,y,z): (2147483647, 65535, 65535) Maximum memory pitch: 2147483647 bytes Texture alignment: 512 bytes Concurrent copy and kernel execution: Yes with 1 copy engine(s) Run time limit on kernels: No Integrated GPU sharing Host Memory: Yes Support host page-locked memory mapping: Yes Alignment requirement for Surfaces: Yes Device has ECC support: Disabled Device supports Unified Addressing (UVA): Yes Supports Cooperative Kernel Launch: Yes Supports MultiDevice Co-op Kernel Launch: Yes Device PCI Domain ID / Bus ID / location ID: 0 / 0 / 0 Compute Mode: < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) > deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 9.0, CUDA Runtime Version = 9.0, NumDevs = 1 Result = PASS ``` Output from `nvcc –version` ```auto nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2017 NVIDIA Corporation Built on Sun_Nov_19_03:16:56_CST_2017 Cuda compilation tools, release 9.0, V9.0.252 ``` CUDA version ```auto cat /usr/local/cuda/version.txt CUDA Version 9.0.252 ``` Output from uname -a ```auto uname -a Linux manifold2 4.4.38+ #2 SMP PREEMPT Mon Jun 3 20:19:02 CST 2019 aarch64 aarch64 aarch64 GNU/Linux ``` Output from “head -n 1 /etc/nv\_tegra\_release” ```auto “head -n 1 /etc/nv_tegra_release # R28 (release), REVISION: 2.1, GCID: 11272647, BOARD: t186ref, EABI: aarch64, DATE: Thu May 17 07:29:06 UTC 2018 ``` Understand that i am using a very rarely used embedded computer. I have posted on Nvidia forums and after a series of exchanges i was advised to simply install from source. However, when trying to install from source, i ran into issues aas well ### Versions ```auto PyTorch version: 1.10.1 Is debug build: False CUDA used to build PyTorch: Could not collect ROCM used to build PyTorch: N/A OS: Ubuntu 16.04.7 LTS (aarch64) GCC version: (Ubuntu/Linaro 5.5.0-12ubuntu1~16.04) 5.5.0 20171010 Clang version: Could not collect CMake version: version 3.22.0 Libc version: glibc-2.23 Python version: 3.8.9 (default, Apr 3 2021, 01:02:10) [GCC 5.4.0 20160609] (64-bit runtime) Python platform: Linux-4.4.38+-aarch64-with-glibc2.17 Is CUDA available: False CUDA runtime version: 9.0.252 GPU models and configuration: Could not collect Nvidia driver version: Could not collect cuDNN version: Probably one of the following: /usr/lib/aarch64-linux-gnu/libcudnn.so.7.1.5 /usr/local/cuda-9.0/targets/aarch64-linux/lib/libcudnn.so.7 HIP runtime version: N/A MIOpen runtime version: N/A Versions of relevant libraries: [pip3] numpy==1.22.1 [pip3] torch==1.10.1 [pip3] torchaudio==0.10.1 [pip3] torchvision==0.11.2 [conda] Could not collect ``` Sorry for the long codes. ---
**Author:** ![AastaLLL](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/aastalll/32/14043_2.png) [@AastaLLL](https://forums.developer.nvidia.com/u/AastaLLL)\ **Post date:** [January 20, 2022, 3:21am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/3 "2022-01-20T03:21:38Z")
Hi, Since CUDA 9.0 is a relatively old library, would you mind upgrading your device to our latest software first? Please note that there are some dependencies between PyTorch and CUDA-related libraries. It’s possible that PyTorch expects newer software and leads to this error. Thanks. ---
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [January 20, 2022, 3:24am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/4 "2022-01-20T03:24:42Z")
@AastaLLL I am unable to upgrade further due to hardware problems encountered. I am running a DJI Manifold 2 which contains a Nvidia jetson tx2. While it contains currently jetpack 3.3, i have tried upgrading it to jetpack 4.4 However, after i upgrade to jetpack 4.4, any system updates during that time will cause the usb hardware interfaces to stop working. Nonetheless ,if i only upgrade to jetpack 4.4, but do not perform any system updates, the usb devices will be fine. However, it also means i am not able to sudo apt-get install on a whim. ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [January 20, 2022, 4:02pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/5 "2022-01-20T16:02:40Z")
> [@pylonicGateway](#): > > `PyTorch version: 1.10.1` I believe the last version of PyTorch to support CUDA 9.0 was PyTorch 1.4 or PyTorch 1.5, but this may take some trial and error. It’s also unclear if that was the last version of PyTorch to officially release x86 binaries for CUDA 9.0 or if the PyTorch code itself doesn’t support building with CUDA 9.0. > [@pylonicGateway](#): > > `python setup.py bdist_wheel` It appears that you are building PyTorch with Python 2.7, but PyTorch has deprecated support for Python 2 since PyTorch 1.4. So instead please build with python3. > [@pylonicGateway](#): > > However, it also means i am not able to sudo apt-get install on a whim. Can you do `apt-get update` and `apt-get install` without doing an `apt-get upgrade`? ---
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [January 21, 2022, 12:17pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/6 "2022-01-21T12:17:00Z")
@dusty_nv I am running a virtual environment with python3.8. So when i call python, it’s actually runnin python3.8. Sorry just to clarify, it means that after i upgrade to jetpack 4.4, i can still run those commands. Yes i can run apt-get update and apt-get install, and even apt-get upgrade. But the issue is, some of the packages installed, downloaded and upgraded via these commands may cause my usb interfaces to stop working. ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [January 21, 2022, 5:03pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/7 "2022-01-21T17:03:08Z")
> [@pylonicGateway](#): > > I am running a virtual environment with python3.8. So when i call python, it’s actually runnin python3.8. OK gotcha - here is a topic about building PyTorch for Python 3.8 that may be helpful: > [@Install PyTorch with Python 3.8 on Jetpack 4.4.1](https://forums.developer.nvidia.com/t/install-pytorch-with-python-3-8-on-jetpack-4-4-1/160060/3): > > Hey @dusty_nv, thank you for your quick response. With your help I was able to build PyTorch 1.7 for Python 3.8 on Jetpack 4.4.1 (Jetson Xavier). It actually helped to switch to the 1.7 branch of PyTorch. Here are the steps that worked for me: Easiest way: git clone --recursive --branch 1.7 http://github.com/pytorch/pytorch cd pytorch python3.8 -m pip install -r requirements.txt python3.8 setup.py install From where I was coming: git clone https://github.com/pytorch/pytorch.git cd pytorch gi… > [@pylonicGateway](#): > > But the issue is, some of the packages installed, downloaded and upgraded via these commands may cause my usb interfaces to stop working. If it’s the `apt-get upgrade` command that causes the USB interfaces on your DJI Manifold to stop working, you may want to refrain from performing the package upgrades or determine which package(s) to mark as hold so they aren’t upgraded. ---
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [January 24, 2022, 12:37pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/8 "2022-01-24T12:37:12Z")
@dusty_nv would you happen to know of a list of apt-get packages that may interact with the USB interfaces for a TX2 ? ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [January 24, 2022, 6:31pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/9 "2022-01-24T18:31:36Z")
Unfortunately I don’t as I haven’t encountered that previously - you may want to file a different topic about this separate issue, or try contacting the drone manufacturer if it’s specific to their device. ---
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [January 26, 2022, 9:59am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/10 "2022-01-26T09:59:09Z")
@dusty_nv I managed to upgrade my device to Jetpack 4.4, which contains CUDA 10.2. I know you maintain a page [PyTorch for Jetson](https://forums.developer.nvidia.com/t/pytorch-for-jetson-version-1-10-now-available/72048) full of the pytorch installers. However i notice that they were for python3.6 Do you have a list for python3.8 ? ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [January 26, 2022, 6:07pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/11 "2022-01-26T18:07:59Z")
> [@pylonicGateway](#): > > I know you maintain a page [PyTorch for Jetson - version 1.10 now available](https://forums.developer.nvidia.com/t/pytorch-for-jetson-version-1-10-now-available/72048) full of the pytorch installers. However i notice that they were for python3.6 Hi @pylonicGateway, I personally only build the PyTorch wheels for Python 3.6 because that is the default version of Python that comes with the version of Ubuntu currently in JetPack and it’s a lot for me to support different versions of Python. If you search that PyTorch post though, I believe other users have posted their wheels for Python 3.7 or 3.8. ---
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [January 27, 2022, 2:40am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/12 "2022-01-27T02:40:21Z")
@dusty_nv ok i think i have found something relevant at [Install PyTorch with Python 3.8 on Jetpack 4.4.1 - #2 by dusty\_nv](https://forums.developer.nvidia.com/t/install-pytorch-with-python-3-8-on-jetpack-4-4-1/160060/2). I will try this out. I had encountered this error while trying to install… ```auto /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch1.8/c10/cuda/CUDAMathCompat.h: In static member function ‘static scalar_t at::native::copysign_kernel_cuda(at::TensorIterator&)::::::::_FUN(scalar_t, scalar_t)’: /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch1.8/c10/cuda/CUDAMathCompat.h:46:24: internal compiler error: Segmentation fault return ::copysignf(x, y); ^ Please submit a full bug report, with preprocessed source if appropriate. See for instructions. CMake Error at torch_cuda_generated_CopysignKernel.cu.o.Release.cmake:281 (message): Error generating file /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch1.8/build/caffe2/CMakeFiles/torch_cuda.dir/__/aten/src/ATen/native/cuda/./torch_cuda_generated_CopysignKernel.cu.o caffe2/CMakeFiles/torch_cuda.dir/build.make:89336: recipe for target 'caffe2/CMakeFiles/torch_cuda.dir/__/aten/src/ATen/native/cuda/torch_cuda_generated_CopysignKernel.cu.o' failed make[2]: *** [caffe2/CMakeFiles/torch_cuda.dir/__/aten/src/ATen/native/cuda/torch_cuda_generated_CopysignKernel.cu.o] Error 1 make[2]: *** Waiting for unfinished jobs.... /usr/include/c++/7/cmath: In static member function ‘static scalar_t at::native::div_floor_kernel_cuda(at::TensorIterator&)::::::::_FUN(scalar_t, scalar_t)’: /usr/include/c++/7/cmath:1302:38: internal compiler error: Segmentation fault { return __builtin_copysignf(__x, __y); } ^ Please submit a full bug report, with preprocessed source if appropriate. See for instructions. CMake Error at torch_cuda_generated_BinaryMulDivKernel.cu.o.Release.cmake:281 (message): Error generating file /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch1.8/build/caffe2/CMakeFiles/torch_cuda.dir/__/aten/src/ATen/native/cuda/./torch_cuda_generated_BinaryMulDivKernel.cu.o caffe2/CMakeFiles/torch_cuda.dir/build.make:79700: recipe for target 'caffe2/CMakeFiles/torch_cuda.dir/__/aten/src/ATen/native/cuda/torch_cuda_generated_BinaryMulDivKernel.cu.o' failed make[2]: *** [caffe2/CMakeFiles/torch_cuda.dir/__/aten/src/ATen/native/cuda/torch_cuda_generated_BinaryMulDivKernel.cu.o] Error 1 CMakeFiles/Makefile2:8965: recipe for target 'caffe2/CMakeFiles/torch_cuda.dir/all' failed make[1]: *** [caffe2/CMakeFiles/torch_cuda.dir/all] Error 2 Makefile:140: recipe for target 'all' failed make: *** [all] Error 2 Traceback (most recent call last): File "setup.py", line 818, in build_deps() File "setup.py", line 315, in build_deps build_caffe2(version=version, File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch1.8/tools/build_pytorch_libs.py", line 58, in build_caffe2 cmake.build(my_env) File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch1.8/tools/setup_helpers/cmake.py", line 345, in build self.run(build_args, my_env) File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch1.8/tools/setup_helpers/cmake.py", line 140, in run check_call(command, cwd=self.build_dir, env=env) File "/usr/lib/python3.8/subprocess.py", line 364, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '6']' returned non-zero exit status 2. ``` Is there some gcc version problem that caused it ? ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [January 31, 2022, 3:25pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/13 "2022-01-31T15:25:47Z")
Hi @pylonicGateway, which version of PyTorch are you building? It looks to be this error: [https://github.com/pytorch/pytorch/pull/51834](https://github.com/pytorch/pytorch/pull/51834) Note that a workaround is included for this in my patch set for PyTorch 1.8: [https://gist.github.com/dusty-nv/ce51796085178e1f38e3c6a1663a93a1#file-pytorch-1-8-jetpack-4-4-1-patch](https://gist.github.com/dusty-nv/ce51796085178e1f38e3c6a1663a93a1#file-pytorch-1-8-jetpack-4-4-1-patch) ---
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [February 3, 2022, 7:14am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/14 "2022-02-03T07:14:37Z")
@dusty_nv hey im not sure if i am using your pytorch patch right… Sorry I have never used a patch file before So i copied your patch file for “pytorch1.8 jeptack4.4.1” out into a gedit file, then put the gedit file into the pytorch folder. I got this output ```auto patch < torch18.patch can't find file to patch at input line 5 Perhaps you should have used the -p or --strip option? The text leading up to this was: -------------------------- |diff --git a/aten/src/ATen/cuda/CUDAContext.cpp b/aten/src/ATen/cuda/CUDAContext.cpp |index 1751128f1a..03e74f5ac2 100644 |--- a/aten/src/ATen/cuda/CUDAContext.cpp |+++ b/aten/src/ATen/cuda/CUDAContext.cpp -------------------------- File to patch: ``` Am i doing this right ? ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [February 3, 2022, 8:10pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/15 "2022-02-03T20:10:54Z")
I created that patch using `git diff`, so I think `git apply` would be the way to apply it - however this would require you to have cloned the same branch of PyTorch that I did. For sanity normally I just apply these patches by hand (by going into the individual files and copy/pasting the changes) ---
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [February 23, 2022, 7:25am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/17 "2022-02-23T07:25:33Z")
@dusty_nv hi I have tried patching by hand and this is what i got ```auto -- -- ********Summary******** -- General: -- CMake version : 3.22.2 -- CMake command : /usr/bin/cmake -- System : Linux -- C++ compiler : /usr/bin/c++ -- C++ compiler id : GNU -- C++ compiler version : 7.4.0 -- CXX flags : -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -DMISSING_ARM_VST1 -DMISSING_ARM_VLD1 -Wno-stringop-overflow -- Build type : Release -- Compile definitions : ONNX_ML=1;ONNXIFI_ENABLE_EXT=1;ONNX_NAMESPACE=onnx_torch;HAVE_MMAP=1;_FILE_OFFSET_BITS=64;HAVE_SHM_OPEN=1;HAVE_SHM_UNLINK=1;HAVE_MALLOC_USABLE_SIZE=1;USE_EXTERNAL_MZCRC;MINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -- CMAKE_PREFIX_PATH : /usr/local/cuda-10.2 -- CMAKE_INSTALL_PREFIX : /usr/local -- -- TORCH_VERSION : 1.8.0 -- CAFFE2_VERSION : 1.8.0 -- BUILD_CAFFE2 : ON -- BUILD_CAFFE2_OPS : ON -- BUILD_CAFFE2_MOBILE : OFF -- BUILD_STATIC_RUNTIME_BENCHMARK: OFF -- BUILD_TENSOREXPR_BENCHMARK: OFF -- BUILD_BINARY : OFF -- BUILD_CUSTOM_PROTOBUF : ON -- Protobuf compiler : -- Protobuf includes : -- Protobuf libraries : -- BUILD_DOCS : OFF -- BUILD_PYTHON : ON -- Python version : 3.8 -- Python executable : /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/bin/python -- Pythonlibs version : 3.8.0 -- Python library : /usr/lib/python3.8 -- Python includes : /usr/include/python3.8 -- Python site-packages: lib/python3.8/site-packages -- BUILD_SHARED_LIBS : OFF -- CAFFE2_USE_MSVC_STATIC_RUNTIME : ON -- BUILD_TEST : OFF -- BUILD_JNI : OFF -- BUILD_MOBILE_AUTOGRAD : OFF -- INTERN_BUILD_MOBILE : -- USE_BLAS : 1 -- BLAS : open -- USE_LAPACK : 1 -- LAPACK : open -- USE_ASAN : OFF -- USE_CPP_CODE_COVERAGE : OFF -- USE_CUDA : ON -- Split CUDA : OFF -- CUDA static link : OFF -- USE_CUDNN : ON -- CUDA version : 10.2 -- cuDNN version : 8.0.0 -- CUDA root directory : /usr/local/cuda-10.2 -- CUDA library : /usr/local/cuda-10.2/lib64/stubs/libcuda.so -- cudart library : /usr/local/cuda-10.2/lib64/libcudart.so -- cublas library : /usr/lib/aarch64-linux-gnu/libcublas.so -- cufft library : /usr/local/cuda-10.2/lib64/libcufft.so -- curand library : /usr/local/cuda-10.2/lib64/libcurand.so -- cuDNN library : /usr/lib/aarch64-linux-gnu/libcudnn.so -- nvrtc : /usr/local/cuda-10.2/lib64/libnvrtc.so -- CUDA include path : /usr/local/cuda-10.2/include -- NVCC executable : /usr/local/cuda-10.2/bin/nvcc -- NVCC flags : -Xfatbin;-compress-all;-DONNX_NAMESPACE=onnx_torch;-gencode;arch=compute_53,code=sm_53;-gencode;arch=compute_62,code=sm_62;-gencode;arch=compute_72,code=sm_72;-Xcudafe;--diag_suppress=cc_clobber_ignored,--diag_suppress=integer_sign_change,--diag_suppress=useless_using_declaration,--diag_suppress=set_but_not_used,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=implicit_return_from_non_void_function,--diag_suppress=unsigned_compare_with_zero,--diag_suppress=declared_but_not_referenced,--diag_suppress=bad_friend_decl;-std=c++14;-Xcompiler;-fPIC;--expt-relaxed-constexpr;--expt-extended-lambda;-Wno-deprecated-gpu-targets;--expt-extended-lambda;-Xcompiler;-fPIC;-DCUDA_HAS_FP16=1;-D __CUDA_NO_HALF_OPERATORS__ ;-D __CUDA_NO_HALF_CONVERSIONS__ ;-D __CUDA_NO_BFLOAT16_CONVERSIONS__ ;-D __CUDA_NO_HALF2_OPERATORS__ -- CUDA host compiler : /usr/bin/cc -- NVCC --device-c : OFF -- USE_TENSORRT : OFF -- USE_ROCM : OFF -- USE_EIGEN_FOR_BLAS : ON -- USE_FBGEMM : OFF -- USE_FAKELOWP : OFF -- USE_KINETO : OFF -- USE_FFMPEG : OFF -- USE_GFLAGS : OFF -- USE_GLOG : OFF -- USE_LEVELDB : OFF -- USE_LITE_PROTO : OFF -- USE_LMDB : OFF -- USE_METAL : OFF -- USE_PYTORCH_METAL : OFF -- USE_FFTW : OFF -- USE_MKL : OFF -- USE_MKLDNN : OFF -- USE_NCCL : ON -- USE_SYSTEM_NCCL : OFF -- USE_NNPACK : ON -- USE_NUMPY : ON -- USE_OBSERVERS : ON -- USE_OPENCL : OFF -- USE_OPENCV : OFF -- USE_OPENMP : ON -- USE_TBB : OFF -- USE_VULKAN : OFF -- USE_PROF : OFF -- USE_QNNPACK : ON -- USE_PYTORCH_QNNPACK : ON -- USE_REDIS : OFF -- USE_ROCKSDB : OFF -- USE_ZMQ : OFF -- USE_DISTRIBUTED : ON -- USE_MPI : ON -- USE_GLOO : ON -- USE_TENSORPIPE : ON -- USE_DEPLOY : OFF -- Public Dependencies : Threads::Threads -- Private Dependencies : pthreadpool;cpuinfo;qnnpack;pytorch_qnnpack;nnpack;XNNPACK;/usr/lib/aarch64-linux-gnu/libnuma.so;fp16;/usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi_cxx.so;/usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi.so;gloo;tensorpipe;aten_op_header_gen;foxi_loader;rt;fmt::fmt-header-only;gcc_s;gcc;dl -- Configuring done -- Generating done -- Build files have been written to: /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch/build [0/1] Re-running CMake... -- std::exception_ptr is supported. -- Turning off deprecation warning due to glog. -- Building using own protobuf under third_party per request. -- Use custom protobuf build. -- -- 3.11.4.0 -- Caffe2 protobuf include directory: $$ -- Trying to find preferred BLAS backend of choice: MKL -- MKL_THREADING = OMP -- MKL_THREADING = OMP CMake Warning at cmake/Dependencies.cmake:152 (message): MKL could not be found. Defaulting to Eigen Call Stack (most recent call first): CMakeLists.txt:564 (include) CMake Warning at cmake/Dependencies.cmake:175 (message): Preferred BLAS (MKL) cannot be found, now searching for a general BLAS library Call Stack (most recent call first): CMakeLists.txt:564 (include) -- MKL_THREADING = OMP -- Checking for [mkl_intel_lp64 - mkl_gnu_thread - mkl_core - gomp - pthread - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel_lp64 - mkl_intel_thread - mkl_core - gomp - pthread - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel - mkl_gnu_thread - mkl_core - gomp - pthread - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_intel - mkl_intel_thread - mkl_core - gomp - pthread - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_gf_lp64 - mkl_gnu_thread - mkl_core - gomp - pthread - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf_lp64 - mkl_intel_thread - mkl_core - gomp - pthread - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf - mkl_gnu_thread - mkl_core - gomp - pthread - m - dl] -- Library mkl_gf: not found -- Checking for [mkl_gf - mkl_intel_thread - mkl_core - gomp - pthread - m - dl] -- Library mkl_gf: not found -- Checking for [mkl_intel_lp64 - mkl_gnu_thread - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel_lp64 - mkl_intel_thread - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel - mkl_gnu_thread - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_intel - mkl_intel_thread - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_gf_lp64 - mkl_gnu_thread - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf_lp64 - mkl_intel_thread - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf - mkl_gnu_thread - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_gf: not found -- Checking for [mkl_gf - mkl_intel_thread - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_gf: not found -- Checking for [mkl_intel_lp64 - mkl_gnu_thread - mkl_core - pthread - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel_lp64 - mkl_intel_thread - mkl_core - pthread - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel - mkl_gnu_thread - mkl_core - pthread - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_intel - mkl_intel_thread - mkl_core - pthread - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_gf_lp64 - mkl_gnu_thread - mkl_core - pthread - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf_lp64 - mkl_intel_thread - mkl_core - pthread - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf - mkl_gnu_thread - mkl_core - pthread - m - dl] -- Library mkl_gf: not found -- Checking for [mkl_gf - mkl_intel_thread - mkl_core - pthread - m - dl] -- Library mkl_gf: not found -- Checking for [mkl_intel_lp64 - mkl_sequential - mkl_core - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel - mkl_sequential - mkl_core - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_gf_lp64 - mkl_sequential - mkl_core - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf - mkl_sequential - mkl_core - m - dl] -- Library mkl_gf: not found -- Checking for [mkl_intel_lp64 - mkl_core - gomp - pthread - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel - mkl_core - gomp - pthread - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_gf_lp64 - mkl_core - gomp - pthread - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf - mkl_core - gomp - pthread - m - dl] -- Library mkl_gf: not found -- Checking for [mkl_intel_lp64 - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_gf_lp64 - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf - mkl_core - iomp5 - pthread - m - dl] -- Library mkl_gf: not found -- Checking for [mkl_intel_lp64 - mkl_core - pthread - m - dl] -- Library mkl_intel_lp64: not found -- Checking for [mkl_intel - mkl_core - pthread - m - dl] -- Library mkl_intel: not found -- Checking for [mkl_gf_lp64 - mkl_core - pthread - m - dl] -- Library mkl_gf_lp64: not found -- Checking for [mkl_gf - mkl_core - pthread - m - dl] -- Library mkl_gf: not found -- Checking for [mkl - guide - pthread - m] -- Library mkl: not found -- MKL library not found -- Checking for [Accelerate] -- Library Accelerate: BLAS_Accelerate_LIBRARY-NOTFOUND -- Checking for [vecLib] -- Library vecLib: BLAS_vecLib_LIBRARY-NOTFOUND -- Found OpenBLAS libraries: /usr/lib/aarch64-linux-gnu/libopenblas.so -- Found OpenBLAS include: /usr/include/aarch64-linux-gnu -- Found a library with BLAS API (open). Full path: (/usr/lib/aarch64-linux-gnu/libopenblas.so) -- Brace yourself, we are building NNPACK -- NNPACK backend is neon CMake Warning at cmake/Dependencies.cmake:732 (message): Turning USE_FAKELOWP off as it depends on USE_FBGEMM. Call Stack (most recent call first): CMakeLists.txt:564 (include) -- Found Numa (include: /usr/include, library: /usr/lib/aarch64-linux-gnu/libnuma.so) -- Using third party subdirectory Eigen. -- Setting Python to /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/bin/python -- Setting Python's include dir to /usr/include/python3.8 from distutils.sysconfig -- Setting Python's library to /usr/lib/python3.8 -- NumPy ver. 1.22.2 found (include: /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/lib/python3.8/site-packages/numpy/core/include) -- Using third_party/pybind11. -- pybind11 include dirs: /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch/cmake/../third_party/pybind11/include -- MPI support found -- MPI compile flags: -pthread -- MPI include path: /usr/lib/aarch64-linux-gnu/openmpi/include/openmpi/usr/lib/aarch64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/usr/lib/aarch64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include/usr/lib/aarch64-linux-gnu/openmpi/include -- MPI LINK flags path: -pthread -- MPI libraries: /usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi_cxx.so/usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi.so CMake Warning at cmake/Dependencies.cmake:1038 (message): OpenMPI found, but it is not built with CUDA support. Call Stack (most recent call first): CMakeLists.txt:564 (include) -- Adding OpenMP CXX_FLAGS: -fopenmp -- No OpenMP library needs to be linked against -- Caffe2: CUDA detected: 10.2 -- Caffe2: CUDA nvcc is: /usr/local/cuda-10.2/bin/nvcc -- Caffe2: CUDA toolkit directory: /usr/local/cuda-10.2 -- Caffe2: Header version is: 10.2 -- Found cuDNN: v8.0.0 (include: /usr/include, library: /usr/lib/aarch64-linux-gnu/libcudnn.so) -- /usr/local/cuda-10.2/lib64/libnvrtc.so shorthash is c13e41e1 CMake Warning at cmake/public/utils.cmake:365 (message): In the future we will require one to explicitly pass TORCH_CUDA_ARCH_LIST to cmake instead of implicitly setting it as an env variable. This will become a FATAL_ERROR in future version of pytorch. Call Stack (most recent call first): cmake/public/cuda.cmake:483 (torch_cuda_get_nvcc_gencode_flag) cmake/Dependencies.cmake:1148 (include) CMakeLists.txt:564 (include) -- Added CUDA NVCC flags for: -gencode;arch=compute_53,code=sm_53;-gencode;arch=compute_62,code=sm_62;-gencode;arch=compute_72,code=sm_72 CMake Warning at cmake/External/nccl.cmake:66 (message): Objcopy version is too old to support NCCL library slimming Call Stack (most recent call first): cmake/Dependencies.cmake:1271 (include) CMakeLists.txt:564 (include) -- Could NOT find CUB (missing: CUB_INCLUDE_DIR) -- Gloo build as STATIC library -- MPI include path: /usr/lib/aarch64-linux-gnu/openmpi/include/openmpi/usr/lib/aarch64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/usr/lib/aarch64-linux-gnu/openmpi/include/openmpi/opal/mca/event/libevent2022/libevent/include/usr/lib/aarch64-linux-gnu/openmpi/include -- MPI libraries: /usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi_cxx.so/usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi.so -- Found CUDA: /usr/local/cuda-10.2 (found suitable version "10.2", minimum required is "7.0") -- CUDA detected: 10.2 CMake Warning (dev) at /usr/share/cmake-3.22/Modules/FindPackageHandleStandardArgs.cmake:438 (message): The package name passed to `find_package_handle_standard_args` (NCCL) does not match the name of the calling package (nccl). This can lead to problems in calling code that expects `find_package` result variables (e.g., `_FOUND`) to follow a certain pattern. Call Stack (most recent call first): third_party/gloo/cmake/Modules/Findnccl.cmake:45 (find_package_handle_standard_args) third_party/gloo/cmake/Dependencies.cmake:128 (find_package) third_party/gloo/CMakeLists.txt:102 (include) This warning is for project developers. Use -Wno-dev to suppress it. -- Could NOT find NCCL (missing: NCCL_INCLUDE_DIR NCCL_LIBRARY) CMake Warning at third_party/gloo/cmake/Dependencies.cmake:133 (message): Not compiling with NCCL support. Suppress this warning with -DUSE_NCCL=OFF. Call Stack (most recent call first): third_party/gloo/CMakeLists.txt:102 (include) ``` The issue is that these compiler information seems to be on a loop. No installer progress is being made. So there seems to be a ninfinite loop ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [February 23, 2022, 8:06pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/18 "2022-02-23T20:06:22Z")
> [@pylonicGateway](#): > > The issue is that these compiler information seems to be on a loop. No installer progress is being made. So there seems to be a ninfinite loop Hi @pylonicGateway, these all seem to be different messages - at a glance, I don’t see them repeating. What happens if you just let it run? ---
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [February 24, 2022, 1:33am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/19 "2022-02-24T01:33:40Z")
@dusty_nv ah I only copied over the part that was being looped, not the whole terminal output. I left it to run for about 30mins and it was going through the same things. Until it hit this portion. ```auto -- -- ********Summary******** -- General: -- CMake version : 3.22.2 -- CMake command : /usr/bin/cmake -- System : Linux -- C++ compiler : /usr/bin/c++ -- C++ compiler id : GNU -- C++ compiler version : 7.4.0 -- CXX flags : -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -DMISSING_ARM_VST1 -DMISSING_ARM_VLD1 -Wno-stringop-overflow -- Build type : Release -- Compile definitions : ONNX_ML=1;ONNXIFI_ENABLE_EXT=1;ONNX_NAMESPACE=onnx_torch;HAVE_MMAP=1;_FILE_OFFSET_BITS=64;HAVE_SHM_OPEN=1;HAVE_SHM_UNLINK=1;HAVE_MALLOC_USABLE_SIZE=1;USE_EXTERNAL_MZCRC;MINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -- CMAKE_PREFIX_PATH : /usr/local/cuda-10.2 -- CMAKE_INSTALL_PREFIX : /usr/local -- -- TORCH_VERSION : 1.8.0 -- CAFFE2_VERSION : 1.8.0 -- BUILD_CAFFE2 : ON -- BUILD_CAFFE2_OPS : ON -- BUILD_CAFFE2_MOBILE : OFF -- BUILD_STATIC_RUNTIME_BENCHMARK: OFF -- BUILD_TENSOREXPR_BENCHMARK: OFF -- BUILD_BINARY : OFF -- BUILD_CUSTOM_PROTOBUF : ON -- Protobuf compiler : -- Protobuf includes : -- Protobuf libraries : -- BUILD_DOCS : OFF -- BUILD_PYTHON : ON -- Python version : 3.8 -- Python executable : /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/bin/python -- Pythonlibs version : 3.8.0 -- Python library : /usr/lib/python3.8 -- Python includes : /usr/include/python3.8 -- Python site-packages: lib/python3.8/site-packages -- BUILD_SHARED_LIBS : OFF -- CAFFE2_USE_MSVC_STATIC_RUNTIME : ON -- BUILD_TEST : OFF -- BUILD_JNI : OFF -- BUILD_MOBILE_AUTOGRAD : OFF -- INTERN_BUILD_MOBILE : -- USE_BLAS : 1 -- BLAS : open -- USE_LAPACK : 1 -- LAPACK : open -- USE_ASAN : OFF -- USE_CPP_CODE_COVERAGE : OFF -- USE_CUDA : ON -- Split CUDA : OFF -- CUDA static link : OFF -- USE_CUDNN : ON -- CUDA version : 10.2 -- cuDNN version : 8.0.0 -- CUDA root directory : /usr/local/cuda-10.2 -- CUDA library : /usr/local/cuda-10.2/lib64/stubs/libcuda.so -- cudart library : /usr/local/cuda-10.2/lib64/libcudart.so -- cublas library : /usr/lib/aarch64-linux-gnu/libcublas.so -- cufft library : /usr/local/cuda-10.2/lib64/libcufft.so -- curand library : /usr/local/cuda-10.2/lib64/libcurand.so -- cuDNN library : /usr/lib/aarch64-linux-gnu/libcudnn.so -- nvrtc : /usr/local/cuda-10.2/lib64/libnvrtc.so -- CUDA include path : /usr/local/cuda-10.2/include -- NVCC executable : /usr/local/cuda-10.2/bin/nvcc -- NVCC flags : -Xfatbin;-compress-all;-DONNX_NAMESPACE=onnx_torch;-gencode;arch=compute_53,code=sm_53;-gencode;arch=compute_62,code=sm_62;-gencode;arch=compute_72,code=sm_72;-Xcudafe;--diag_suppress=cc_clobber_ignored,--diag_suppress=integer_sign_change,--diag_suppress=useless_using_declaration,--diag_suppress=set_but_not_used,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=implicit_return_from_non_void_function,--diag_suppress=unsigned_compare_with_zero,--diag_suppress=declared_but_not_referenced,--diag_suppress=bad_friend_decl;-std=c++14;-Xcompiler;-fPIC;--expt-relaxed-constexpr;--expt-extended-lambda;-Wno-deprecated-gpu-targets;--expt-extended-lambda;-Xcompiler;-fPIC;-DCUDA_HAS_FP16=1;-D __CUDA_NO_HALF_OPERATORS__ ;-D __CUDA_NO_HALF_CONVERSIONS__ ;-D __CUDA_NO_BFLOAT16_CONVERSIONS__ ;-D __CUDA_NO_HALF2_OPERATORS__ -- CUDA host compiler : /usr/bin/cc -- NVCC --device-c : OFF -- USE_TENSORRT : OFF -- USE_ROCM : OFF -- USE_EIGEN_FOR_BLAS : ON -- USE_FBGEMM : OFF -- USE_FAKELOWP : OFF -- USE_KINETO : OFF -- USE_FFMPEG : OFF -- USE_GFLAGS : OFF -- USE_GLOG : OFF -- USE_LEVELDB : OFF -- USE_LITE_PROTO : OFF -- USE_LMDB : OFF -- USE_METAL : OFF -- USE_PYTORCH_METAL : OFF -- USE_FFTW : OFF -- USE_MKL : OFF -- USE_MKLDNN : OFF -- USE_NCCL : ON -- USE_SYSTEM_NCCL : OFF -- USE_NNPACK : ON -- USE_NUMPY : ON -- USE_OBSERVERS : ON -- USE_OPENCL : OFF -- USE_OPENCV : OFF -- USE_OPENMP : ON -- USE_TBB : OFF -- USE_VULKAN : OFF -- USE_PROF : OFF -- USE_QNNPACK : ON -- USE_PYTORCH_QNNPACK : ON -- USE_REDIS : OFF -- USE_ROCKSDB : OFF -- USE_ZMQ : OFF -- USE_DISTRIBUTED : ON -- USE_MPI : ON -- USE_GLOO : ON -- USE_TENSORPIPE : ON -- USE_DEPLOY : OFF -- Public Dependencies : Threads::Threads -- Private Dependencies : pthreadpool;cpuinfo;qnnpack;pytorch_qnnpack;nnpack;XNNPACK;/usr/lib/aarch64-linux-gnu/libnuma.so;fp16;/usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi_cxx.so;/usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi.so;gloo;tensorpipe;aten_op_header_gen;foxi_loader;rt;fmt::fmt-header-only;gcc_s;gcc;dl -- Configuring done -- Generating done -- Build files have been written to: /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch/build ninja: error: manifest 'build.ninja' still dirty after 100 tries Traceback (most recent call last): File "setup.py", line 818, in build_deps() File "setup.py", line 315, in build_deps build_caffe2(version=version, File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/build_pytorch_libs.py", line 58, in build_caffe2 cmake.build(my_env) File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/setup_helpers/cmake.py", line 345, in build self.run(build_args, my_env) File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/setup_helpers/cmake.py", line 140, in run check_call(command, cwd=self.build_dir, env=env) File "/usr/lib/python3.8/subprocess.py", line 364, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '6']' returned non-zero exit status 1. ``` seems like ninja is giving me some problems. However, if it perform pip uninstall ninja, then run the setup.py for pytorch, i get this ```auto Building wheel torch-1.8.0 -- Building version 1.8.0 cmake --build . --target install --config Release -- -j 6 CMake Error: The current CMakeCache.txt directory /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/build/CMakeCache.txt is different than the directory /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch/build where CMakeCache.txt was created. This may result in binaries being created in the wrong place. If you are not sure, reedit the CMakeCache.txt No such file or directory CMake Error: Generator: execution of make failed. Make command was: /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/bin/ninja -j 6 install && Traceback (most recent call last): File "setup.py", line 818, in build_deps() File "setup.py", line 315, in build_deps build_caffe2(version=version, File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/build_pytorch_libs.py", line 58, in build_caffe2 cmake.build(my_env) File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/setup_helpers/cmake.py", line 345, in build self.run(build_args, my_env) File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/setup_helpers/cmake.py", line 140, in run check_call(command, cwd=self.build_dir, env=env) File "/usr/lib/python3.8/subprocess.py", line 364, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '6']' returned non-zero exit status 1. ``` Which seems largely similar ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [February 24, 2022, 9:26pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/20 "2022-02-24T21:26:16Z")
Unfortunately I’m not sure how to fix the issue, or if it’s specific to Jetson/ARM or your configuration at all. You could try to build an unpatched/vanilla clone of PyTorch repo and see if that’s related. You may also want to try posting to the PyTorch forum about it to see if they may know. ---
**Author:** ![pylonicGateway](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/pylonicgateway/32/141839_2.png) [@pylonicGateway](https://forums.developer.nvidia.com/u/pylonicGateway)\ **Post date:** [February 25, 2022, 5:47am UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/21 "2022-02-25T05:47:58Z")
@dusty_nv would you know if the version of cmake matters ? I had also upgraded to cmake 3.22. Previously when using an older version of cmake, there was no infinite loop. ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [February 25, 2022, 7:40pm UTC](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976/22 "2022-02-25T19:40:22Z")
Hmm I’m not sure myself, as I build PyTorch with the default version of CMake in the Ubuntu 18.04 repo (which is CMake 3.10.2). That’s a good observation though - and since the infinite loop does seem to be occurring during the CMake config stage, you may want to try downgrading it. [Next page](https://forums.developer.nvidia.com/t/installing-pytorch-usr-local-cuda-lib64-libcudnn-so-error-adding-symbols-file-in-wrong-format-collect2-error-ld-returned-1-exit-status/200976.md?page=2)