@dusty_nv ah I only copied over the part that was being looped, not the whole terminal output.
I left it to run for about 30mins and it was going through the same things. Until it hit this portion.
--
-- ******** Summary ********
-- General:
-- CMake version : 3.22.2
-- CMake command : /usr/bin/cmake
-- System : Linux
-- C++ compiler : /usr/bin/c++
-- C++ compiler id : GNU
-- C++ compiler version : 7.4.0
-- CXX flags : -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -DMISSING_ARM_VST1 -DMISSING_ARM_VLD1 -Wno-stringop-overflow
-- Build type : Release
-- Compile definitions : ONNX_ML=1;ONNXIFI_ENABLE_EXT=1;ONNX_NAMESPACE=onnx_torch;HAVE_MMAP=1;_FILE_OFFSET_BITS=64;HAVE_SHM_OPEN=1;HAVE_SHM_UNLINK=1;HAVE_MALLOC_USABLE_SIZE=1;USE_EXTERNAL_MZCRC;MINIZ_DISABLE_ZIP_READER_CRC32_CHECKS
-- CMAKE_PREFIX_PATH : /usr/local/cuda-10.2
-- CMAKE_INSTALL_PREFIX : /usr/local
--
-- TORCH_VERSION : 1.8.0
-- CAFFE2_VERSION : 1.8.0
-- BUILD_CAFFE2 : ON
-- BUILD_CAFFE2_OPS : ON
-- BUILD_CAFFE2_MOBILE : OFF
-- BUILD_STATIC_RUNTIME_BENCHMARK: OFF
-- BUILD_TENSOREXPR_BENCHMARK: OFF
-- BUILD_BINARY : OFF
-- BUILD_CUSTOM_PROTOBUF : ON
-- Protobuf compiler :
-- Protobuf includes :
-- Protobuf libraries :
-- BUILD_DOCS : OFF
-- BUILD_PYTHON : ON
-- Python version : 3.8
-- Python executable : /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/bin/python
-- Pythonlibs version : 3.8.0
-- Python library : /usr/lib/python3.8
-- Python includes : /usr/include/python3.8
-- Python site-packages: lib/python3.8/site-packages
-- BUILD_SHARED_LIBS : OFF
-- CAFFE2_USE_MSVC_STATIC_RUNTIME : ON
-- BUILD_TEST : OFF
-- BUILD_JNI : OFF
-- BUILD_MOBILE_AUTOGRAD : OFF
-- INTERN_BUILD_MOBILE :
-- USE_BLAS : 1
-- BLAS : open
-- USE_LAPACK : 1
-- LAPACK : open
-- USE_ASAN : OFF
-- USE_CPP_CODE_COVERAGE : OFF
-- USE_CUDA : ON
-- Split CUDA : OFF
-- CUDA static link : OFF
-- USE_CUDNN : ON
-- CUDA version : 10.2
-- cuDNN version : 8.0.0
-- CUDA root directory : /usr/local/cuda-10.2
-- CUDA library : /usr/local/cuda-10.2/lib64/stubs/libcuda.so
-- cudart library : /usr/local/cuda-10.2/lib64/libcudart.so
-- cublas library : /usr/lib/aarch64-linux-gnu/libcublas.so
-- cufft library : /usr/local/cuda-10.2/lib64/libcufft.so
-- curand library : /usr/local/cuda-10.2/lib64/libcurand.so
-- cuDNN library : /usr/lib/aarch64-linux-gnu/libcudnn.so
-- nvrtc : /usr/local/cuda-10.2/lib64/libnvrtc.so
-- CUDA include path : /usr/local/cuda-10.2/include
-- NVCC executable : /usr/local/cuda-10.2/bin/nvcc
-- NVCC flags : -Xfatbin;-compress-all;-DONNX_NAMESPACE=onnx_torch;-gencode;arch=compute_53,code=sm_53;-gencode;arch=compute_62,code=sm_62;-gencode;arch=compute_72,code=sm_72;-Xcudafe;--diag_suppress=cc_clobber_ignored,--diag_suppress=integer_sign_change,--diag_suppress=useless_using_declaration,--diag_suppress=set_but_not_used,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=implicit_return_from_non_void_function,--diag_suppress=unsigned_compare_with_zero,--diag_suppress=declared_but_not_referenced,--diag_suppress=bad_friend_decl;-std=c++14;-Xcompiler;-fPIC;--expt-relaxed-constexpr;--expt-extended-lambda;-Wno-deprecated-gpu-targets;--expt-extended-lambda;-Xcompiler;-fPIC;-DCUDA_HAS_FP16=1;-D__CUDA_NO_HALF_OPERATORS__;-D__CUDA_NO_HALF_CONVERSIONS__;-D__CUDA_NO_BFLOAT16_CONVERSIONS__;-D__CUDA_NO_HALF2_OPERATORS__
-- CUDA host compiler : /usr/bin/cc
-- NVCC --device-c : OFF
-- USE_TENSORRT : OFF
-- USE_ROCM : OFF
-- USE_EIGEN_FOR_BLAS : ON
-- USE_FBGEMM : OFF
-- USE_FAKELOWP : OFF
-- USE_KINETO : OFF
-- USE_FFMPEG : OFF
-- USE_GFLAGS : OFF
-- USE_GLOG : OFF
-- USE_LEVELDB : OFF
-- USE_LITE_PROTO : OFF
-- USE_LMDB : OFF
-- USE_METAL : OFF
-- USE_PYTORCH_METAL : OFF
-- USE_FFTW : OFF
-- USE_MKL : OFF
-- USE_MKLDNN : OFF
-- USE_NCCL : ON
-- USE_SYSTEM_NCCL : OFF
-- USE_NNPACK : ON
-- USE_NUMPY : ON
-- USE_OBSERVERS : ON
-- USE_OPENCL : OFF
-- USE_OPENCV : OFF
-- USE_OPENMP : ON
-- USE_TBB : OFF
-- USE_VULKAN : OFF
-- USE_PROF : OFF
-- USE_QNNPACK : ON
-- USE_PYTORCH_QNNPACK : ON
-- USE_REDIS : OFF
-- USE_ROCKSDB : OFF
-- USE_ZMQ : OFF
-- USE_DISTRIBUTED : ON
-- USE_MPI : ON
-- USE_GLOO : ON
-- USE_TENSORPIPE : ON
-- USE_DEPLOY : OFF
-- Public Dependencies : Threads::Threads
-- Private Dependencies : pthreadpool;cpuinfo;qnnpack;pytorch_qnnpack;nnpack;XNNPACK;/usr/lib/aarch64-linux-gnu/libnuma.so;fp16;/usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi_cxx.so;/usr/lib/aarch64-linux-gnu/openmpi/lib/libmpi.so;gloo;tensorpipe;aten_op_header_gen;foxi_loader;rt;fmt::fmt-header-only;gcc_s;gcc;dl
-- Configuring done
-- Generating done
-- Build files have been written to: /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch/build
ninja: error: manifest 'build.ninja' still dirty after 100 tries
Traceback (most recent call last):
File "setup.py", line 818, in <module>
build_deps()
File "setup.py", line 315, in build_deps
build_caffe2(version=version,
File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/build_pytorch_libs.py", line 58, in build_caffe2
cmake.build(my_env)
File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/setup_helpers/cmake.py", line 345, in build
self.run(build_args, my_env)
File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/setup_helpers/cmake.py", line 140, in run
check_call(command, cwd=self.build_dir, env=env)
File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '6']' returned non-zero exit status 1.
seems like ninja is giving me some problems. However, if it perform pip uninstall ninja, then run the setup.py for pytorch, i get this
Building wheel torch-1.8.0
-- Building version 1.8.0
cmake --build . --target install --config Release -- -j 6
CMake Error: The current CMakeCache.txt directory /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/build/CMakeCache.txt is different than the directory /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorch/build where CMakeCache.txt was created. This may result in binaries being created in the wrong place. If you are not sure, reedit the CMakeCache.txt
No such file or directory
CMake Error: Generator: execution of make failed. Make command was: /media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/bin/ninja -j 6 install &&
Traceback (most recent call last):
File "setup.py", line 818, in <module>
build_deps()
File "setup.py", line 315, in build_deps
build_caffe2(version=version,
File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/build_pytorch_libs.py", line 58, in build_caffe2
cmake.build(my_env)
File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/setup_helpers/cmake.py", line 345, in build
self.run(build_args, my_env)
File "/media/8eb89120-ba8b-4110-96c7-3179158d68ee/pyenvs/newpy38/pytorchOLD/tools/setup_helpers/cmake.py", line 140, in run
check_call(command, cwd=self.build_dir, env=env)
File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '6']' returned non-zero exit status 1.
Which seems largely similar