mm@mm-desktop:~/Downloads/TensorRT_OSS/build$ make nvinfer_plugin -j8 Building for TensorRT version: 8.0.1, library version: 8 -- Targeting TRT Platform: x86_64 -- CUDA version set to 11.3.1 -- cuDNN version set to 8.2 -- Protobuf version set to 3.0.0 -- Setting up another Protobuf build for cross compilation targeting aarch64-Linux -- Using libprotobuf /home/mm/Downloads/TensorRT_OSS/build/third_party.protobuf_aarch64/lib/libprotobuf.a -- ========================= Importing and creating target nvinfer ========================== -- Looking for library nvinfer -- Library that was found /usr/lib/aarch64-linux-gnu/libnvinfer.so -- ========================================================================================== -- ========================= Importing and creating target nvuffparser ========================== -- Looking for library nvparsers -- Library that was found /usr/lib/aarch64-linux-gnu/libnvparsers.so -- ========================================================================================== -- GPU_ARCHS defined as 53 62 72. Generating CUDA code for SM 53 62 72 -- Protobuf proto/trtcaffe.proto -> proto/trtcaffe.pb.cc proto/trtcaffe.pb.h -- /home/mm/Downloads/TensorRT_OSS/build/parsers/caffe Generated: /home/mm/Downloads/TensorRT_OSS/build/parsers/onnx/third_party/onnx/onnx/onnx_onnx2trt_onnx-ml.proto Generated: /home/mm/Downloads/TensorRT_OSS/build/parsers/onnx/third_party/onnx/onnx/onnx-operators_onnx2trt_onnx-ml.proto Generated: /home/mm/Downloads/TensorRT_OSS/build/parsers/onnx/third_party/onnx/onnx/onnx-data_onnx2trt_onnx.proto -- -- ******** Summary ******** -- CMake version : 3.19.4 -- CMake command : /home/mm/install/bin/cmake -- System : Linux -- C++ compiler : /usr/bin/g++ -- C++ compiler version : 7.5.0 -- CXX flags : -Wno-deprecated-declarations -DBUILD_SYSTEM=cmake_oss -Wall -Wno-deprecated-declarations -Wno-unused-function -Wnon-virtual-dtor -- Build type : Release -- Compile definitions : _PROTOBUF_INSTALL_DIR=/home/mm/Downloads/TensorRT_OSS/build/third_party.protobuf;ONNX_NAMESPACE=onnx2trt_onnx -- CMAKE_PREFIX_PATH : -- CMAKE_INSTALL_PREFIX : /usr/lib/aarch64-linux-gnu/.. -- CMAKE_MODULE_PATH : -- -- ONNX version : 1.8.0 -- ONNX NAMESPACE : onnx2trt_onnx -- ONNX_BUILD_TESTS : OFF -- ONNX_BUILD_BENCHMARKS : OFF -- ONNX_USE_LITE_PROTO : OFF -- ONNXIFI_DUMMY_BACKEND : OFF -- ONNXIFI_ENABLE_EXT : OFF -- -- Protobuf compiler : -- Protobuf includes : -- Protobuf libraries : -- BUILD_ONNX_PYTHON : OFF -- Found TensorRT headers at /home/mm/Downloads/TensorRT_OSS/include -- Find TensorRT libs at /usr/lib/aarch64-linux-gnu/libnvinfer.so;/usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so -- Adding new sample: sample_algorithm_selector -- - Parsers Used: caffe -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_char_rnn -- - Parsers Used: uff;caffe;onnx -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_dynamic_reshape -- - Parsers Used: onnx -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_fasterRCNN -- - Parsers Used: caffe -- - InferPlugin Used: ON -- - Licensing: samples -- Adding new sample: sample_googlenet -- - Parsers Used: caffe -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_int8 -- - Parsers Used: caffe -- - InferPlugin Used: ON -- - Licensing: samples -- Adding new sample: sample_int8_api -- - Parsers Used: onnx -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_mlp -- - Parsers Used: caffe -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_mnist -- - Parsers Used: caffe -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_mnist_api -- - Parsers Used: caffe -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_nmt -- - Parsers Used: none -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_onnx_mnist -- - Parsers Used: onnx -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_reformat_free_io -- - Parsers Used: caffe -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_ssd -- - Parsers Used: caffe -- - InferPlugin Used: ON -- - Licensing: samples -- Adding new sample: sample_uff_fasterRCNN -- - Parsers Used: uff -- - InferPlugin Used: ON -- - Licensing: samples -- Adding new sample: sample_uff_maskRCNN -- - Parsers Used: uff -- - InferPlugin Used: ON -- - Licensing: samples -- Adding new sample: sample_uff_mnist -- - Parsers Used: uff -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_uff_plugin_v2_ext -- - Parsers Used: uff -- - InferPlugin Used: OFF -- - Licensing: samples -- Adding new sample: sample_uff_ssd -- - Parsers Used: uff -- - InferPlugin Used: ON -- - Licensing: samples -- Adding new sample: sample_onnx_mnist_coord_conv_ac -- - Parsers Used: onnx -- - InferPlugin Used: ON -- - Licensing: samples -- Adding new sample: trtexec -- - Parsers Used: caffe;uff;onnx -- - InferPlugin Used: OFF -- - Licensing: samples -- Configuring done CMake Warning (dev) in plugin/CMakeLists.txt: Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC, empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104" for policy details. Use the cmake_policy command to set the policy and suppress this warning. CUDA_ARCHITECTURES is empty for target "nvinfer_plugin". This warning is for project developers. Use -Wno-dev to suppress it. CMake Warning (dev) in plugin/CMakeLists.txt: Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC, empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104" for policy details. Use the cmake_policy command to set the policy and suppress this warning. CUDA_ARCHITECTURES is empty for target "nvinfer_plugin_static". This warning is for project developers. Use -Wno-dev to suppress it. -- Generating done -- Build files have been written to: /home/mm/Downloads/TensorRT_OSS/build Scanning dependencies of target nvinfer_plugin [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/batchedNMSPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/batchTilePlugin/batchTilePlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/cropAndResizePlugin/cropAndResizePlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/detectionLayerPlugin/detectionLayerPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/coordConvACPlugin/coordConvACPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/flattenConcat/flattenConcat.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/generateDetectionPlugin/generateDetectionPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/efficientNMSPlugin/efficientNMSPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/gridAnchorPlugin/gridAnchorPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/groupNormalizationPlugin/groupNormalizationPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/leakyReluPlugin/lReluPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/multilevelCropAndResizePlugin/multilevelCropAndResizePlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/multilevelProposeROI/multilevelProposeROIPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/nmsPlugin/nmsPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/normalizePlugin/normalizePlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/nvFasterRCNN/nvFasterRCNNPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/priorBoxPlugin/priorBoxPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/proposalLayerPlugin/proposalLayerPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/proposalPlugin/proposalPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/pyramidROIAlignPlugin/pyramidROIAlignPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/regionPlugin/regionPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/reorgPlugin/reorgPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/resizeNearestPlugin/resizeNearestPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/scatterPlugin/scatterPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/specialSlicePlugin/specialSlicePlugin.cpp.o [ 3%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/splitPlugin/split.cu.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_128_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_128_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_384_64_kernel.sm86.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_64_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_64_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_96_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_fp16_96_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_128_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_128_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_384_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention/src/fused_multihead_attention_int8_384_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_32_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_32_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_128_64_kernel.sm86.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_32_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_32_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_256_64_kernel.sm86.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_32_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_384_64_kernel.sm86.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_32_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_512_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_64_64_kernel.sm86.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_fp16_96_64_kernel.sm86.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_32_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_32_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm72.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_128_64_kernel.sm86.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm72.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_192_64_kernel.sm86.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_32_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_32_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm72.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm72.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_256_64_kernel.sm86.cpp.o /home/mm/Downloads/TensorRT_OSS/plugin/splitPlugin/split.h(85): warning: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::configurePlugin" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/splitPlugin/split.h(87): warning: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::SplitPlugin::enqueue" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/splitPlugin/split.h(88): warning: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::getOutputDimensions" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/splitPlugin/split.h(106): warning: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::SplitPlugin::getWorkspaceSize" -- virtual function override intended? [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_384_64_kernel.sm86.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_32_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_32_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_64_kernel.sm75.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/fused_multihead_attention_v2/src/fused_multihead_attention_v2_int8_512_64_kernel.sm80.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/qkvToContextInt8InterleavedPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/bertQKVToContextPlugin/qkvToContextPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/embLayerNormPlugin/embLayerNormPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/embLayerNormPlugin/embLayerNormVarSeqlenPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/fcPlugin/fcPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/geluPlugin/geluPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/skipLayerNormPlugin/skipLayerNormInt8InterleavedPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/skipLayerNormPlugin/skipLayerNormPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/common/checkMacrosPlugin.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/common/cudaDriverWrapper.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/common/kernel.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/common/nmsHelper.cpp.o [ 3%] Building CXX object plugin/CMakeFiles/nvinfer_plugin.dir/common/reducedMathPlugin.cpp.o [ 3%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/batchedNMSInference.cu.o [ 3%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/batchedNMSPlugin/gatherNMSOutputs.cu.o [ 3%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/coordConvACPlugin/coordConvACPlugin.cu.o [ 3%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/efficientNMSPlugin/efficientNMSInference.cu.o [ 3%] Building CUDA object plugin/CMakeFiles/nvinfer_plugin.dir/groupNormalizationPlugin/groupNormalizationKernel.cu.o /home/mm/Downloads/TensorRT_OSS/plugin/efficientNMSPlugin/efficientNMSInference.cu:18:10: fatal error: cub/cub.cuh: No such file or directory #include "cub/cub.cuh" ^~~~~~~~~~~~~ compilation terminated. plugin/CMakeFiles/nvinfer_plugin.dir/build.make:1407: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/efficientNMSPlugin/efficientNMSInference.cu.o' failed make[3]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/efficientNMSPlugin/efficientNMSInference.cu.o] Error 1 make[3]: *** Waiting for unfinished jobs.... /home/mm/Downloads/TensorRT_OSS/plugin/splitPlugin/split.h(85): warning: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::configurePlugin" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/splitPlugin/split.h(87): warning: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::SplitPlugin::enqueue" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/splitPlugin/split.h(88): warning: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::SplitPlugin::getOutputDimensions" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/splitPlugin/split.h(106): warning: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::SplitPlugin::getWorkspaceSize" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const __nv_bool *, const __nv_bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(53): warning: function "nvinfer1::IPluginV2::getOutputDimensions(int32_t, const nvinfer1::Dims *, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getOutputDimensions" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(60): warning: function "nvinfer1::IPluginV2::getWorkspaceSize(int32_t) const" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::getWorkspaceSize" -- virtual function override intended? /home/mum/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(63): warning: function "nvinfer1::IPluginV2::enqueue(int32_t, const void *const *, void *const *, void *, cudaStream_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::enqueue" -- virtual function override intended? /home/mm/Downloads/TensorRT_OSS/plugin/groupNormalizationPlugin/groupNormalizationPlugin.h(91): warning: function "nvinfer1::IPluginV2Ext::configurePlugin(const nvinfer1::Dims *, int32_t, const nvinfer1::Dims *, int32_t, const nvinfer1::DataType *, const nvinfer1::DataType *, const bool *, const bool *, nvinfer1::PluginFormat, int32_t)" is hidden by "nvinfer1::plugin::GroupNormalizationPlugin::configurePlugin" -- virtual function override intended? CMakeFiles/Makefile2:1539: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/all' failed make[2]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/all] Error 2 CMakeFiles/Makefile2:1546: recipe for target 'plugin/CMakeFiles/nvinfer_plugin.dir/rule' failed make[1]: *** [plugin/CMakeFiles/nvinfer_plugin.dir/rule] Error 2 Makefile:257: recipe for target 'nvinfer_plugin' failed make: *** [nvinfer_plugin] Error 2