&&&& RUNNING TensorRT.trtexec [TensorRT v8501] # /usr/src/tensorrt/bin/trtexec --onnx=mobilenetv2_224x224.onnx --saveEngine=mobile.engine --allowGPUFallback --verbose [12/07/2022-00:15:06] [I] === Model Options === [12/07/2022-00:15:06] [I] Format: ONNX [12/07/2022-00:15:06] [I] Model: mobilenetv2_224x224.onnx [12/07/2022-00:15:06] [I] Output: [12/07/2022-00:15:06] [I] === Build Options === [12/07/2022-00:15:06] [I] Max batch: explicit batch [12/07/2022-00:15:06] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default [12/07/2022-00:15:06] [I] minTiming: 1 [12/07/2022-00:15:06] [I] avgTiming: 8 [12/07/2022-00:15:06] [I] Precision: FP32 [12/07/2022-00:15:06] [I] LayerPrecisions: [12/07/2022-00:15:06] [I] Calibration: [12/07/2022-00:15:06] [I] Refit: Disabled [12/07/2022-00:15:06] [I] Sparsity: Disabled [12/07/2022-00:15:06] [I] Safe mode: Disabled [12/07/2022-00:15:06] [I] DirectIO mode: Disabled [12/07/2022-00:15:06] [I] Restricted mode: Disabled [12/07/2022-00:15:06] [I] Build only: Disabled [12/07/2022-00:15:06] [I] Save engine: mobile.engine [12/07/2022-00:15:06] [I] Load engine: [12/07/2022-00:15:06] [I] Profiling verbosity: 0 [12/07/2022-00:15:06] [I] Tactic sources: Using default tactic sources [12/07/2022-00:15:06] [I] timingCacheMode: local [12/07/2022-00:15:06] [I] timingCacheFile: [12/07/2022-00:15:06] [I] Heuristic: Disabled [12/07/2022-00:15:06] [I] Preview Features: Use default preview flags. [12/07/2022-00:15:06] [I] Input(s)s format: fp32:CHW [12/07/2022-00:15:06] [I] Output(s)s format: fp32:CHW [12/07/2022-00:15:06] [I] Input build shapes: model [12/07/2022-00:15:06] [I] Input calibration shapes: model [12/07/2022-00:15:06] [I] === System Options === [12/07/2022-00:15:06] [I] Device: 0 [12/07/2022-00:15:06] [I] DLACore: [12/07/2022-00:15:06] [I] Plugins: [12/07/2022-00:15:06] [I] === Inference Options === [12/07/2022-00:15:06] [I] Batch: Explicit [12/07/2022-00:15:06] [I] Input inference shapes: model [12/07/2022-00:15:06] [I] Iterations: 10 [12/07/2022-00:15:06] [I] Duration: 3s (+ 200ms warm up) [12/07/2022-00:15:06] [I] Sleep time: 0ms [12/07/2022-00:15:06] [I] Idle time: 0ms [12/07/2022-00:15:06] [I] Streams: 1 [12/07/2022-00:15:06] [I] ExposeDMA: Disabled [12/07/2022-00:15:06] [I] Data transfers: Enabled [12/07/2022-00:15:06] [I] Spin-wait: Disabled [12/07/2022-00:15:06] [I] Multithreading: Disabled [12/07/2022-00:15:06] [I] CUDA Graph: Disabled [12/07/2022-00:15:06] [I] Separate profiling: Disabled [12/07/2022-00:15:06] [I] Time Deserialize: Disabled [12/07/2022-00:15:06] [I] Time Refit: Disabled [12/07/2022-00:15:06] [I] NVTX verbosity: 0 [12/07/2022-00:15:06] [I] Persistent Cache Ratio: 0 [12/07/2022-00:15:06] [I] Inputs: [12/07/2022-00:15:06] [I] === Reporting Options === [12/07/2022-00:15:06] [I] Verbose: Enabled [12/07/2022-00:15:06] [I] Averages: 10 inferences [12/07/2022-00:15:06] [I] Percentiles: 90,95,99 [12/07/2022-00:15:06] [I] Dump refittable layers:Disabled [12/07/2022-00:15:06] [I] Dump output: Disabled [12/07/2022-00:15:06] [I] Profile: Disabled [12/07/2022-00:15:06] [I] Export timing to JSON file: [12/07/2022-00:15:06] [I] Export output to JSON file: [12/07/2022-00:15:06] [I] Export profile to JSON file: [12/07/2022-00:15:06] [I] [12/07/2022-00:15:06] [I] === Device Information === [12/07/2022-00:15:06] [I] Selected Device: Orin [12/07/2022-00:15:06] [I] Compute Capability: 8.7 [12/07/2022-00:15:06] [I] SMs: 16 [12/07/2022-00:15:06] [I] Compute Clock Rate: 1.3 GHz [12/07/2022-00:15:06] [I] Device Global Memory: 30535 MiB [12/07/2022-00:15:06] [I] Shared Memory per SM: 164 KiB [12/07/2022-00:15:06] [I] Memory Bus Width: 128 bits (ECC disabled) [12/07/2022-00:15:06] [I] Memory Clock Rate: 1.3 GHz [12/07/2022-00:15:06] [I] [12/07/2022-00:15:06] [I] TensorRT version: 8.5.1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::DecodeBbox3DPlugin version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 2 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::MultiscaleDeformableAttnPlugin_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::PillarScatterPlugin version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::Proposal version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::ROIAlign_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::Split version 1 [12/07/2022-00:15:06] [V] [TRT] Registered plugin creator - ::VoxelGeneratorPlugin version 1 [12/07/2022-00:15:06] [W] [TRT] Unable to determine GPU memory usage [12/07/2022-00:15:06] [W] [TRT] Unable to determine GPU memory usage [12/07/2022-00:15:06] [I] [TRT] [MemUsageChange] Init CUDA: CPU +5, GPU +0, now: CPU 17, GPU 0 (MiB) [12/07/2022-00:15:06] [W] [TRT] CUDA initialization failure with error: 222. Please check your CUDA installation: http://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html [12/07/2022-00:15:06] [E] Builder creation failed [12/07/2022-00:15:06] [E] Failed to create engine from model or file. [12/07/2022-00:15:06] [E] Engine set up failed &&&& FAILED TensorRT.trtexec [TensorRT v8501] # /usr/src/tensorrt/bin/trtexec --onnx=mobilenetv2_224x224.onnx --saveEngine=mobile.engine --allowGPUFallback --verbose