/trtexec --onnx=/home/nvidia/NVIDIA/DRV3/drive/mobilenetv2-10.onnx --dumpProfile --dumpLayerInfo
&&&& RUNNING TensorRT.trtexec [TensorRT v8411] # ./trtexec --onnx=/home/nvidia/NVIDIA/DRV3/drive/mobilenetv2-10.onnx --dumpProfile --dumpLayerInfo
[10/19/2022-16:16:47] [I] === Model Options ===
[10/19/2022-16:16:47] [I] Format: ONNX
[10/19/2022-16:16:47] [I] Model: /home/nvidia/NVIDIA/DRV3/drive/mobilenetv2-10.onnx
[10/19/2022-16:16:47] [I] Output:
[10/19/2022-16:16:47] [I] === Build Options ===
[10/19/2022-16:16:47] [I] Max batch: explicit batch
[10/19/2022-16:16:47] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
[10/19/2022-16:16:47] [I] minTiming: 1
[10/19/2022-16:16:47] [I] avgTiming: 8
[10/19/2022-16:16:47] [I] Precision: FP32
[10/19/2022-16:16:47] [I] LayerPrecisions: 
[10/19/2022-16:16:47] [I] Calibration: 
[10/19/2022-16:16:47] [I] Refit: Disabled
[10/19/2022-16:16:47] [I] Sparsity: Disabled
[10/19/2022-16:16:47] [I] Safe mode: Disabled
[10/19/2022-16:16:47] [I] DirectIO mode: Disabled
[10/19/2022-16:16:47] [I] Restricted mode: Disabled
[10/19/2022-16:16:47] [I] Build only: Disabled
[10/19/2022-16:16:47] [I] Save engine: 
[10/19/2022-16:16:47] [I] Load engine: 
[10/19/2022-16:16:47] [I] Profiling verbosity: 0
[10/19/2022-16:16:47] [I] Tactic sources: Using default tactic sources
[10/19/2022-16:16:47] [I] timingCacheMode: local
[10/19/2022-16:16:47] [I] timingCacheFile: 
[10/19/2022-16:16:47] [I] Input(s)s format: fp32:CHW
[10/19/2022-16:16:47] [I] Output(s)s format: fp32:CHW
[10/19/2022-16:16:47] [I] Input build shapes: model
[10/19/2022-16:16:47] [I] Input calibration shapes: model
[10/19/2022-16:16:47] [I] === System Options ===
[10/19/2022-16:16:47] [I] Device: 0
[10/19/2022-16:16:47] [I] DLACore: 
[10/19/2022-16:16:47] [I] Plugins:
[10/19/2022-16:16:47] [I] === Inference Options ===
[10/19/2022-16:16:47] [I] Batch: Explicit
[10/19/2022-16:16:47] [I] Input inference shapes: model
[10/19/2022-16:16:47] [I] Iterations: 10
[10/19/2022-16:16:47] [I] Duration: 3s (+ 200ms warm up)
[10/19/2022-16:16:47] [I] Sleep time: 0ms
[10/19/2022-16:16:47] [I] Idle time: 0ms
[10/19/2022-16:16:47] [I] Streams: 1
[10/19/2022-16:16:47] [I] ExposeDMA: Disabled
[10/19/2022-16:16:47] [I] Data transfers: Enabled
[10/19/2022-16:16:47] [I] Spin-wait: Disabled
[10/19/2022-16:16:47] [I] Multithreading: Disabled
[10/19/2022-16:16:47] [I] CUDA Graph: Disabled
[10/19/2022-16:16:47] [I] Separate profiling: Disabled
[10/19/2022-16:16:47] [I] Time Deserialize: Disabled
[10/19/2022-16:16:47] [I] Time Refit: Disabled
[10/19/2022-16:16:47] [I] Inputs:
[10/19/2022-16:16:47] [I] === Reporting Options ===
[10/19/2022-16:16:47] [I] Verbose: Disabled
[10/19/2022-16:16:47] [I] Averages: 10 inferences
[10/19/2022-16:16:47] [I] Percentile: 99
[10/19/2022-16:16:47] [I] Dump refittable layers:Disabled
[10/19/2022-16:16:47] [I] Dump output: Disabled
[10/19/2022-16:16:47] [I] Profile: Enabled
[10/19/2022-16:16:47] [I] Export timing to JSON file: 
[10/19/2022-16:16:47] [I] Export output to JSON file: 
[10/19/2022-16:16:47] [I] Export profile to JSON file: 
[10/19/2022-16:16:47] [I] 
[10/19/2022-16:16:47] [I] === Device Information ===
[10/19/2022-16:16:47] [I] Selected Device: Quadro P2000
[10/19/2022-16:16:47] [I] Compute Capability: 6.1
[10/19/2022-16:16:47] [I] SMs: 6
[10/19/2022-16:16:47] [I] Compute Clock Rate: 1.607 GHz
[10/19/2022-16:16:47] [I] Device Global Memory: 4040 MiB
[10/19/2022-16:16:47] [I] Shared Memory per SM: 96 KiB
[10/19/2022-16:16:47] [I] Memory Bus Width: 128 bits (ECC disabled)
[10/19/2022-16:16:47] [I] Memory Clock Rate: 3.004 GHz
[10/19/2022-16:16:47] [I] 
[10/19/2022-16:16:47] [I] TensorRT version: 8.4.11
[10/19/2022-16:16:48] [I] [TRT] [MemUsageChange] Init CUDA: CPU +23, GPU +0, now: CPU 32, GPU 64 (MiB)
[10/19/2022-16:16:48] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +7, GPU +0, now: CPU 58, GPU 64 (MiB)
[10/19/2022-16:16:48] [I] Start parsing network model
[10/19/2022-16:16:48] [I] [TRT] ----------------------------------------------------------------
[10/19/2022-16:16:48] [I] [TRT] Input filename:   /home/nvidia/NVIDIA/DRV3/drive/mobilenetv2-10.onnx
[10/19/2022-16:16:48] [I] [TRT] ONNX IR version:  0.0.6
[10/19/2022-16:16:48] [I] [TRT] Opset version:    10
[10/19/2022-16:16:48] [I] [TRT] Producer name:    pytorch
[10/19/2022-16:16:48] [I] [TRT] Producer version: 1.8
[10/19/2022-16:16:48] [I] [TRT] Domain:           
[10/19/2022-16:16:48] [I] [TRT] Model version:    0
[10/19/2022-16:16:48] [I] [TRT] Doc string:       
[10/19/2022-16:16:48] [I] [TRT] ----------------------------------------------------------------
[10/19/2022-16:16:48] [W] [TRT] onnx2trt_utils.cpp:367: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[10/19/2022-16:16:48] [I] Finish parsing network model
[10/19/2022-16:16:48] [W] Dynamic dimensions required for input: input, but no shapes were provided. Automatically overriding shape to: 1x3x224x224
[10/19/2022-16:16:49] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +248, GPU +102, now: CPU 320, GPU 166 (MiB)
[10/19/2022-16:16:49] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +113, GPU +46, now: CPU 433, GPU 212 (MiB)
[10/19/2022-16:16:49] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
[10/19/2022-16:16:49] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:49] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:49] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:49] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:49] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:49] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:49] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.
[10/19/2022-16:16:50] [W] [TRT] Caught cuda error during timing, format rejected.