Tactic Device request: 250MB Available: 6MB. Device memory is insufficient to use tactic

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Hello, I’m trying to convert a model inside deepstream container but somehow it cannot access the GPU memory properly

Memory check:

root@tegra-ubuntu:/app/resources# nvidia-smi
Tue Mar 31 16:50:47 2026
±--------------------------------------------------------------------------------------+
| NVIDIA-SMI 540.4.0                Driver Version: 540.4.0      CUDA Version: 12.6     |
|-----------------------------------------±---------------------±---------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  Orin (nvgpu)                  N/A  | N/A              N/A |                  N/A |
| N/A   N/A  N/A               N/A /  N/A | Not Supported        |     N/A          N/A |
|                                         |                      |                  N/A |
±----------------------------------------±---------------------±---------------------+

±--------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|  No running processes found                                                           |
±--------------------------------------------------------------------------------------+
root@tegra-ubuntu:/app/resources# free -m
total        used        free      shared  buff/cache   available
Mem:           15656        4513        9865          42        1276       10837
Swap:           7828           0        7828

However:



[03/31/2026-16:48:49] [I] [TRT] ----------------------------------------------------------------
[03/31/2026-16:48:49] [I] [TRT] Input filename:   yolox_single_channel_orin.onnx
[03/31/2026-16:48:49] [I] [TRT] ONNX IR version:  0.0.6
[03/31/2026-16:48:49] [I] [TRT] Opset version:    11
[03/31/2026-16:48:49] [I] [TRT] Producer name:    pytorch
[03/31/2026-16:48:49] [I] [TRT] Producer version: 1.9
[03/31/2026-16:48:49] [I] [TRT] Domain:
[03/31/2026-16:48:49] [I] [TRT] Model version:    0
[03/31/2026-16:48:49] [I] [TRT] Doc string:
[03/31/2026-16:48:49] [I] [TRT] ----------------------------------------------------------------
[03/31/2026-16:48:49] [I] Finished parsing network model. Parse time: 0.0622941
[03/31/2026-16:48:49] [I] Set shape of input tensor input for optimization profile 0 to: MIN=1x1x640x640 OPT=72x1x640x640 MAX=80x1x640x640
[03/31/2026-16:48:49] [W] [TRT] DLA requests all profiles have same min, max, and opt value. All dla layers are falling back to GPU
[03/31/2026-16:48:49] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
[03/31/2026-16:48:49] [W] [TRT] Tactic Device request: 250MB Available: 6MB. Device memory is insufficient to use tactic.
[03/31/2026-16:48:49] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 262144000 detected for tactic 0x0000000000000000.
[03/31/2026-16:48:49] [W] [TRT] Tactic Device request: 156MB Available: 6MB. Device memory is insufficient to use tactic.
[03/31/2026-16:48:49] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 163840000 detected for tactic 0x0000000000000000.
[03/31/2026-16:48:49] [W] [TRT] Tactic Device request: 125MB Available: 6MB. Device memory is insufficient to use tactic.
[03/31/2026-16:48:49] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 131072000 detected for tactic 0x0000000000000000.
[03/31/2026-16:48:49] [W] [TRT] Tactic Device request: 78MB Available: 6MB. Device memory is insufficient to use tactic.
[03/31/2026-16:48:49] [W] [TRT] UNSUPPORTED_STATE: Skipping tactic 0 due to insufficient memory on requested size of 81920000 detected for tactic 0x0000000000000000.
[03/31/2026-16:48:49] [E] Error[10]: IBuilder::buildSerializedNetwork: Error Code 10: Internal Error (Could not find any implementation for node node_of_1552.)
[03/31/2026-16:48:49] [E] Engine could not be created from network
[03/31/2026-16:48:49] [E] Building engine failed
[03/31/2026-16:48:49] [E] Failed to create engine from model or file.
[03/31/2026-16:48:49] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v100300] # trtexec --onnx=yolox_single_channel_orin.onnx --saveEngine=yolox_single_channel_orin_ds71nx-new.engine --fp16 --minShapes=input:1x1x640x640 --optShapes=input:72x1x640x640 --maxShapes=input:80x1x640x640 --memPoolSize=workspace:8000

Tegrastats output (outside container):

03-31-2026 16:52:52 RAM 4583/15656MB (lfb 310x4MB) SWAP 0/7828MB (cached 0MB) CPU [0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497] GR3D_FREQ 0% cv0@68.5C cpu@71.812C soc2@69.625C soc0@70.281C cv1@70.437C gpu@68.468C tj@73.281C soc1@73.281C cv2@69.531C VDD_IN 7654mW/7654mW VDD_CPU_GPU_CV 1243mW/1243mW VDD_SOC 2868mW/2868mW
03-31-2026 16:52:53 RAM 4583/15656MB (lfb 310x4MB) SWAP 0/7828MB (cached 0MB) CPU [0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497] GR3D_FREQ 0% cv0@68.531C cpu@72.093C soc2@69.625C soc0@70.25C cv1@70.156C gpu@68.593C tj@73C soc1@73C cv2@69.593C VDD_IN 7654mW/7654mW VDD_CPU_GPU_CV 1243mW/1243mW VDD_SOC 2868mW/2868mW
03-31-2026 16:52:54 RAM 4583/15656MB (lfb 310x4MB) SWAP 0/7828MB (cached 0MB) CPU [0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497] GR3D_FREQ 0% cv0@68.562C cpu@71.718C soc2@69.468C soc0@70.312C cv1@70.125C gpu@68.781C tj@73C soc1@73C cv2@69.625C VDD_IN 7654mW/7654mW VDD_CPU_GPU_CV 1243mW/1243mW VDD_SOC 2868mW/2868mW
03-31-2026 16:52:55 RAM 4583/15656MB (lfb 310x4MB) SWAP 0/7828MB (cached 0MB) CPU [0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497,0%@1497] GR3D_FREQ 0% cv0@68.625C cpu@71.781C soc2@69.406C soc0@70.375C cv1@70.25C gpu@68.625C tj@73.156C soc1@73.156C cv2@69.5C VDD_IN 7654mW/7654mW VDD_CPU_GPU_CV 1243mW/1243mW VDD_SOC 2868mW/2868mW

Platform info:

• Hardware Platform (Jetson / GPU) Orin NX 16gb
• DeepStream Version 7.1
• JetPack Version (valid for Jetson only) 6.2
• TensorRT Version 10.3
• NVIDIA GPU Driver Version (valid for GPU only) 540.4.0
• Base image: nvcr.io/nvidia/deepstream:7.1-triton-multiarch

3

Have you run the deepstream-test1 sample in the docker?

4

Deepstream test 1 and 2 (modified them to use fakesink so they work inside a non-display container)

Diving a bit into the issue, could this be related to memory fragmentation? lfb 310x4MB seems small, but I don’t think adjusting it is possible, this is a brand new board, the only process done was flashing jetpack 6.2 and building the docker image for deepstream

root@tegra-ubuntu:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test1# ./deepstream-test1-app /app/resources/output.h264
max_fps_dur 8.33333e+06 min_fps_dur 2e+08

(deepstream-test1-app:1302): GLib-GObject-CRITICAL **: 06:59:43.752: g_object_set_is_valid_property: object class ‘GstNvStreamMux’ has no property named ‘width’
Added elements to bin
Using file: /app/resources/output.h264
Opening in BLOCKING MODE
Setting min object dimensions as 16x16 instead of 1x1 to support VIC compute mode.
0:00:00.296555959  1302 0xaaaae920db80 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2092> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-7.1/samples/models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b1_gpu0_int8.engine
Implicit layer support has been deprecated
INFO: [Implicit Engine Info]: layers num: 0

0:00:00.296673945  1302 0xaaaae920db80 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2195> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-7.1/samples/models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b1_gpu0_int8.engine
0:00:00.303592205  1302 0xaaaae920db80 INFO                 nvinfer gstnvinfer_impl.cpp:343:notifyLoadModelStatus: [UID 1]: Load new model:dstest1_pgie_config.txt sucessfully
Running…
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
max_fps_dur 8.33333e+06 min_fps_dur 2e+08
Frame Number = 0 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 1 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 2 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 3 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 4 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 5 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 6 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 7 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 8 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 9 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 10 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 11 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 12 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 13 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 14 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 15 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 16 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 17 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 18 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 19 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 20 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 21 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 22 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 23 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 24 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 25 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 26 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 27 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 28 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 29 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 30 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 31 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 32 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 33 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 34 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 35 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 36 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 37 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 38 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 39 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 40 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 41 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 42 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 43 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 44 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 45 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 46 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 47 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 48 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 49 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 50 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 51 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 52 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 53 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 54 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 55 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 56 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 57 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 58 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 59 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 60 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 61 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 62 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 63 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 64 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 65 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 66 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 67 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 68 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 69 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 70 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 71 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 72 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 73 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 74 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 75 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 76 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 77 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 78 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 79 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 80 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 81 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 82 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 83 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 84 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 85 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 86 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 87 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 88 Number of objects = 3 Vehicle Count = 3 Person Count = 0
Frame Number = 89 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 90 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 91 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 92 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 93 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 94 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 95 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 96 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 97 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 98 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 99 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 100 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 101 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 102 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 103 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 104 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 105 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 106 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 107 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 108 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 109 Number of objects = 3 Vehicle Count = 3 Person Count = 0
Frame Number = 110 Number of objects = 3 Vehicle Count = 3 Person Count = 0
Frame Number = 111 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 112 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 113 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 114 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 115 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 116 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 117 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 118 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 119 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 120 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 121 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 122 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 123 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 124 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 125 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 126 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 127 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 128 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 129 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 130 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 131 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 132 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 133 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 134 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 135 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 136 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 137 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 138 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 139 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 140 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 141 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 142 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 143 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 144 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 145 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 146 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 147 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 148 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 149 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 150 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 151 Number of objects = 3 Vehicle Count = 3 Person Count = 0
Frame Number = 152 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 153 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 154 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 155 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 156 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 157 Number of objects = 4 Vehicle Count = 4 Person Count = 0
Frame Number = 158 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 159 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 160 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 161 Number of objects = 3 Vehicle Count = 3 Person Count = 0
Frame Number = 162 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 163 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 164 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 165 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 166 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 167 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 168 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 169 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 170 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 171 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 172 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 173 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 174 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 175 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 176 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 177 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 178 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 179 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 180 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 181 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 182 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 183 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 184 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 185 Number of objects = 3 Vehicle Count = 3 Person Count = 0
Frame Number = 186 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 187 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 188 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 189 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 190 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 191 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 192 Number of objects = 4 Vehicle Count = 4 Person Count = 0
Frame Number = 193 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 194 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 195 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 196 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 197 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 198 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 199 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 200 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 201 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 202 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 203 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 204 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 205 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 206 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 207 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 208 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 209 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 210 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 211 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 212 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 213 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 214 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 215 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 216 Number of objects = 3 Vehicle Count = 3 Person Count = 0
Frame Number = 217 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 218 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 219 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 220 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 221 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 222 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 223 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 224 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 225 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 226 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 227 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 228 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 229 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 230 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 231 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 232 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 233 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 234 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 235 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 236 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 237 Number of objects = 1 Vehicle Count = 1 Person Count = 0
Frame Number = 238 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 239 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 240 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 241 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 242 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 243 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 244 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 245 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 246 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 247 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 248 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 249 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 250 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 251 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 252 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 253 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 254 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 255 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 256 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 257 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 258 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 259 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 260 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 261 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 262 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 263 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 264 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 265 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 266 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 267 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 268 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 269 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 270 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 271 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 272 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 273 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 274 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 275 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 276 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 277 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 278 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 279 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 280 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 281 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 282 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 283 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 284 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 285 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 286 Number of objects = 0 Vehicle Count = 0 Person Count = 0
End of stream
Returned, stopping playback
Deleting pipeline
root@tegra-ubuntu:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test1# cd ../deepstream-test2/
root@tegra-ubuntu:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test2# ls
deepstream-test2-app    dstest2_config.yml       dstest2_pgie_nvinferserver_config.txt  dstest2_sgie1_nvinferserver_config.txt  dstest2_sgie2_nvinferserver_config.txt  README
deepstream_test2_app.c  dstest2_pgie_config.txt  dstest2_sgie1_config.txt               dstest2_sgie2_config.txt                dstest2_tracker_config.txt
deepstream_test2_app.o  dstest2_pgie_config.yml  dstest2_sgie1_config.yml               dstest2_sgie2_config.yml                Makefile
root@tegra-ubuntu:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test2# nano deepstream_test2_app.c
root@tegra-ubuntu:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test2# make
cc -c -o deepstream_test2_app.o -DPLATFORM_TEGRA -I../../../includes -I /usr/local/cuda-12.6/include -pthread -I/usr/include/gstreamer-1.0 -I/usr/include/aarch64-linux-gnu -I/usr/include/glib-2.0 -I/usr/lib/aarch64-linux-gnu/glib-2.0/include deepstream_test2_app.c
cc -o deepstream-test2-app deepstream_test2_app.o -lgstreamer-1.0 -lgobject-2.0 -lglib-2.0 -L/usr/local/cuda-12.6/lib64/ -lcudart -L/opt/nvidia/deepstream/deepstream-7.1/lib/ -lnvdsgst_meta -lnvds_meta -lnvds_yml_parser -Wl,-rpath,/opt/nvidia/deepstream/deepstream-7.1/lib/
root@tegra-ubuntu:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test2# ./deepstream-test2-app /app/resources/output.h264
With tracker
max_fps_dur 8.33333e+06 min_fps_dur 2e+08

(deepstream-test2-app:1389): GLib-GObject-CRITICAL **: 07:01:23.189: g_object_set_is_valid_property: object class ‘GstNvStreamMux’ has no property named ‘width’
Using file: /app/resources/output.h264
Opening in BLOCKING MODE
Setting min object dimensions as 16x16 instead of 1x1 to support VIC compute mode.
WARNING: Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-test2/../../../../samples/models/Secondary_VehicleTypes/resnet18_vehicletypenet_pruned.onnx_b16_gpu0_int8.engine open error
0:00:00.267836204  1389 0xaaaae3f3ed30 WARN                 nvinfer gstnvinfer.cpp:681:gst_nvinfer_logger: NvDsInferContext[UID 3]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2080> [UID = 3]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-test2/../../../../samples/models/Secondary_VehicleTypes/resnet18_vehicletypenet_pruned.onnx_b16_gpu0_int8.engine failed
0:00:00.267894157  1389 0xaaaae3f3ed30 WARN                 nvinfer gstnvinfer.cpp:681:gst_nvinfer_logger: NvDsInferContext[UID 3]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2185> [UID = 3]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-test2/../../../../samples/models/Secondary_VehicleTypes/resnet18_vehicletypenet_pruned.onnx_b16_gpu0_int8.engine failed, try rebuild
0:00:00.267911406  1389 0xaaaae3f3ed30 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger: NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2106> [UID = 3]: Trying to create engine from model files
WARNING: [TRT]: DLA requests all profiles have same min, max, and opt value. All dla layers are falling back to GPU
0:02:25.665041900  1389 0xaaaae3f3ed30 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger: NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2138> [UID = 3]: serialize cuda engine to file: /opt/nvidia/deepstream/deepstream-7.1/samples/models/Secondary_VehicleTypes/resnet18_vehicletypenet_pruned.onnx_b16_gpu0_int8.engine successfully
INFO: [FullDims Engine Info]: layers num: 2
0   INPUT  kFLOAT input_1:0       3x224x224       min: 1x3x224x224     opt: 16x3x224x224    Max: 16x3x224x224
1   OUTPUT kFLOAT predictions/Softmax:0 6               min: 0               opt: 0               Max: 0

0:02:26.017083536  1389 0xaaaae3f3ed30 INFO                 nvinfer gstnvinfer_impl.cpp:343:notifyLoadModelStatus: [UID 3]: Load new model:dstest2_sgie2_config.txt sucessfully
Setting min object dimensions as 16x16 instead of 1x1 to support VIC compute mode.
WARNING: Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-test2/../../../../samples/models/Secondary_VehicleMake/resnet18_vehiclemakenet_pruned.onnx_b16_gpu0_int8.engine open error
0:02:26.017382775  1389 0xaaaae3f3ed30 WARN                 nvinfer gstnvinfer.cpp:681:gst_nvinfer_logger: NvDsInferContext[UID 2]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2080> [UID = 2]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-test2/../../../../samples/models/Secondary_VehicleMake/resnet18_vehiclemakenet_pruned.onnx_b16_gpu0_int8.engine failed
0:02:26.017408407  1389 0xaaaae3f3ed30 WARN                 nvinfer gstnvinfer.cpp:681:gst_nvinfer_logger: NvDsInferContext[UID 2]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2185> [UID = 2]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-test2/../../../../samples/models/Secondary_VehicleMake/resnet18_vehiclemakenet_pruned.onnx_b16_gpu0_int8.engine failed, try rebuild
0:02:26.017428824  1389 0xaaaae3f3ed30 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger: NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2106> [UID = 2]: Trying to create engine from model files
WARNING: [TRT]: DLA requests all profiles have same min, max, and opt value. All dla layers are falling back to GPU
0:04:26.799255397  1389 0xaaaae3f3ed30 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger: NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2138> [UID = 2]: serialize cuda engine to file: /opt/nvidia/deepstream/deepstream-7.1/samples/models/Secondary_VehicleMake/resnet18_vehiclemakenet_pruned.onnx_b16_gpu0_int8.engine successfully
INFO: [FullDims Engine Info]: layers num: 2
0   INPUT  kFLOAT input_1:0       3x224x224       min: 1x3x224x224     opt: 16x3x224x224    Max: 16x3x224x224
1   OUTPUT kFLOAT predictions/Softmax:0 20              min: 0               opt: 0               Max: 0

0:04:27.151344036  1389 0xaaaae3f3ed30 INFO                 nvinfer gstnvinfer_impl.cpp:343:notifyLoadModelStatus: [UID 2]: Load new model:dstest2_sgie1_config.txt sucessfully
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
[NvMultiObjectTracker] Initialized
Setting min object dimensions as 16x16 instead of 1x1 to support VIC compute mode.
0:04:27.330082173  1389 0xaaaae3f3ed30 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2092> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-7.1/samples/models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b1_gpu0_int8.engine
Implicit layer support has been deprecated
INFO: [Implicit Engine Info]: layers num: 0

0:04:27.330168927  1389 0xaaaae3f3ed30 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2195> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-7.1/samples/models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b1_gpu0_int8.engine
0:04:27.335340045  1389 0xaaaae3f3ed30 INFO                 nvinfer gstnvinfer_impl.cpp:343:notifyLoadModelStatus: [UID 1]: Load new model:dstest2_pgie_config.txt sucessfully
Running…
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
max_fps_dur 8.33333e+06 min_fps_dur 2e+08
Frame Number = 0 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 1 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 2 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 3 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 4 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 5 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 6 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 7 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 8 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 9 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 10 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 11 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 12 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 13 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 14 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 15 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 16 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 17 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 18 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 19 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 20 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 21 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 22 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 23 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 24 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 25 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 26 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 27 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 28 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 29 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 30 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 31 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 32 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 33 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 34 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 35 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 36 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 37 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 38 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 39 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 40 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 41 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 42 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 43 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 44 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 45 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 46 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 47 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 48 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 49 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 50 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 51 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 52 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 53 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 54 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 55 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 56 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 57 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 58 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 59 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 60 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 61 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 62 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 63 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 64 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 65 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 66 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 67 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 68 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 69 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 70 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 71 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 72 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 73 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 74 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 75 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 76 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 77 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 78 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 79 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 80 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 81 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 82 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 83 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 84 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 85 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 86 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 87 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 88 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 89 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 90 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 91 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 92 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 93 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 94 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 95 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 96 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 97 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 98 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 99 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 100 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 101 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 102 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 103 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 104 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 105 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 106 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 107 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 108 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 109 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 110 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 111 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 112 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 113 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 114 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 115 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 116 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 117 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 118 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 119 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 120 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 121 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 122 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 123 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 124 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 125 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 126 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 127 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 128 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 129 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 130 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 131 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 132 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 133 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 134 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 135 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 136 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 137 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 138 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 139 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 140 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 141 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 142 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 143 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 144 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 145 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 146 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 147 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 148 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 149 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 150 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 151 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 152 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 153 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 154 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 155 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 156 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 157 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 158 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 159 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 160 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 161 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 162 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 163 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 164 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 165 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 166 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 167 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 168 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 169 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 170 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 171 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 172 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 173 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 174 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 175 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 176 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 177 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 178 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 179 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 180 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 181 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 182 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 183 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 184 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 185 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 186 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 187 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 188 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 189 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 190 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 191 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 192 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 193 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 194 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 195 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 196 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 197 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 198 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 199 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 200 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 201 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 202 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 203 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 204 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 205 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 206 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 207 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 208 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 209 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 210 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 211 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 212 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 213 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 214 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 215 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 216 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 217 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 218 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 219 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 220 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 221 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 222 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 223 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 224 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 225 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 226 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 227 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 228 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 229 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 230 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 231 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 232 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 233 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 234 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 235 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 236 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 237 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 238 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 239 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 240 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 241 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 242 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 243 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 244 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 245 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 246 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 247 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 248 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 249 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 250 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 251 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 252 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 253 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 254 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 255 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 256 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 257 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 258 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 259 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 260 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 261 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 262 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 263 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 264 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 265 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 266 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 267 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 268 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 269 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 270 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 271 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 272 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 273 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 274 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 275 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 276 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 277 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 278 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 279 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 280 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 281 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 282 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 283 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 284 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 285 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Frame Number = 286 Number of objects = 0 Vehicle Count = 0 Person Count = 0
End of stream
Returned, stopping playback
Deleting pipeline
5

Since the DeepStream samples work, tensorrt works.

From you log, seems it is a onnx model issue. Some layer may not be supported by TensorRT 10.3

6

Apparently this is a bug in TensorRT 10.3, updating to 10.5 fixed the issue as seen in other forum posts, would be nice to update deepstream 7.1 base tensorrt image to 10.5