ERROR: [TRT]: 1: [caskUtils.cpp::trtSmToCask::147] Error Code 1: Internal Error (Unsupported SM: 0x809)

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) GPU
• DeepStream Version 6.1
• JetPack Version (valid for Jetson only)
• TensorRT Version 8.2 .5
• NVIDIA GPU Driver Version (valid for GPU only) RTX 3080
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

±----------------------------------------------------------------------------+
| NVIDIA-SMI 525.89.02 Driver Version: 525.89.02 CUDA Version: 12.0 |
|-------------------------------±---------------------±---------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 NVIDIA GeForce … Off | 00000000:01:00.0 Off | N/A |
| N/A 49C P8 3W / 150W | 498MiB / 12282MiB | 0% Default |
| | | N/A |
±------------------------------±---------------------±---------------------+

±----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| 0 N/A N/A 557127 C tritonserver 248MiB |
| 0 N/A N/A 620766 C tritonserver 248MiB |
±----------------------------------------------------------------------------+

i get the below error on running one of the usecase

Starting pipeline

gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
gstnvtracker: Batch processing is ON
gstnvtracker: Past frame output is OFF
[NvMultiObjectTracker] Loading TRT Engine for tracker ReID…
ERROR: [TRT]: 6: The engine plan file is generated on an incompatible device, expecting compute 8.9 got compute 7.5, please rebuild.
ERROR: [TRT]: 4: [runtime.cpp::deserializeCudaEngine::50] Error Code 4: Internal Error (Engine deserialization failed.)
~~ CLOG[src/modules/ReID/ReID.cpp, loadTRTEngine() @line 445]: Engine build failed
[NvMultiObjectTracker] Load engine failed. Create engine again.
[NvMultiObjectTracker] Begin building engine for tracker ReID…
ERROR: [TRT]: 1: [caskUtils.cpp::trtSmToCask::147] Error Code 1: Internal Error (Unsupported SM: 0x809)

2

Can you provide reproducing steps/code? Can the deepstream-app and samples in /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps run correctly on your PC?

4

im running default Vehicle Use-Case , and i get above error while creating model i believe

Below is the Pgie ,config file

[property]
gpu-id=0
net-scale-factor=0.0039215697906911373
model-file= …/…/model/Primary_Detector/resnet10.caffemodel
proto-file=…/…/model/Primary_Detector/resnet10.prototxt
#model-engine-file=…/…/model/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
labelfile-path=…/…/model/Primary_Detector/labels.txt
int8-calib-file=…/…/model/Primary_Detector/cal_trt.bin
force-implicit-batch-dim=1
batch-size=1
process-mode=1
model-color-format=0
network-mode=1
num-detected-classes=4
interval=0
gie-unique-id=1
output-blob-names=conv2d_bbox;conv2d_cov/Sigmoid

[class-attrs-0]
pre-cluster-threshold=0.2
eps=0.2
group-threshold=1

[class-attrs-1]
pre-cluster-threshold=0.2
eps=0.2
group-threshold=1

[class-attrs-2]
threshold = 1
pre-cluster-threshold=1
eps=0.2
group-threshold=1

[class-attrs-3]
threshold = 1
pre-cluster-threshold=1
eps=0.2
group-threshold=1

7

Seems you created the engine file in one setup while running it in another setup, which has different GPU compute compatibility level.

8

yes , thats true . But deepstream 6.1 auto generates new models right while running the App

9

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

from the logs, the app failed when creating engine for tracker. here are some questions:

  1. are you testing in docker?
  2. which sample are you testing? are you using config_tracker_DeepSORT.yml?
  3. please share the result of “ll /opt/nvidia/deepstream/deepstream/samples/models/Tracker”
11

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.