However when trying to integrate the .etlt model to deepstream application code, i get the following error:
ERROR: …/nvdsinfer/nvdsinfer_func_utils.cpp:33 [TRT]: UffParser: Validator error: FirstDimTile_4: Unsupported operation _BatchTilePlugin_TRT
parseModel: Failed to parse UFF model
ERROR: tlt/tlt_decode.cpp:274 failed to build network since parsing model errors.
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:797 Failed to create network using custom network creation function
ERROR: …/nvdsinfer/nvdsinfer_model_builder.cpp:862 Failed to get cuda engine from custom library API
0:00:14.934727996 1427 0x335ce10 ERROR nvinfer gstnvinfer.cpp:613:gst_nvinfer_logger: NvDsInferContext[UID 1]:
I also noticed one more thing, the _BatchTilePlugin_TRT operation that is causing the error, itself was introduced in the TensoRT 7.1 release…(as seen from the github page)
My TLT container is using TensorRT 7.0.0-1 then how does the fine-tuned .etlt model file contains this operation ?
To solve my problem, tried to update the TRT version in my Deepstream5.0 container to TRT 7.1.3.4-ga, however that too failed with the folowing error:
The following packages have unmet dependencies:
tensorrt : Depends: libnvinfer7 (= 7.1.3-1+cuda10.2) but 7.0.0-1+cuda10.2 is to be installed
Depends: libnvinfer-plugin7 (= 7.1.3-1+cuda10.2) but 7.0.0-1+cuda10.2 is to be installed
Depends: libnvparsers7 (= 7.1.3-1+cuda10.2) but 7.0.0-1+cuda10.2 is to be installed
Depends: libnvonnxparsers7 (= 7.1.3-1+cuda10.2) but 7.0.0-1+cuda10.2 is to be installed
Depends: libnvinfer-bin (= 7.1.3-1+cuda10.2) but 7.0.0-1+cuda10.2 is to be installed
Depends: libnvinfer-dev (= 7.1.3-1+cuda10.2) but 7.0.0-1+cuda10.2 is to be installed
Depends: libnvinfer-plugin-dev (= 7.1.3-1+cuda10.2) but 7.0.0-1+cuda10.2 is to be installed
Depends: libnvparsers-dev (= 7.1.3-1+cuda10.2) but 7.0.0-1+cuda10.2 is to be installed
Depends: libnvonnxparsers-dev (= 7.1.3-1+cuda10.2) but 7.0.0-1+cuda10.2 is to be installed
Depends: libnvinfer-samples (= 7.1.3-1+cuda10.2) but it is not going to be installed
Depends: libnvinfer-doc (= 7.1.3-1+cuda10.2) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.
To solve the above problem i am following the steps here:
But unfortunately i have reached a complete dead end as there is no cuda10.2 for my Nvidia driver version 450.51.05.