Started stand alone triton docker container on T4 GPU (x86),
→ Triton server has following models:
a. YOLOX model (onnx-backend)
b. Post processing (python-backend)
c. ensemble_yolox_postprocessing
Started stand alone deepstream-triton docker container on T4 GPU (x86),
created pipeline which uses nvinferserver running
"ensemble_yolox_postprocessing " in it.
I have attached the probe to extract output tensor from the ensemble
model but it turns out the first two number in the extracted array are
corrupted.
To further conclude the issue I have returned hard coded array [[1,2,3,4,5,6,7]] from model.py python-backend. I am getting [[0,0,3,4,5,6,7]] inside the deepstream probe function.
Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU) • DeepStream Version • JetPack Version (valid for Jetson only) • TensorRT Version • NVIDIA GPU Driver Version (valid for GPU only) • Issue Type( questions, new requirements, bugs) • How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing) • Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
Hi,
We are trying to build an application with the deepstream 6.0.1 and triton 22.02-py3 and have the same issue with the ensemble model, which consists of yolo preprocessing python model, yolov5 onnx model and yolo post processing python model. We’ve tried to hardcode an outputs in the same way and got the same results in the deepstream.
Don’t really know for now how to fix this and ready to share with you all the configs and models, if needed.
There is no update from you for a period, assuming this is not an issue anymore.
Hence we are closing this topic. If need further support, please open a new one.
Thanks