General questions about Deepstream

[agustinperezcastro]

We are evaluating Deepstream to see if it could fit with our use cases and we are having a number of questions that we can’t answer with the documentation.

1. Is it possible to create a flow with only a classification model using the Python Bindings? Is it necessary to modify the code and recompile Deepstream and modify the Python Bindings for this? If possible, what is the best way, using nvinfer or nvinferserver?

2. In the nvinferserver documentation it is stated that only multi-class classification, detection and segmentation models can be used, is this correct, is this a limitation of nvinferserver or is it a limitation of Triton?

3. Is it possible to use a custom model with the Python Bindings such as keypoints, line detection or depth estimation? Is there any documentation or can you give me some guidance on what steps to follow?

4. Is it possible to incorporate post-processing logics on the predictions using the Python Bindings such as, for example, using the positions of the different detections of a vehicle to calculate its velocity or to make a projection of its position?

5. Is it in the deepstream or TAO toolkit roadmap to incorporate new models such as, for example, depth detection? Is there a public roadmap to consult?

I would appreciate any full or partial answer.
Thanks!!

[Fiona.Chen]

@agustinperezcastro

Is it possible to create a flow with only a classification model using the Python Bindings? Is it necessary to modify the code and recompile Deepstream and modify the Python Bindings for this? If possible, what is the best way, using nvinfer or nvinferserver?

It is possible. No need to change anything

@agustinperezcastro

In the nvinferserver documentation it is stated that only multi-class classification, detection and segmentation models can be used, is this correct, is this a limitation of nvinferserver or is it a limitation of Triton?

The other models can be used if the model has only one input layer. You may need to customize the postprocessing.

@agustinperezcastro

Is it possible to use a custom model with the Python Bindings such as keypoints, line detection or depth estimation? Is there any documentation or can you give me some guidance on what steps to follow?

The other models can be used if the model has only one input layer. You may need to customize the postprocessing.

@agustinperezcastro

Is it possible to incorporate post-processing logics on the predictions using the Python Bindings such as, for example, using the positions of the different detections of a vehicle to calculate its velocity or to make a projection of its position?

You need to implement by yourself

@agustinperezcastro

Is it in the deepstream or TAO toolkit roadmap to incorporate new models such as, for example, depth detection? Is there a public roadmap to consult?

For TAO models roadmap, please ask in the TAO forum.

[yingliu]

There is no update from you for a period, assuming this is not an issue anymore.
Hence we are closing this topic. If need further support, please open a new one.
Thanks