Kafka Performance issues in DeepStream python

Please provide complete information as applicable to your setup.

• Hardware Platform (GPU)
• DeepStream Version 7.0
• TensorRT Version 8.6.1
• NVIDIA GPU Driver Version (535)
Can the use of confluent_kafka for to produce messages to kafka cluster in a deepstream pipeline instead of using nvmsgbroker cause performance overhead or data loss?
Or
Does making synchronous http API calls in the deepstream pipeline cause performance overhead or data loss?

  1. please refer to the doc. Deepstream uses librdkafka for the protocol implementation. using custom protocol implementation will not cause data loss. you can compare the performance ourself.
  2. if sending message consumes too much and block the pipeline, it will cause performance issue. nvmsgbroker plugin is opensource. it uses async mode to send messages.

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.