Error running deepsteam-test4 with Kafka

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU): Jetson AGX Xavier
• DeepStream Version: 5.0
• JetPack Version (valid for Jetson only): 4.4
• TensorRT Version: 7.1.3
• Issue Type( questions, new requirements, bugs): bugs
• How to reproduce the issue ?

I followed the README instructions in /opt/nvidia/deepstream/deepstream/sources/libs/kafka_protocol_adaptor and installed all dependencies (librdkafka, glib 2.0, jansson), them simply use make command to build deepstream-test4-app.

  • command line:

./deepstream-test4-app -i ../../../../samples/streams/sample_720p.h264 -p /opt/nvidia/deepstream/deepstream/lib/libnvds_kafka_proto.so --conn-str="<IP address>;9092" --topic=quickstart-events --schema=0 --no-display --cfg-file=cfg_kafka.txt

Where <IP address> is the IP address of another computer running a Kafka server, created by follow the instructions from https://kafka.apache.org/quickstart

The topic is created with: bin/kafka-topics.sh --create --topic quickstart-events --bootstrap-server <IP address>:9092

  • cfg_kafka.txt:
[message-broker]
partition-key = sensor.id
#share-connection = 1
  • Errors:

%3|1607384478.520|FAIL|rdkafka#producer-1| [thrd:kt-ThinkStation-P510:9092/0]: kt-ThinkStation-P510:9092/0: Failed to resolve ‘kt-ThinkStation-P510:9092’: Name or service not known
%3|1607384478.520|ERROR|rdkafka#producer-1| [thrd:kt-ThinkStation-P510:9092/0]: kt-ThinkStation-P510:9092/0: Failed to resolve ‘kt-ThinkStation-P510:9092’: Name or service not known

I simply want to send messages to another computer that run a Kafka server then view them in the terminal. Please advice on how to fix the above error.

For Amqp - Connection string of format: host;port;username;password

Hi @amycao,

My question is about kafka, not Amqp. Do you mind elaborate on why you suggested Amqp instead?

Oh, sorry, see wrong.
from the log, you used server name to connect, correct?
Failed to resolve ‘kt-ThinkStation-P510:9092’: Name or service not known
Can you use IP address to try again?

Hi @amycao,

Thank you for clarification, I actually used IP address and kafka translates it to the corresponding hostname. I fixed the issue, I need to modify kafka’s server.properties file on the server PC & /etc/hosts on the Jetson.