Break in MQTT connection silently crashes Deepstream pipeline

• Hardware Platform (Jetson / GPU): Jetson
• DeepStream Version: 7.1
• JetPack Version (valid for Jetson only) 6.1
• TensorRT Version 10.3.0
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs) Bug
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

Here are some details about my setup:

  • The Deepstream pipeline is running on a NVIDIA Jetson Orin NX (16GB) device inside the nvcr.io/nvidia/deepstream-l4t:7.1-triton-multiarch Docker container.

  • I’ve configured the nvmsgbroker to send messages out of the Deepstream container using the Python plugins

msgbroker = Gst.ElementFactory.make("nvmsgbroker", "nvmsg-broker")
msgbroker.set_property('sync', 0)
msgbroker.set_property('new-api', 1)
  • The Mosquitto service is managed outside this Docker environment

• Bug Description

These are what my logs look like:

  • Normal Operation:
lvt-deepstream  | 2025-02-05T15:53:44.841202+0000 : INFO : Stream #=stream1, Frame #=473, ts=1738770824478001000, pts=48.611070048, Person #=0, Vehicle #=1
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data
lvt-deepstream  | 2025-02-05T15:53:44.844301+0000 : INFO : Stream #=stream2, Frame #=472, ts=1738770824478311000, pts=48.608900472, Person #=0, Vehicle #=5
lvt-deepstream  | 2025-02-05T15:53:44.845670+0000 : INFO : Stream #=stream0, Frame #=446, ts=1738770824478774000, pts=48.69980177, Person #=0, Vehicle #=0
lvt-deepstream  | Error disconnecting: (The client is not currently connected.).
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data
lvt-deepstream  | Encode Latency = 43.239990 
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending PUBLISH (d0, q0, r0, m1, '/tracks', ... (3101 bytes))
lvt-deepstream  | Publish callback with reason code: Success.
lvt-deepstream  | 2025-02-05T15:53:44.946311+0000 : INFO : Stream #=stream2, Frame #=473, ts=1738770824589330000, pts=48.708684788, Person #=0, Vehicle #=5
lvt-deepstream  | Encode Latency = 41.376953 
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending PUBLISH (d0, q0, r0, m2, '/tracks', ... (3101 bytes))
lvt-deepstream  | Publish callback with reason code: Success.
lvt-deepstream  | 2025-02-05T15:53:45.048182+0000 : INFO : Stream #=stream1, Frame #=475, ts=1738770824666035000, pts=48.810935175, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-05T15:53:45.051957+0000 : INFO : Stream #=stream2, Frame #=474, ts=1738770824666196000, pts=48.808284209, Person #=0, Vehicle #=5
lvt-deepstream  | 2025-02-05T15:53:45.053890+0000 : INFO : Stream #=stream0, Frame #=448, ts=1738770824666447000, pts=48.899472051, Person #=0, Vehicle #=0
lvt-deepstream  | Encode Latency = 43.037842 
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending PUBLISH (d0, q0, r0, m3, '/tracks', ... (2659 bytes))
lvt-deepstream  | Publish callback with reason code: Success.
lvt-deepstream  | 
lvt-deepstream  | **PERF:  {'stream0': 8.6, 'stream1': 9.39, 'stream2': 9.59} 
  • On Mosquitto service restart
lvt-deepstream  | 2025-02-05T15:53:46.869535+0000 : INFO : Stream #=stream1, Frame #=494, ts=1738770826556691000, pts=50.710565027, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-05T15:53:46.874242+0000 : INFO : Stream #=stream2, Frame #=493, ts=1738770826556833000, pts=50.772934986, Person #=0, Vehicle #=5
lvt-deepstream  | 2025-02-05T15:53:46.875840+0000 : INFO : Stream #=stream0, Frame #=467, ts=1738770826556947000, pts=50.798956361, Person #=0, Vehicle #=0
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data
lvt-deepstream  | Error disconnecting: (The client is not currently connected.).
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data
lvt-deepstream  | Encode Latency = 48.074951 
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending PUBLISH (d0, q0, r0, m1, '/tracks', ... (2660 bytes))
lvt-deepstream  | Publish callback with reason code: Success.
lvt-deepstream  | 2025-02-05T15:53:46.981949+0000 : INFO : Stream #=stream1, Frame #=495, ts=1738770826611877000, pts=50.810994635, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-05T15:53:46.986502+0000 : INFO : Stream #=stream2, Frame #=494, ts=1738770826612008000, pts=50.854150408, Person #=0, Vehicle #=5
lvt-deepstream  | Encode Latency = 38.187988 
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending PUBLISH (d0, q0, r0, m2, '/tracks', ... (2658 bytes))
lvt-deepstream  | Publish callback with reason code: Success.
  • When Deepstream finally silently crashes
lvt-deepstream  | 2025-02-05T15:54:17.279242+0000 : INFO : Stream #=stream1, Frame #=797, ts=1738770856865785000, pts=81.011141431, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-05T15:54:17.283939+0000 : INFO : Stream #=stream2, Frame #=796, ts=1738770856865882000, pts=81.007415151, Person #=0, Vehicle #=5
lvt-deepstream  | 2025-02-05T15:54:17.285902+0000 : INFO : Stream #=stream0, Frame #=770, ts=1738770856865956000, pts=81.098151222, Person #=0, Vehicle #=0
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data
lvt-deepstream  | Encode Latency = 55.544922 
lvt-deepstream  | Error sending repeat publish: The client is not currently connected.2025-02-05T15:54:17.366136+0000 : INFO : Stream #=stream1, Frame #=798, ts=1738770856955782000, pts=81.111038711, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-05T15:54:17.369212+0000 : INFO : Stream #=stream2, Frame #=797, ts=1738770856955914000, pts=81.107422948, Person #=0, Vehicle #=5
lvt-deepstream  | 2025-02-05T15:54:17.370572+0000 : INFO : Stream #=stream0, Frame #=771, ts=1738770856983033000, pts=81.198376394, Person #=0, Vehicle #=0
lvt-deepstream  | Encode Latency = 30.634033 
lvt-deepstream  | 2025-02-05T15:54:17.460197+0000 : INFO : Stream #=stream1, Frame #=799, ts=1738770857065805000, pts=81.210818836, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-05T15:54:17.464705+0000 : INFO : Stream #=stream2, Frame #=798, ts=1738770857065930000, pts=81.207740903, Person #=0, Vehicle #=5
lvt-deepstream  | 2025-02-05T15:54:17.466634+0000 : INFO : Stream #=stream0, Frame #=772, ts=1738770857066037000, pts=81.299408801, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-05T15:54:17.503547+0000 : INFO : Stream #=stream1, Frame #=800, ts=1738770857172569000, pts=81.310401128, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-05T15:54:17.506592+0000 : INFO : Stream #=stream2, Frame #=799, ts=1738770857172704000, pts=81.307897252, Person #=0, Vehicle #=4
lvt-deepstream  | Encode Latency = 7.348145 
lvt-deepstream  | Encode Latency = 20.053955 
lvt-deepstream  | 2025-02-05T15:54:17.586879+0000 : INFO : Stream #=stream1, Frame #=802, ts=1738770857356802000, pts=81.510347212, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-05T15:54:17.589685+0000 : INFO : Stream #=stream2, Frame #=801, ts=1738770857357033000, pts=81.50757504, Person #=0, Vehicle #=4
lvt-deepstream  | 2025-02-05T15:54:17.591177+0000 : INFO : Stream #=stream0, Frame #=775, ts=1738770857357384000, pts=81.598646284, Person #=0, Vehicle #=0
lvt-deepstream  | Encode Latency = 36.311035 
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client 123 received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data

As you can see from the log messages (and timestamps) above the Deepstream pipeline crashes about 30 seconds after the Mosquitto service restarts/stops.

I need your support to make the nvmsgbroker element robust to these breaks in connection.
I further examined the code in /opt/nvidia/deepstream/deepstream/sources/gst-plugins/gst-nvmsgbroker and found that there is no mechanism for reconnecting back to the Mosquitto service.
Here I’m specifically referring to the empty nvds_msgapi_connect_callback method in /opt/nvidia/deepstream/deepstream/sources/gst-plugins/gst-nvmsgbroker/gstnvmsgbroker.cpp

static void
nvds_msgapi_connect_callback (NvDsMsgApiHandle h_ptr,
    NvDsMsgApiEventType ds_evt)
{

}
1 Like
  1. which MQTT version are you using? How did you restart MQTT server? which sample are you referring to?
 lvt-deepstream  | Error disconnecting: (The client is not currently connected.).
 lvt-deepstream  | mqtt connection success; ready to send data
  1. from your log, the client reconnected successfully, but it did not send data again after 2025-02-05T15:53:46.
  2. Using mosquitto-2.0.15, I tested with deepstream-test5, after restarting(ctrl+c, then mosquitto -v), the test5 did not crash or exit. it just did not send data. could you confirm if the client crashed? From server side, the server printed “Client uniqueID already connected, closing old connection.” repeatedly .
  1. which MQTT version are you using?
    2.0.20
  2. How did you restart MQTT server?
systemctl restart mosquitto
  1. which sample are you referring to?
    I’m using a custom pipeline that looks like this

  2. from your log, the client reconnected successfully, but it did not send data again after 2025-02-05T15:53:46.5.
    I’ve added more context in 5. See more logs below

  3. Using mosquitto-2.0.15, I tested with deepstream-test5, after restarting(ctrl+c, then mosquitto -v), the test5 did not crash or exit. it just did not send data. could you confirm if the client crashed? From server side, the server printed “Client uniqueID already connected, closing old connection.” repeatedly .

    Here are some more logs that can help describe the issue better. I’ve also added logs from Mosquitto service

  • Normal Operation (Mosquitto service logs):
1738876481: New connection from 127.0.0.1:37072 on port 1883.
1738876481: New client connected from 127.0.0.1:37072 as lvt-deepstream (p2, c1, k30, u'user').
1738876491: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876491: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876491: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876491: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
  • Normal Operation (Deepstream logs):
lvt-deepstream  | Publish callback with reason code: Success.
lvt-deepstream  | 2025-02-06T21:14:53.177834+0000 : INFO : Stream #=stream0, Frame #=26, ts=1738876492414032000, pts=10.444551286, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-06T21:14:53.184640+0000 : INFO : Stream #=stream1, Frame #=39, ts=1738876492414167000, pts=10.468506702, Person #=0, Vehicle #=16
lvt-deepstream  | 2025-02-06T21:14:53.198701+0000 : INFO : Stream #=stream2, Frame #=39, ts=1738876492414288000, pts=10.470963331, Person #=0, Vehicle #=56
lvt-deepstream  | Encode Latency = 29.016113 
lvt-deepstream  | [mosq_mqtt_log_callback] Client lvt-deepstream sending PUBLISH (d0, q0, r0, m4, '/tracks', ... (31485 bytes))
  • On Mosquitto service restart (Mosquitto service logs):
1738876510: mosquitto version 2.0.20 terminating
1738876510: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876510: mosquitto version 2.0.20 starting
1738876510: Config loaded from /etc/mosquitto/mosquitto.conf.
1738876510: Opening ipv4 listen socket on port 1883.
1738876510: Connecting bridge (step 1) bridge (emqx.int.lvt.services:8883)
1738876510: mosquitto version 2.0.20 running
1738876510: New connection from 10.0.1.115:59073 on port 1883.
1738876510: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876510: New client connected from 10.0.1.115:59073 as edge-io-head (p2, c0, k10).
1738876510: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876510: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876510: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876510: Connecting bridge (step 2) bridge (emqx.int.lvt.services:8883)
1738876511: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876511: New connection from 127.0.0.1:57329 on port 1883.
1738876511: New connection from 127.0.0.1:43587 on port 1883.
1738876511: New client connected from 127.0.0.1:43587 as auto-************** (p2, c1, k60).
1738876511: New client connected from 127.0.0.1:57329 as auto-************** (p2, c1, k60).
1738876511: New connection from 127.0.0.1:47623 on port 1883.
1738876511: New client connected from 127.0.0.1:47623 as auto-************** (p2, c1, k60).
1738876511: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
1738876511: New connection from 127.0.0.1:44328 on port 1883.
1738876511: New client connected from 127.0.0.1:44328 as lvt-deepstream (p2, c1, k30, u'user').
1738876511: New connection from 127.0.0.1:44338 on port 1883.
1738876511: Client lvt-deepstream already connected, closing old connection.
1738876511: New client connected from 127.0.0.1:44338 as lvt-deepstream (p2, c1, k30, u'user').
1738876511: New connection from 127.0.0.1:44340 on port 1883.
1738876511: Client lvt-deepstream already connected, closing old connection.
1738876511: New client connected from 127.0.0.1:44340 as lvt-deepstream (p2, c1, k30, u'user').
1738876511: Saving in-memory database to /var/lvt/mosquittodb/mosquitto.db.
  • On Mosquitto service restart (Deepstream logs):
lvt-deepstream  | Publish callback with reason code: Success.
lvt-deepstream  | 2025-02-06T21:15:10.483185+0000 : INFO : Stream #=stream1, Frame #=265, ts=1738876510053971000, pts=27.804198608, Person #=0, Vehicle #=18
lvt-deepstream  | 2025-02-06T21:15:10.496564+0000 : INFO : Stream #=stream2, Frame #=266, ts=1738876510054097000, pts=27.895997827, Person #=0, Vehicle #=59
lvt-deepstream  | 2025-02-06T21:15:10.498111+0000 : INFO : Stream #=stream0, Frame #=238, ts=1738876510054204000, pts=27.807531287, Person #=0, Vehicle #=0
lvt-deepstream  | Encode Latency = 23.958008 
lvt-deepstream  | [mosq_mqtt_log_callback] Client lvt-deepstream sending PUBLISH (d0, q0, r0, m152, '/tracks', ... (34523 bytes))
lvt-deepstream  | Publish callback with reason code: Success.
lvt-deepstream  | 2025-02-06T21:15:10.551940+0000 : INFO : Stream #=stream1, Frame #=266, ts=1738876510161331000, pts=27.904437227, Person #=0, Vehicle #=18
lvt-deepstream  | 2025-02-06T21:15:10.553376+0000 : INFO : Stream #=stream0, Frame #=239, ts=1738876510161456000, pts=27.906417348, Person #=0, Vehicle #=0
lvt-deepstream  | Error disconnecting: (The client is not currently connected.).
lvt-deepstream  | error=14
lvt-deepstream  | Error: Connection refused

When Deepstream finally silently crashes (Mosquitto service logs):

1738876560: New connection from 127.0.0.1:52022 on port 1883.
1738876560: Client lvt-deepstream already connected, closing old connection.
1738876560: New client connected from 127.0.0.1:52022 as lvt-deepstream (p2, c1, k30, u'user').
1738876560: Client lvt-deepstream closed its connection.
  • When Deepstream finally silently crashes (Deepstream logs):
lvt-deepstream  | [mosq_mqtt_log_callback] Client lvt-deepstream sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client lvt-deepstream received CONNACK (0)
lvt-deepstream  | Error sending repeat publish: The client is not currently connected.mqtt connection success; ready to send data
lvt-deepstream  | 2025-02-06T21:15:39.007914+0000 : INFO : Stream #=stream1, Frame #=550, ts=1738876538463358000, pts=56.30392147, Person #=0, Vehicle #=18
lvt-deepstream  | 2025-02-06T21:15:39.022350+0000 : INFO : Stream #=stream2, Frame #=550, ts=1738876538463485000, pts=56.305824103, Person #=0, Vehicle #=56
lvt-deepstream  | 2025-02-06T21:15:39.023974+0000 : INFO : Stream #=stream0, Frame #=523, ts=1738876538463602000, pts=56.306545018, Person #=0, Vehicle #=0
lvt-deepstream  | Encode Latency = 18.802979 
lvt-deepstream  | 2025-02-06T21:15:39.114717+0000 : INFO : Stream #=stream1, Frame #=551, ts=1738876538674931000, pts=56.403720182, Person #=0, Vehicle #=18
lvt-deepstream  | 2025-02-06T21:15:39.134800+0000 : INFO : Stream #=stream2, Frame #=551, ts=1738876538675056000, pts=56.403398129, Person #=0, Vehicle #=57
lvt-deepstream  | 2025-02-06T21:15:39.136402+0000 : INFO : Stream #=stream0, Frame #=524, ts=1738876538675162000, pts=56.406339525, Person #=0, Vehicle #=0
lvt-deepstream  | Encode Latency = 23.907959 
lvt-deepstream  | 2025-02-06T21:15:39.306734+0000 : INFO : Stream #=stream1, Frame #=553, ts=1738876538851514000, pts=56.603581748, Person #=0, Vehicle #=18
lvt-deepstream  | 2025-02-06T21:15:39.329542+0000 : INFO : Stream #=stream2, Frame #=554, ts=1738876538851809000, pts=56.694899994, Person #=0, Vehicle #=57
lvt-deepstream  | Encode Latency = 32.317871 
lvt-deepstream  | 2025-02-06T21:15:39.332453+0000 : INFO : Stream #=stream0, Frame #=526, ts=1738876538852009000, pts=56.606495746, Person #=0, Vehicle #=0
lvt-deepstream  | 2025-02-06T21:15:39.421163+0000 : INFO : Stream #=stream1, Frame #=554, ts=1738876538941376000, pts=56.703490181, Person #=0, Vehicle #=18
lvt-deepstream  | 2025-02-06T21:15:39.435942+0000 : INFO : Stream #=stream2, Frame #=555, ts=1738876538941510000, pts=56.795667611, Person #=0, Vehicle #=56
lvt-deepstream  | 2025-02-06T21:15:39.437553+0000 : INFO : Stream #=stream0, Frame #=527, ts=1738876538941634000, pts=56.706390647, Person #=0, Vehicle #=0
lvt-deepstream  | Encode Latency = 24.062988 
lvt-deepstream  | [mosq_mqtt_log_callback] Client lvt-deepstream sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client lvt-deepstream received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data
lvt-deepstream  | [mosq_mqtt_log_callback] Client lvt-deepstream sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client lvt-deepstream received CONNACK (0)

Here is a workaround.
from the server log, the server will disconnect if reconencting with the same client-id.
if config is set for nvmsgbroker, please comment out “client-id =…” in “config” file.

That worked. Thanks!
Are there any plans to fix this in the future?

Thanks for the update! We will discuss it internally then get back to you.

@fanzh Your suggestion fixed a part of the issue but I’m still seeing the same error being thrown when the MQTT Broker restarts. The error being Error sending repeat publish: The client is not currently connected. from /opt/nvidia/deepstream/deepstream-7.1/sources/libs/mqtt_protocol_adaptor/nvds_mqtt_proto.cpp file.

Do you have a fix that is more robust to these connection breaks?

MQTT Broker logs:

Feb 14 01:42:37 eac6000 systemd[1]: Stopping Mosquitto MQTT Broker...
Feb 14 01:42:37 eac6000 systemd[1]: mosquitto.service: Deactivated successfully.
Feb 14 01:42:37 eac6000 systemd[1]: Stopped Mosquitto MQTT Broker.
Feb 14 01:42:37 eac6000 systemd[1]: mosquitto.service: Consumed 3.504s CPU time.
Feb 14 01:42:37 eac6000 systemd[1]: Starting Mosquitto MQTT Broker...
Feb 14 01:42:37 eac6000 mosquitto[1689914]: 1739497357: Loading config file /etc/mosquitto/conf.d/00_general.conf
Feb 14 01:42:37 eac6000 mosquitto[1689914]: 1739497357: Loading config file /etc/mosquitto/conf.d/01_listeners.conf
Feb 14 01:42:37 eac6000 mosquitto[1689914]: 1739497357: Loading config file /etc/mosquitto/conf.d/02_bridge.conf
Feb 14 01:42:37 eac6000 systemd[1]: Started Mosquitto MQTT Broker.

Deepstream logs:

lvt-deepstream  | [mosq_mqtt_log_callback] Client null sending PUBLISH (d0, q0, r0, m12116, '/tracks', ... (8357 bytes))
lvt-deepstream  | Publish callback with reason code: Success.
lvt-deepstream  | 2025-02-14T01:40:32.314278+0000 : INFO : Stream #=stream0, Frame #=31450, ts=1739497231968129000, pts=2096.800017716, Person #=0, Vehicle #=1
lvt-deepstream  | 2025-02-14T01:40:32.316036+0000 : INFO : Stream #=stream1, Frame #=31439, ts=1739497231968191000, pts=2096.788769491, Person #=0, Vehicle #=5
lvt-deepstream  | 2025-02-14T01:40:32.317910+0000 : INFO : Stream #=stream2, Frame #=31450, ts=1739497231968209000, pts=2096.809843747, Person #=0, Vehicle #=9
lvt-deepstream  | Error sending repeat publish: The client is not currently connected.Encode Latency = 40.012207 
lvt-deepstream  | 2025-02-14T01:40:32.362149+0000 : INFO : Stream #=stream0, Frame #=31451, ts=1739497232034773000, pts=2096.865861913, Person #=0, Vehicle #=2
lvt-deepstream  | 2025-02-14T01:40:32.364203+0000 : INFO : Stream #=stream1, Frame #=31440, ts=1739497232034798000, pts=2096.85286859, Person #=0, Vehicle #=3
lvt-deepstream  | 2025-02-14T01:40:32.365786+0000 : INFO : Stream #=stream2, Frame #=31451, ts=1739497232034810000, pts=2096.876270688, Person #=0, Vehicle #=9
lvt-deepstream  | Encode Latency = 26.004883 
lvt-deepstream  | 2025-02-14T01:40:32.453104+0000 : INFO : Stream #=stream0, Frame #=31452, ts=1739497232101478000, pts=2096.932765404, Person #=0, Vehicle #=1
lvt-deepstream  | 2025-02-14T01:40:32.455249+0000 : INFO : Stream #=stream1, Frame #=31441, ts=1739497232101507000, pts=2096.916835291, Person #=0, Vehicle #=4
lvt-deepstream  | 2025-02-14T01:40:32.457981+0000 : INFO : Stream #=stream2, Frame #=31452, ts=1739497232101520000, pts=2096.942703242, Person #=0, Vehicle #=9
lvt-deepstream  | Encode Latency = 34.020020 
lvt-deepstream  | 2025-02-14T01:40:32.564439+0000 : INFO : Stream #=stream1, Frame #=31443, ts=1739497232210289000, pts=2097.044438549, Person #=1, Vehicle #=5
lvt-deepstream  | Encode Latency = 27.320068 
lvt-deepstream  | 2025-02-14T01:40:32.606306+0000 : INFO : Stream #=stream0, Frame #=31455, ts=1739497232301530000, pts=2097.132737892, Person #=0, Vehicle #=1
lvt-deepstream  | 2025-02-14T01:40:32.609260+0000 : INFO : Stream #=stream1, Frame #=31445, ts=1739497232301576000, pts=2097.172616472, Person #=0, Vehicle #=6
lvt-deepstream  | 2025-02-14T01:40:32.612303+0000 : INFO : Stream #=stream2, Frame #=31455, ts=1739497232301613000, pts=2097.142996348, Person #=0, Vehicle #=9
lvt-deepstream  | Encode Latency = 19.540039 
lvt-deepstream  | [mosq_mqtt_log_callback] Client null sending CONNECT
lvt-deepstream  | [mosq_mqtt_log_callback] Client null received CONNACK (0)
lvt-deepstream  | mqtt connection success; ready to send data
lvt-deepstream  | [mosq_mqtt_log_callback] Client null sending PINGREQ
lvt-deepstream  | [mosq_mqtt_log_callback] Client null sending PINGREQ
lvt-deepstream  | [mosq_mqtt_log_callback] Client null sending PINGREQ
lvt-deepstream  | [mosq_mqtt_log_callback] Client null received PINGRESP
lvt-deepstream  | [mosq_mqtt_log_callback] Client null received PINGRESP
lvt-deepstream  | [mosq_mqtt_log_callback] Client null received PINGRESP
lvt-deepstream  | [mosq_mqtt_log_callback] Client null sending PINGREQ
lvt-deepstream  | [mosq_mqtt_log_callback] Client null received PINGRESP
1 Like

From the logs, the cleint succeeded to reconnect after restarting the MQTT server, but no data was sent. we are investigating.