Unable to get nvsipl_multicast to function in basic c2c scenario

Autonomous Vehicles DRIVE AGX Thor DRIVE AGX Thor General
,
1

DRIVE OS Version: 7.0.3

Issue Description: nvsipl_multicast does not transfer frames successfully over PCIe / CSC mode

I have setup two Drive AGX Thor units such that one enables PCIe Root on C5 and the other enables PCIe Endpoint on C5.

The two units are connected with the appropriate PCIe cable for C2C operation. The drivers to support C2C are loaded at boot time. The hotplug operation is executed correctly. The /dev/nvscic2c_pcie_s{0|1}c4_{1-11} devices are present on both node.

The basic C2C operation has been verified with test_nvscistream_perf and shown to work as expected.

The hardware and drivers are all setup correctly and working.

The chosen camera configuraiton and link mask are correct. This has been verified with nvsipl_camera and video displays just fine.

However, nvsipl_multicast does not work.

The command lines I am using are:

sudo nvsipl_multicast -c V1SIM728MPRU4120ND1_5Des_CPHY_x4 -m "0x0100 0 0 0 0" -N /usr/share/camera -p sipl_c2c -v 4

and

sudo nvsipl_multicast -c V1SIM728MPRU4120ND1_5Des_CPHY_x4 -m "0x0100 0 0 0 0" -N /usr/share/camera -p c2c_enc -C -v 4

I start the producer first then the consumer. After a short time I terminate the operation by typing ‘q’ in the consumer which tears down the test and both consumer and producer exit. No frames appear to be exchanged, however.

The producer log output is:

2026-06-10 19:40:53.314363 28167-28167/nvsipl_multicast DEBUG   Enter: CManager::InitStream()
2026-06-10 19:40:53.315141 28167-28167/nvsipl_multicast DEBUG   Exit: CManager::InitStream()
2026-06-10 19:40:53.315155 28167-28167/nvsipl_multicast DEBUG   Enter: CManager::CreateControlChannel()
2026-06-10 19:40:53.315157 28167-28167/nvsipl_multicast DEBUG   isCentralNode: true
2026-06-10 19:40:53.315160 28167-28167/nvsipl_multicast DEBUG   isP2P: true
2026-06-10 19:40:53.315164 28167-28167/nvsipl_multicast DEBUG   isC2C: true
2026-06-10 19:40:53.315169 28167-28167/nvsipl_multicast DEBUG   isMasterSoc: true
2026-06-10 19:40:53.315173 28167-28167/nvsipl_multicast DEBUG   Exit: CManager::CreateControlChannel()
2026-06-10 19:40:53.315175 28167-28167/nvsipl_multicast DEBUG   Enter: CControlChannelManager::Init()
2026-06-10 19:40:53.315284 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:53.315293 28167-28167/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvscic2c_pcie_s0_c5_11
2026-06-10 19:40:53.315669 28167-28167/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvscic2c_pcie_s0_c5_11, nframes = 16, frame_size = 32768
2026-06-10 19:40:53.315696 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:53.315700 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:53.315733 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:53.315739 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:53.315742 28167-28167/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvsipl_multicast_ipc_0
2026-06-10 19:40:53.315788 28167-28167/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvsipl_multicast_ipc_0, nframes = 64, frame_size = 1536
2026-06-10 19:40:53.315807 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:53.315812 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:53.315838 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:53.315843 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:53.315846 28167-28167/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvsipl_multicast_ipc_2
2026-06-10 19:40:53.315873 28167-28167/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvsipl_multicast_ipc_2, nframes = 64, frame_size = 1536
2026-06-10 19:40:53.315886 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:53.315890 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:53.315910 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:53.315913 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:53.315916 28167-28167/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvsipl_multicast_ipc_4
2026-06-10 19:40:53.315939 28167-28167/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvsipl_multicast_ipc_4, nframes = 64, frame_size = 1536
2026-06-10 19:40:53.315951 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:53.315955 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:53.315978 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:53.315982 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:53.315986 28167-28167/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvsipl_multicast_ipc_6
2026-06-10 19:40:53.316015 28167-28167/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvsipl_multicast_ipc_6, nframes = 64, frame_size = 1536
2026-06-10 19:40:53.316025 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:53.316030 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:53.316051 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:53.316055 28167-28167/nvsipl_multicast DEBUG   Exit: CControlChannelManager::Init()
2026-06-10 19:40:54.195156 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 has connected!
2026-06-10 19:40:54.417421 28167-28167/nvsipl_multicast INFO    Setting link masks
2026-06-10 19:40:54.426171 28167-28167/nvsipl_multicast DEBUG   Enter: CManager::CreateChannels()
2026-06-10 19:40:54.426220 28167-28167/nvsipl_multicast DEBUG   Exit: CManager::CreateChannels()
2026-06-10 19:40:54.426288 28167-28167/nvsipl_multicast DEBUG   Exit: CManager::Init()
2026-06-10 19:40:54.426296 28167-28167/nvsipl_multicast DEBUG   Enter: CManager::Run()
2026-06-10 19:40:54.426299 28167-28180/nvsipl_multicast DEBUG   c0: Enter: CChannel::ThreadFunc()
2026-06-10 19:40:54.426322 28167-28180/nvsipl_multicast DEBUG   c0: Enter: CChannel::BuildPipeline()
2026-06-10 19:40:54.426336 28167-28167/nvsipl_multicast DEBUG   Enter: InputEventLoop()
Enter 'q' to quit the application
Enter 's to suspend application
Enter 'r to resume application
-
2026-06-10 19:40:54.426385 28167-28181/nvsipl_multicast DEBUG   Enter: MonitorThreadFunc()
2026-06-10 19:40:54.426456 28167-28180/nvsipl_multicast DEBUG   CreateModule 5 c0_SIPL_2
2026-06-10 19:40:54.426465 28167-28180/nvsipl_multicast INFO    CSiplModule GetSensorId() 2
2026-06-10 19:40:54.426505 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Enter: CProducer::GetConnectBlock
2026-06-10 19:40:54.426517 28167-28180/nvsipl_multicast INFO    GetConnectBlock: m_uNumConsumers: 1 
2026-06-10 19:40:54.426522 28167-28180/nvsipl_multicast DEBUG   CAppCfg::SetPeerValidator
2026-06-10 19:40:54.426524 28167-28180/nvsipl_multicast DEBUG   CPeerValidator::SendValidationInfo.
2026-06-10 19:40:54.426527 28167-28180/nvsipl_multicast DEBUG   CPeerValidator::GetStringInfo
2026-06-10 19:40:54.426541 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer SendValidationInfo, error = 0.
2026-06-10 19:40:54.426578 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Exit: CProducer::GetConnectBlock
c0_SIPL_2_Producer NvSciIpcOpenEndpoint: nvscic2c_pcie_s0_c5_1
2026-06-10 19:40:54.427249 28167-28180/nvsipl_multicast DEBUG   A reader is created in Zone: nvscic2c_pcie_s0_c5_1
2026-06-10 19:40:54.427338 28167-28180/nvsipl_multicast DEBUG   c0: Exit: CChannel::BuildPipeline()
2026-06-10 19:40:54.427348 28167-28180/nvsipl_multicast DEBUG   c0: Enter: CChannel::InitModules()
2026-06-10 19:40:54.427355 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2: Enter: CSiplModule::Init
2026-06-10 19:40:54.427371 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2: Enter: CBaseModule::Init(), isPassthrough: 0
2026-06-10 19:40:54.427380 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Enter: CClientCommon::Init()
2026-06-10 19:40:54.427434 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Exit: CClientCommon::Init()
2026-06-10 19:40:54.427442 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2: Exit: CBaseModule::Init()
2026-06-10 19:40:54.427510 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Enter: CEventHandler::ThreadFunc()
2026-06-10 19:40:54.427535 28167-28180/nvsipl_multicast INFO    NvSIPL library version: 1.0.0
2026-06-10 19:40:54.427554 28167-28180/nvsipl_multicast INFO    NVSIPL header version: 1 0 0
2026-06-10 19:40:54.433049 28167-28180/nvsipl_multicast INFO    [[SIPLCamera]] SetPipelineCfg sensor 2 format 20
2026-06-10 19:40:54.433643 28167-28180/nvsipl_multicast INFO    uSensorId 2, pipelineQueues 0xffff640010c0, this 0xffff6405e060
2026-06-10 19:40:54.433654 28167-28180/nvsipl_multicast DEBUG   c0: Exit: CChannel::InitModules()
2026-06-10 19:40:55.322252 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:55.322329 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: CheckConnection: connected checked for 2.
2026-06-10 19:40:55.322346 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: CheckConnection: connected checked for 3.
2026-06-10 19:40:55.322357 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: CheckConnection: connected checked for 4.
2026-06-10 19:40:55.323871 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: CheckConnection: connected checked for 5.
2026-06-10 19:40:55.323880 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: CheckConnection: connected checked for 1.
2026-06-10 19:40:55.323889 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: CheckConnection: connected checked for 6.
c0_SIPL_2_Producer blocks are connected to the stream!
2026-06-10 19:40:55.323921 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2: Received event: c0_SIPL_2_Producer EventStatus::CONNECTED
2026-06-10 19:40:55.323930 28167-28184/nvsipl_multicast DEBUG   c0: Received event: c0_SIPL_2 EventStatus::CONNECTED
2026-06-10 19:40:55.323937 28167-28184/nvsipl_multicast DEBUG   c0: Push event 3
2026-06-10 19:40:55.323955 28167-28184/nvsipl_multicast INFO    c0_SIPL_2: SIPL MODULE Received event: c0_SIPL_2_Producer EventStatus::CONNECTED
2026-06-10 19:40:55.323967 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleConnectEvent return 6
2026-06-10 19:40:55.323965 28167-28180/nvsipl_multicast DEBUG   c0: Transfer Channel State to 1
2026-06-10 19:40:55.323984 28167-28180/nvsipl_multicast DEBUG   c0: Enter: CChannel::ReconcileModules()
2026-06-10 19:40:55.323991 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2: Enter: CBaseModule::Reconcile()
2026-06-10 19:40:55.323998 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Enter: CClientCommon::Reconcile()
2026-06-10 19:40:55.324016 28167-28180/nvsipl_multicast DEBUG   [[FillDataBufAttrList]] FillDataBufAttrList GetSensorId() 2 outputType 0, userType = 4
2026-06-10 19:40:55.324066 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Set element: 0 attributes.
2026-06-10 19:40:55.324086 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Set element: 1 attributes.
2026-06-10 19:40:55.324093 28167-28180/nvsipl_multicast DEBUG   [[FillDataBufAttrList]] FillDataBufAttrList GetSensorId() 2 outputType 1, userType = 0
2026-06-10 19:40:55.324120 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Set element: 2 attributes.
2026-06-10 19:40:55.324199 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Exit: CClientCommon::Reconcile()
2026-06-10 19:40:55.324239 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2: Exit: CBaseModule::Reconcile()
2026-06-10 19:40:55.324244 28167-28180/nvsipl_multicast DEBUG   c0: Exit: CChannel::ReconcileModules()
2026-06-10 19:40:55.324278 28167-28186/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Enter: CEventHandler::ThreadFunc()
2026-06-10 19:40:55.324991 28167-28186/nvsipl_multicast DEBUG   c0_SIPL_2_Producer_Pool: HandlePoolBufferSetup, m_bIsC2C: 0
2026-06-10 19:40:55.325847 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_Elements.
2026-06-10 19:40:55.325848 28167-28186/nvsipl_multicast DEBUG   c0_SIPL_2_Producer_Pool: HandleElements, NvSciStreamSetup_ElementExport
2026-06-10 19:40:55.326177 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.326411 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.326421 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Received PacketCreate from pool, m_numPackets: 1
2026-06-10 19:40:55.326428 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: GetPacketByCookie: packetId: 0
2026-06-10 19:40:55.326450 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Mapping meta buffer, uPacketIndex: 0.
2026-06-10 19:40:55.326470 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Set packet status success, cookie: 201376229.
2026-06-10 19:40:55.326487 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.335256 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.335261 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Received PacketCreate from pool, m_numPackets: 2
2026-06-10 19:40:55.335264 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: GetPacketByCookie: packetId: 1
2026-06-10 19:40:55.335270 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Mapping meta buffer, uPacketIndex: 1.
2026-06-10 19:40:55.335277 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Set packet status success, cookie: 201376230.
2026-06-10 19:40:55.335280 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.335731 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.335739 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Received PacketCreate from pool, m_numPackets: 3
2026-06-10 19:40:55.335745 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: GetPacketByCookie: packetId: 2
2026-06-10 19:40:55.335761 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Mapping meta buffer, uPacketIndex: 2.
2026-06-10 19:40:55.335779 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Set packet status success, cookie: 201376231.
2026-06-10 19:40:55.335786 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.336315 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.336323 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Received PacketCreate from pool, m_numPackets: 4
2026-06-10 19:40:55.336327 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: GetPacketByCookie: packetId: 3
2026-06-10 19:40:55.336343 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Mapping meta buffer, uPacketIndex: 3.
2026-06-10 19:40:55.336356 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Set packet status success, cookie: 201376232.
2026-06-10 19:40:55.336369 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.336808 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.336817 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Received PacketCreate from pool, m_numPackets: 5
2026-06-10 19:40:55.336822 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: GetPacketByCookie: packetId: 4
2026-06-10 19:40:55.336836 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Mapping meta buffer, uPacketIndex: 4.
2026-06-10 19:40:55.336842 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Set packet status success, cookie: 201376233.
2026-06-10 19:40:55.336845 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.337367 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.337378 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Received PacketCreate from pool, m_numPackets: 6
2026-06-10 19:40:55.337391 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: GetPacketByCookie: packetId: 5
2026-06-10 19:40:55.337409 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Mapping meta buffer, uPacketIndex: 5.
2026-06-10 19:40:55.337417 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Set packet status success, cookie: 201376234.
2026-06-10 19:40:55.337426 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.337368 28167-28186/nvsipl_multicast DEBUG   c0_SIPL_2_Producer_Pool: NvSciStreamSetup_PacketExport
2026-06-10 19:40:55.337432 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_PacketsComplete.
2026-06-10 19:40:55.337456 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.337448 28167-28186/nvsipl_multicast DEBUG   c0_SIPL_2_Producer_Pool: Received all the PacketStatus events.
2026-06-10 19:40:55.337483 28167-28186/nvsipl_multicast DEBUG   c0_SIPL_2_Producer_Pool: NvSciStreamSetup_PacketImport, bPacketFailure: 0
2026-06-10 19:40:55.341849 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_WaiterAttr.
2026-06-10 19:40:55.342296 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.342305 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent, received NvSciStreamEventType_SignalObj.
2026-06-10 19:40:55.342308 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Null sync obj for element type 4
2026-06-10 19:40:55.342315 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: HandleEvent() return error 0
2026-06-10 19:40:55.424154 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:55.524116 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:55.624081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:55.724078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:55.824080 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:55.924085 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.024076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.124082 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.224079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.324076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.337548 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:40:56.342398 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:40:56.424081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.524081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.624075 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.724081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.824076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:56.924079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.024076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.124076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.224083 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.324076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.337616 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:40:57.342467 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:40:57.424077 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.524083 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.624072 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.724082 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.824079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:57.924076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.024078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.124076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.224076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.324078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.337682 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:40:58.342537 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:40:58.424076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.524084 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.624075 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.724079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.824081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:58.924077 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.024076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.124080 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.224075 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.324080 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.337747 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:40:59.342608 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:40:59.424078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.524078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.624082 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.724102 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.824081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:40:59.924081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.024076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.124081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.224080 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.324079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.337813 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:41:00.342682 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:41:00.424080 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.524079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.624079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.724082 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.824079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:00.924081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.024080 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.124078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.224081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.324078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.337881 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:41:01.342753 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:41:01.424077 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.524081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.624076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.724079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.824079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:01.924078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.024081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.124077 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.224076 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.324079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.337946 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:41:02.342824 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:41:02.424081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.524082 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.624082 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.724081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.824080 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:02.924079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.024075 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.124077 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.224075 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.324083 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.338012 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:41:03.342894 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:41:03.424079 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.524075 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.624078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.724078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.824077 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:03.924080 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:04.024073 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:04.124078 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:04.224075 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:04.324074 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:04.338077 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:41:04.342971 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:41:04.424081 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 received user msg!
2026-06-10 19:41:04.426296 28167-28172/nvsipl_multicast INFO    nvscic2c_pcie_s0_c5_11 has disconnected!
2026-06-10 19:41:05.338143 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:41:05.343041 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
2026-06-10 19:41:06.338207 28167-28186/nvsipl_multicast WARNING c0_SIPL_2_Producer_Pool: Event query, timed out.
2026-06-10 19:41:06.343109 28167-28184/nvsipl_multicast WARNING c0_SIPL_2_Producer: Event query, timed out.
channel: nvscic2c_pcie_s0_c5_1 lost heartbeat for 2099ms, begin to detach!
Begin to detach consumer: nvscic2c_pcie_s0_c5_1
HandleEvent, received NvSciStreamEventType_Disconnected.
2026-06-10 19:41:06.524031 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2: Received event: c0_SIPL_2_Producer EventStatus::DISCONNECT
2026-06-10 19:41:06.524035 28167-28184/nvsipl_multicast DEBUG   c0: Received event: c0_SIPL_2 EventStatus::DISCONNECT
2026-06-10 19:41:06.524038 28167-28184/nvsipl_multicast DEBUG   c0: Push event 2
2026-06-10 19:41:06.524042 28167-28184/nvsipl_multicast INFO    c0_SIPL_2: SIPL MODULE Received event: c0_SIPL_2_Producer EventStatus::DISCONNECT
Received disconnect event, quit!
2026-06-10 19:41:06.524051 28167-28180/nvsipl_multicast DEBUG   Enter: CManager::Quit()
2026-06-10 19:41:06.524054 28167-28180/nvsipl_multicast DEBUG   c0: Received cmd 2
2026-06-10 19:41:06.524056 28167-28180/nvsipl_multicast DEBUG   Exit: CManager::Quit()
2026-06-10 19:41:06.524058 28167-28180/nvsipl_multicast DEBUG   c0: Enter: CChannel::DeInit()
2026-06-10 19:41:06.524061 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2: Enter: CSiplModule::DeInit
2026-06-10 19:41:06.524064 28167-28180/nvsipl_multicast INFO    ~CSiplCamera
2026-06-10 19:41:06.825260 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2: Enter: CBaseModule::DeInit()
2026-06-10 19:41:06.825271 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Enter: CClientCommon::DeInit()
2026-06-10 19:41:06.825280 28167-28184/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Exit: CEventHandler::ThreadFunc()
2026-06-10 19:41:06.825308 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Exit: CClientCommon::DeInit()
2026-06-10 19:41:06.825322 28167-28186/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: Exit: CEventHandler::ThreadFunc()
2026-06-10 19:41:06.825463 28167-28180/nvsipl_multicast DEBUG   c0: Received event: c0_SIPL_2 EventStatus::QUITTED
2026-06-10 19:41:06.825471 28167-28180/nvsipl_multicast DEBUG   c0: Push event 6
2026-06-10 19:41:06.825473 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2: Exit: CBaseModule::DeInit()
2026-06-10 19:41:06.825478 28167-28180/nvsipl_multicast DEBUG   c0_SIPL_2: Exit: CSiplModule::DeInit
2026-06-10 19:41:06.825483 28167-28180/nvsipl_multicast DEBUG   c0: Exit: CChannel::DeInit()
2026-06-10 19:41:06.825492 28167-28180/nvsipl_multicast DEBUG   c0: Transfer Channel State to 5
2026-06-10 19:41:06.825498 28167-28180/nvsipl_multicast DEBUG   c0: Exit: CChannel::ThreadFunc()
2026-06-10 19:41:07.438319 28167-28167/nvsipl_multicast DEBUG   Exit: InputEventLoop()

Channel c0:
c0_SIPL_2                        Frame rate (fps):	0.0

2026-06-10 19:41:08.825591 28167-28181/nvsipl_multicast DEBUG   Exit: MonitorThreadFunc()
2026-06-10 19:41:08.825633 28167-28167/nvsipl_multicast DEBUG   Exit: CManager::Run()
2026-06-10 19:41:08.825641 28167-28167/nvsipl_multicast DEBUG   Enter: CManager::DeInit()
2026-06-10 19:41:08.825643 28167-28167/nvsipl_multicast DEBUG   Enter: CTimer::Deinit()
2026-06-10 19:41:08.825690 28167-28167/nvsipl_multicast DEBUG   Enter: CThreadPool::Deinit()
2026-06-10 19:41:08.825761 28167-28167/nvsipl_multicast DEBUG   Exit: CThreadPool::Deinit()
2026-06-10 19:41:08.825766 28167-28167/nvsipl_multicast DEBUG   Exit: CTimer::Deinit()
2026-06-10 19:41:08.825768 28167-28167/nvsipl_multicast DEBUG   Enter: CControlChannelManager::Deinit()
2026-06-10 19:41:08.825773 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:08.825784 28167-28172/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:08.825816 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:08.825820 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:08.825885 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:08.825890 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:08.825907 28167-28173/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:08.825957 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:08.825963 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:08.825996 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:08.826001 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:08.826015 28167-28174/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:08.826061 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:08.826068 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:08.826092 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:08.826097 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:08.826107 28167-28175/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:08.826137 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:08.826141 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:08.826162 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:08.826166 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:08.826184 28167-28176/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:08.826234 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:08.826241 28167-28167/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:08.826262 28167-28167/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:08.826267 28167-28167/nvsipl_multicast DEBUG   Enter: CThreadPool::Deinit()
2026-06-10 19:41:08.826339 28167-28167/nvsipl_multicast DEBUG   Exit: CThreadPool::Deinit()
2026-06-10 19:41:08.826347 28167-28167/nvsipl_multicast DEBUG   Exit: CControlChannelManager::Deinit()
2026-06-10 19:41:08.826484 28167-28167/nvsipl_multicast DEBUG   Exit: CManager::DeInit()
2026-06-10 19:41:08.826499 28167-28167/nvsipl_multicast DEBUG   c0_SIPL_2_Producer_Pool: Pool release.
2026-06-10 19:41:08.826507 28167-28167/nvsipl_multicast DEBUG   c0_SIPL_2_Producer: ClientCommon release.
nvsipl_multicast properly quitted

The consumer log output is:

2026-06-10 19:40:54.193640 26678-26678/nvsipl_multicast DEBUG   Enter: CManager::InitStream()
2026-06-10 19:40:54.194402 26678-26678/nvsipl_multicast DEBUG   Exit: CManager::InitStream()
2026-06-10 19:40:54.194417 26678-26678/nvsipl_multicast DEBUG   Enter: CManager::CreateControlChannel()
2026-06-10 19:40:54.194419 26678-26678/nvsipl_multicast DEBUG   isCentralNode: true
2026-06-10 19:40:54.194422 26678-26678/nvsipl_multicast DEBUG   isP2P: true
2026-06-10 19:40:54.194427 26678-26678/nvsipl_multicast DEBUG   isC2C: true
2026-06-10 19:40:54.194432 26678-26678/nvsipl_multicast DEBUG   isMasterSoc: false
2026-06-10 19:40:54.194435 26678-26678/nvsipl_multicast DEBUG   Exit: CManager::CreateControlChannel()
2026-06-10 19:40:54.194437 26678-26678/nvsipl_multicast DEBUG   Enter: CControlChannelManager::Init()
2026-06-10 19:40:54.194548 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:54.194556 26678-26678/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvscic2c_pcie_s1_c5_11
2026-06-10 19:40:54.194930 26678-26678/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvscic2c_pcie_s1_c5_11, nframes = 16, frame_size = 32768
2026-06-10 19:40:54.194956 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:54.194960 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:54.195013 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:54.195019 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:54.195023 26678-26678/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvsipl_multicast_ipc_0
2026-06-10 19:40:54.195069 26678-26678/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvsipl_multicast_ipc_0, nframes = 64, frame_size = 1536
2026-06-10 19:40:54.195086 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:54.195091 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:54.195113 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:54.195116 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:54.195120 26678-26678/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvsipl_multicast_ipc_2
2026-06-10 19:40:54.195188 26678-26678/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvsipl_multicast_ipc_2, nframes = 64, frame_size = 1536
2026-06-10 19:40:54.195202 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:54.195207 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:54.195237 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:54.195244 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:54.195248 26678-26678/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvsipl_multicast_ipc_4
2026-06-10 19:40:54.195274 26678-26678/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvsipl_multicast_ipc_4, nframes = 64, frame_size = 1536
2026-06-10 19:40:54.195284 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:54.195288 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:54.195288 26678-26683/nvsipl_multicast INFO    nvscic2c_pcie_s1_c5_11 has connected!
2026-06-10 19:40:54.195327 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:54.195331 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Init()
2026-06-10 19:40:54.195333 26678-26678/nvsipl_multicast INFO     NvSciIpcOpenEndpoint: nvsipl_multicast_ipc_6
2026-06-10 19:40:54.195358 26678-26678/nvsipl_multicast DEBUG   Endpoint info: endpoint name = nvsipl_multicast_ipc_6, nframes = 64, frame_size = 1536
2026-06-10 19:40:54.195371 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Init()
2026-06-10 19:40:54.195375 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Start()
2026-06-10 19:40:54.195396 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Start()
2026-06-10 19:40:54.195401 26678-26678/nvsipl_multicast DEBUG   Exit: CControlChannelManager::Init()
2026-06-10 19:40:54.427371 26678-26683/nvsipl_multicast INFO    nvscic2c_pcie_s1_c5_11 received reader create msg!
2026-06-10 19:40:55.314139 26678-26678/nvsipl_multicast INFO    Setting link masks
2026-06-10 19:40:55.321023 26678-26678/nvsipl_multicast DEBUG   Enter: CManager::CreateChannels()
2026-06-10 19:40:55.321072 26678-26678/nvsipl_multicast DEBUG   Exit: CManager::CreateChannels()
2026-06-10 19:40:55.321182 26678-26678/nvsipl_multicast DEBUG   Exit: CManager::Init()
2026-06-10 19:40:55.321190 26678-26678/nvsipl_multicast DEBUG   Enter: CManager::Run()
2026-06-10 19:40:55.321194 26678-26692/nvsipl_multicast DEBUG   c0: Enter: CChannel::ThreadFunc()
2026-06-10 19:40:55.321218 26678-26678/nvsipl_multicast DEBUG   Enter: InputEventLoop()
Enter 'q' to quit the application
2026-06-10 19:40:55.321218 26678-26692/nvsipl_multicast DEBUG   c0: Enter: CChannel::BuildPipeline()
2026-06-10 19:40:55.321234 26678-26693/nvsipl_multicast DEBUG   Enter: MonitorThreadFunc()
Enter 's to suspend application
Enter 'r to resume application
-
2026-06-10 19:40:55.321320 26678-26692/nvsipl_multicast DEBUG   CreateModule 0 c0_Enc_2
Using default elemInfo.
c0_Enc_2_Consumer0 NvSciIpcOpenEndpoint: nvscic2c_pcie_s1_c5_1
2026-06-10 19:40:55.322125 26678-26692/nvsipl_multicast DEBUG   A writer is created in Zone: nvscic2c_pcie_s0_c5_1
2026-06-10 19:40:55.322204 26678-26692/nvsipl_multicast DEBUG   c0: Exit: CChannel::BuildPipeline()
2026-06-10 19:40:55.322212 26678-26692/nvsipl_multicast DEBUG   c0: Enter: CChannel::InitModules()
2026-06-10 19:40:55.322217 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Enter Init
2026-06-10 19:40:55.322223 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Enter: CBaseModule::Init(), isPassthrough: 0
2026-06-10 19:40:55.322227 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Enter: CClientCommon::Init()
2026-06-10 19:40:55.322256 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Exit: CClientCommon::Init()
2026-06-10 19:40:55.322260 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Exit: CBaseModule::Init()
2026-06-10 19:40:55.322263 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Exit Init
2026-06-10 19:40:55.322266 26678-26692/nvsipl_multicast DEBUG   c0: Exit: CChannel::InitModules()
2026-06-10 19:40:55.322300 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Enter: CEventHandler::ThreadFunc()
2026-06-10 19:40:55.322500 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: CheckConnection: connected checked for 3.
2026-06-10 19:40:55.322509 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: CheckConnection: connected checked for 2.
2026-06-10 19:40:55.323870 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: CheckConnection: connected checked for 4.
2026-06-10 19:40:55.323877 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: CheckConnection: connected checked for 1.
c0_Enc_2_Consumer0 blocks are connected to the stream!
2026-06-10 19:40:55.323883 26678-26695/nvsipl_multicast DEBUG   CAppCfg::SetPeerValidator
2026-06-10 19:40:55.323887 26678-26695/nvsipl_multicast DEBUG   CPeerValidator::Validate.
2026-06-10 19:40:55.323892 26678-26695/nvsipl_multicast DEBUG   CPeerValidator::GetStringInfo
2026-06-10 19:40:55.323898 26678-26695/nvsipl_multicast DEBUG   the info from producer: {isStaticConfig=0}{platformName=V1SIM728MPRU4120ND1_5Des_CPHY_x4;}{masks=256,;}{isMultiElementsEnabled=0}.
2026-06-10 19:40:55.323903 26678-26695/nvsipl_multicast DEBUG   the info in this consumer: {isStaticConfig=0}{platformName=V1SIM728MPRU4120ND1_5Des_CPHY_x4;}{masks=256,;}{isMultiElementsEnabled=0}.
2026-06-10 19:40:55.323906 26678-26695/nvsipl_multicast INFO    Peer validation succeeded.
2026-06-10 19:40:55.323916 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2: Received event: c0_Enc_2_Consumer0 EventStatus::CONNECTED
2026-06-10 19:40:55.323922 26678-26695/nvsipl_multicast DEBUG   c0: Received event: c0_Enc_2 EventStatus::CONNECTED
2026-06-10 19:40:55.323924 26678-26695/nvsipl_multicast DEBUG   c0: Push event 3
2026-06-10 19:40:55.323930 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleConnectEvent return 6
2026-06-10 19:40:55.323940 26678-26692/nvsipl_multicast DEBUG   c0: Transfer Channel State to 1
2026-06-10 19:40:55.323946 26678-26692/nvsipl_multicast DEBUG   c0: Enter: CChannel::ReconcileModules()
2026-06-10 19:40:55.323948 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Enter: CBaseModule::Reconcile()
2026-06-10 19:40:55.323951 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Enter: CClientCommon::Reconcile()
2026-06-10 19:40:55.324005 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Set element: 0 attributes.
2026-06-10 19:40:55.324027 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Set element: 1 attributes.
2026-06-10 19:40:55.324050 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Set element: 2 attributes.
2026-06-10 19:40:55.324145 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Exit: CClientCommon::Reconcile()
2026-06-10 19:40:55.324178 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Exit: CBaseModule::Reconcile()
2026-06-10 19:40:55.324182 26678-26692/nvsipl_multicast DEBUG   c0: Exit: CChannel::ReconcileModules()
2026-06-10 19:40:55.324218 26678-26696/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Enter: CEventHandler::ThreadFunc()
2026-06-10 19:40:55.333602 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_Elements.
2026-06-10 19:40:55.334049 26678-26695/nvsipl_multicast DEBUG   Enc device list size 2 
2026-06-10 19:40:55.334058 26678-26695/nvsipl_multicast INFO    c0_Enc_2: device num 0 numaDomainId 0 
2026-06-10 19:40:55.334060 26678-26695/nvsipl_multicast INFO     Encoder - Primary GPU UUID:         254328d7-e464-51c1-ae9ae0ddbbd6a316 
2026-06-10 19:40:55.334064 26678-26695/nvsipl_multicast INFO     Encoder - Hardware GPU UUID:        254328d7-e464-51c1-ae9ae0ddbbd6a316 
2026-06-10 19:40:55.334069 26678-26695/nvsipl_multicast INFO    c0_Enc_2: device num 1 numaDomainId 0 
2026-06-10 19:40:55.334071 26678-26695/nvsipl_multicast INFO     Encoder - Primary GPU UUID:         254328d7-e464-51c1-ae9ae0ddbbd6a316 
2026-06-10 19:40:55.334074 26678-26695/nvsipl_multicast INFO     Encoder - Hardware GPU UUID:        254328d7-e464-51c1-ae9ae0ddbbd6a316 
2026-06-10 19:40:55.338611 26678-26696/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0_Pool: HandlePoolBufferSetup, m_bIsC2C: 1
2026-06-10 19:40:55.338683 26678-26696/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0_Pool: HandleC2CElements, NvSciStreamSetup_ElementImport
2026-06-10 19:40:55.338934 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:55.338949 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.338956 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Received PacketCreate from pool, m_numPackets: 1
2026-06-10 19:40:55.338961 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: GetPacketByCookie: packetId: 0
2026-06-10 19:40:55.338968 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Mapping meta buffer, uPacketIndex: 0.
2026-06-10 19:40:55.339061 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Set packet status success, cookie: 201376229.
2026-06-10 19:40:55.339067 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:55.339070 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_WaiterAttr.
2026-06-10 19:40:55.339496 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:55.341526 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.341532 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Received PacketCreate from pool, m_numPackets: 2
2026-06-10 19:40:55.341535 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: GetPacketByCookie: packetId: 1
2026-06-10 19:40:55.341541 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Mapping meta buffer, uPacketIndex: 1.
2026-06-10 19:40:55.341618 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Set packet status success, cookie: 201376230.
2026-06-10 19:40:55.341624 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:55.374468 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_SignalObj.
2026-06-10 19:40:55.374477 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:55.374481 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.374486 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Received PacketCreate from pool, m_numPackets: 3
2026-06-10 19:40:55.374492 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: GetPacketByCookie: packetId: 2
2026-06-10 19:40:55.374499 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Mapping meta buffer, uPacketIndex: 2.
2026-06-10 19:40:55.374565 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Set packet status success, cookie: 201376231.
2026-06-10 19:40:55.374571 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:55.374951 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.374956 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Received PacketCreate from pool, m_numPackets: 4
2026-06-10 19:40:55.374959 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: GetPacketByCookie: packetId: 3
2026-06-10 19:40:55.374964 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Mapping meta buffer, uPacketIndex: 3.
2026-06-10 19:40:55.375044 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Set packet status success, cookie: 201376232.
2026-06-10 19:40:55.375050 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:55.375435 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.375440 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Received PacketCreate from pool, m_numPackets: 5
2026-06-10 19:40:55.375442 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: GetPacketByCookie: packetId: 4
2026-06-10 19:40:55.375447 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Mapping meta buffer, uPacketIndex: 4.
2026-06-10 19:40:55.375513 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Set packet status success, cookie: 201376233.
2026-06-10 19:40:55.375518 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:55.375902 26678-26696/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0_Pool: NvSciStreamSetup_PacketExport
2026-06-10 19:40:55.375905 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_PacketCreate.
2026-06-10 19:40:55.375924 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Received PacketCreate from pool, m_numPackets: 6
2026-06-10 19:40:55.375927 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: GetPacketByCookie: packetId: 5
2026-06-10 19:40:55.375933 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Mapping meta buffer, uPacketIndex: 5.
2026-06-10 19:40:55.376014 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Set packet status success, cookie: 201376234.
2026-06-10 19:40:55.376019 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:55.376021 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent, received NvSciStreamEventType_PacketsComplete.
2026-06-10 19:40:55.376026 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: HandleEvent() return error 0
2026-06-10 19:40:56.376091 26678-26695/nvsipl_multicast WARNING c0_Enc_2_Consumer0: Event query, timed out.
2026-06-10 19:40:56.376186 26678-26696/nvsipl_multicast WARNING c0_Enc_2_Consumer0_Pool: Event query, timed out.
2026-06-10 19:40:57.376159 26678-26695/nvsipl_multicast WARNING c0_Enc_2_Consumer0: Event query, timed out.
2026-06-10 19:40:57.376255 26678-26696/nvsipl_multicast WARNING c0_Enc_2_Consumer0_Pool: Event query, timed out.
2026-06-10 19:40:58.376224 26678-26695/nvsipl_multicast WARNING c0_Enc_2_Consumer0: Event query, timed out.
2026-06-10 19:40:58.376324 26678-26696/nvsipl_multicast WARNING c0_Enc_2_Consumer0_Pool: Event query, timed out.
2026-06-10 19:40:59.376293 26678-26695/nvsipl_multicast WARNING c0_Enc_2_Consumer0: Event query, timed out.
2026-06-10 19:40:59.376398 26678-26696/nvsipl_multicast WARNING c0_Enc_2_Consumer0_Pool: Event query, timed out.
2026-06-10 19:41:00.376367 26678-26695/nvsipl_multicast WARNING c0_Enc_2_Consumer0: Event query, timed out.
2026-06-10 19:41:00.376476 26678-26696/nvsipl_multicast WARNING c0_Enc_2_Consumer0_Pool: Event query, timed out.
2026-06-10 19:41:01.376433 26678-26695/nvsipl_multicast WARNING c0_Enc_2_Consumer0: Event query, timed out.
2026-06-10 19:41:01.376544 26678-26696/nvsipl_multicast WARNING c0_Enc_2_Consumer0_Pool: Event query, timed out.
q
Application exiting
2026-06-10 19:41:01.887835 26678-26678/nvsipl_multicast DEBUG   Enter: CManager::Quit()
2026-06-10 19:41:01.887847 26678-26678/nvsipl_multicast DEBUG   c0: Received cmd 2
2026-06-10 19:41:01.887854 26678-26678/nvsipl_multicast DEBUG   Exit: CManager::Quit()
2026-06-10 19:41:01.887863 26678-26692/nvsipl_multicast DEBUG   c0: Enter: CChannel::DeInit()
2026-06-10 19:41:01.887875 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Enter DeInit
2026-06-10 19:41:01.887878 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Enter: CBaseModule::DeInit()
2026-06-10 19:41:01.888139 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Enter: CClientCommon::DeInit()
2026-06-10 19:41:02.376499 26678-26695/nvsipl_multicast WARNING c0_Enc_2_Consumer0: Event query, timed out.
2026-06-10 19:41:02.376506 26678-26695/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Exit: CEventHandler::ThreadFunc()
2026-06-10 19:41:02.376535 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Exit: CClientCommon::DeInit()
2026-06-10 19:41:02.376612 26678-26696/nvsipl_multicast WARNING c0_Enc_2_Consumer0_Pool: Event query, timed out.
2026-06-10 19:41:02.376620 26678-26696/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: Exit: CEventHandler::ThreadFunc()
2026-06-10 19:41:02.423254 26678-26692/nvsipl_multicast DEBUG   c0: Received event: c0_Enc_2 EventStatus::QUITTED
2026-06-10 19:41:02.423265 26678-26692/nvsipl_multicast DEBUG   c0: Push event 6
2026-06-10 19:41:02.423268 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Exit: CBaseModule::DeInit()
2026-06-10 19:41:02.425805 26678-26692/nvsipl_multicast DEBUG   c0_Enc_2: Exit DeInit
2026-06-10 19:41:02.425814 26678-26692/nvsipl_multicast DEBUG   c0: Exit: CChannel::DeInit()
2026-06-10 19:41:02.425823 26678-26692/nvsipl_multicast DEBUG   c0: Transfer Channel State to 5
2026-06-10 19:41:02.425828 26678-26692/nvsipl_multicast DEBUG   c0: Exit: CChannel::ThreadFunc()
2026-06-10 19:41:02.888871 26678-26678/nvsipl_multicast DEBUG   Exit: InputEventLoop()

Channel c0:
c0_Enc_2                         Frame rate (fps):	0.0

2026-06-10 19:41:04.425927 26678-26693/nvsipl_multicast DEBUG   Exit: MonitorThreadFunc()
2026-06-10 19:41:04.425985 26678-26678/nvsipl_multicast DEBUG   Exit: CManager::Run()
2026-06-10 19:41:04.426005 26678-26678/nvsipl_multicast DEBUG   Enter: CManager::DeInit()
2026-06-10 19:41:04.426012 26678-26678/nvsipl_multicast DEBUG   Enter: CTimer::Deinit()
2026-06-10 19:41:04.426077 26678-26678/nvsipl_multicast DEBUG   Enter: CThreadPool::Deinit()
2026-06-10 19:41:04.426152 26678-26678/nvsipl_multicast DEBUG   Exit: CThreadPool::Deinit()
2026-06-10 19:41:04.426162 26678-26678/nvsipl_multicast DEBUG   Exit: CTimer::Deinit()
2026-06-10 19:41:04.426168 26678-26678/nvsipl_multicast DEBUG   Enter: CControlChannelManager::Deinit()
2026-06-10 19:41:04.426182 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:04.426269 26678-26683/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:04.426321 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:04.426331 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:04.426425 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:04.426433 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:04.426450 26678-26685/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:04.426503 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:04.426511 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:04.426560 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:04.426567 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:04.426586 26678-26686/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:04.426643 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:04.426653 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:04.426689 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:04.426696 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:04.426713 26678-26687/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:04.426769 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:04.426777 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:04.426810 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:04.426816 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Stop()
2026-06-10 19:41:04.426839 26678-26688/nvsipl_multicast INFO    CIpcLink::WaitEvent received quit command
2026-06-10 19:41:04.426903 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Stop()
2026-06-10 19:41:04.426912 26678-26678/nvsipl_multicast DEBUG   Enter: CIpcLink::Deinit()
2026-06-10 19:41:04.426944 26678-26678/nvsipl_multicast DEBUG   Exit: CIpcLink::Deinit()
2026-06-10 19:41:04.426952 26678-26678/nvsipl_multicast DEBUG   Enter: CThreadPool::Deinit()
2026-06-10 19:41:04.427060 26678-26678/nvsipl_multicast DEBUG   Exit: CThreadPool::Deinit()
2026-06-10 19:41:04.427070 26678-26678/nvsipl_multicast DEBUG   Exit: CControlChannelManager::Deinit()
2026-06-10 19:41:04.427263 26678-26678/nvsipl_multicast DEBUG   Exit: CManager::DeInit()
2026-06-10 19:41:04.427289 26678-26678/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0_Pool: Pool release.
2026-06-10 19:41:04.427299 26678-26678/nvsipl_multicast DEBUG   c0_Enc_2_Consumer0: ClientCommon release.
nvsipl_multicast properly quitted

Questions

  1. Are the command lines correct?
  2. Is the sample known to work in 7.0.3?
  3. How do I debug this?
5

Dear @david.cattley ,
Could you clear the syslog on both thor, run the test and share the syslog on both thors?

7

Instead of clearing the syslog as requested I simply recorded the tail -f /var/log/syslog | tee soc{0|1}-syslog.txt to capture the syslog output from just prior to the test until just after the test.

soc0-syslog.txt (41.9 KB)

soc1-syslog.txt (12.3 KB)

8

Sorry, I forgot to run the application with sudo in that last post. Here are the syslogs with the application run with sudo.

soc0-syslog-1.txt (38.4 KB)

soc1-syslog-1.txt (11.8 KB)

9

I am attaching the /etc/nvsciipc.cfg files for both SoCs here as well. I have read and re-read the documentation on NvSciIpc configuration and the documnentation on the NvSci sample applications, the multicast application, and the C2C communications multiple times. I don’t understand if there should be entries of the form

INTER_CHIP ...

or

INTER_CHIP_PCIE ...

the files as attached seem to allow the test_nvscistream_perfapplication to work in C2C. I have not been able to get nvscistream_event_sampleto work in C2C.

soc1-nvsciipc.cfg.txt (65.0 KB)

soc0-nvsciipc.cfg.txt (65.0 KB)

10

Also:

Do I need to specify some opiont to bind_partitions to set the soc_id value for each Drive AGX Thor unit to a unique value (like 1 and 2)?

I don’t see any references in the DOS7 documentation that indicate that soc_id in the DeviceTree needs to be modified for C2C operation though it seems in various places for DOS6 this was mentioned.

bind_partions has the --soc_id option (SOC_IDENTIFICATION_VALUE gets set)

Similarly do I need to set ENABLE_PLATFORM_T2=y to bind_partitions for the “second” Drive AGX Thor to have it behave as if it were in a Dual-Soc system?

11

Dear @david.cattley ,
I notice below messages in syslog

2026-06-15T15:51:31.521966+00:00 tegra-ubuntu kernel: [TS:522528399023395] nvscic2c-pcie: vmap: per endpoint mapping limit exceeded, aperture_inuse: 64253952, map_size: 12845056
2026-06-15T15:51:31.521978+00:00 tegra-ubuntu kernel: [TS:522528399027747] nvscic2c-pcie: vmap: Failed in aperture limit check

This is a known issue in DRIVE OS 7.0.3 and got fixed. The fix should be available in next release.

12

I don’t see that one in the Release Notes.

Is there a work-around?

And that will be when?

13

Unfortunately patch can not be provided on 7.0.3 release. The release date is not finalized . We will communicate once it is finalized