RoCE communication over MGBE on Thor

Hello.

My understanding is that the Holoscan Sensor Bridge makes use of RDMA over Converged Ethernet with the Thor over its MGBE interfaces to drive ultra low latency communication with Camera over Ethernet. However - is it possible to make use of something like InfiniBand Verbs or DPDK to take advantage of that interface to do RDMA over Converged Ethernet for other low latency purposes besides camera interfaces?

Hello,

Thank you for your interest in the holoscan sensor bridge.
To answer your question, holoscan sensor bridge RoCE transport is used in systems that have the Connectx NIC (like IGX Orin for example) and in these cases it uses the ibverbs to facilitate RDMA to GPU and offload the CPU.
As you rightfully mentioned, Thor uses the MGBE (not Connectx) which rules out the usage of RoCE and ibverbs. Instead, there is a different HW path to achieve the offloading of CPU and writing data into GPU which uses the IEEE1722b protocol as transport. This means RoCE/ibverbs are not available for Thor.
As for DPDK, it is not supported with holoscan sensor bridge.
I hope these answers you question.
Thanks!

Interesting. Does the MGBE on the Thor only support IEEE Std 802.1BA-2021 or does it support other profiles of the TSN spec as well?

Instead, there is a different HW path to achieve the offloading of CPU and writing data into GPU which uses the IEEE1722b protocol as transport

Does this imply that the Thor has hardware acceleration for processing the AVB packets and splitting them into an appropriate video stream?

Are there any CUDA libraries that can be used outside of Holoscan to process this information and present it? Or is it solely through Holoscan?

Hi,

Yes, Thor has hardware engine to handle this.

It is soley through Holoscan.

Interesting. Is it NVIDIA’s intent to open up this core to be used by something like for e.g. GStreamer or FFMPEG?

Also, are there any other parts of TSN that are accessible without Holoscan?