Missing veth/macvlan/ipvlan support on NVIDIA DRIVE AGX (Kernel 5.15.122-rt-tegra)

DRIVE OS Version: Provide DRIVE OS ver. 6.0.10

Issue Description:

I am working on a setup on NVIDIA DRIVE AGX, where multiple containerized applications are deployed on a single HPC node.

I am unable to create any form of container network isolation required to simulate inter-ECU communication due to missing kernel networking support.

Specifically:

  1. Docker bridge network fails
failed to add the host (vethXXXX) <=> sandbox (vethXXXX) pair interfaces: operation not supported
  1. macvlan network fails
failed to create the macvlan port: operation not supported
  1. ipvlan network fails
failed to create the ipvlan port: operation not supported
  1. Manual veth creation fails
ip link add veth_cam type veth peer name veth_drow
β†’ Error: Unknown device type

Kernel Investigation:

Kernel version:

5.15.122-rt-tegra

Kernel config:

CONFIG_VETH=m

However, the module is missing:

modprobe veth
β†’ FATAL: Module veth not found in directory /lib/modules/5.15.122-rt-tegra

Also:

/lib/modules/5.15.122-rt-tegra/kernel/drivers/net/
β†’ only contains: can, mdio.ko, usb
(no veth.ko, macvlan.ko, ipvlan.ko)

Impact:

  • Unable to use Docker bridge networking (depends on veth)

  • Unable to use macvlan/ipvlan

  • Unable to create network namespaces for isolation

  • Only --network host is functional

Request:

We would like guidance on the following:

  1. Is it expected that NVIDIA DRIVE AGX kernel does not include:

    • veth

    • macvlan

    • ipvlan modules?

  2. Is there an official way to enable container network isolation on DRIVE AGX?

  3. Is there a supported kernel/modules package that includes:

    • veth.ko

    • macvlan.ko

    • ipvlan.ko

Please check and help.

Dear @amitkumar.nandi1 ,
--network hostoption with Docker, allows containers to use the host network stack. This is the recommended approach for DRIVE AGX Orin. Does that work your case?

@SivaRamaKrishnaNV Thanks for the support.

Yes, --network hostoption with Docker is working fine. But I was trying to communicate via macvlan/ipvlan network also, which is not working. Is there any way to enable those?

Dear @amitkumar.nandi1 ,
Docker on DRIVE is for experimentation purpose and expect to use network via host.