Jetson devices join to k8s issue,about ip_set

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
,
1

Hi NVIDIA team,
We have 3 Jetson AGX Orin devices pre-installed with Ubuntu20.04 operating system.We tried to build a k8s cluster on the device and used calico as the CNI for the cluster.However, the calico pod of the cluster is in an unhealthy state, looking at the log we find the following error:

kubectl logs -n kube-system calico-node-b9vww --tail=50
2024-08-28 03:33:01.994 [ERROR][3119790] felix/ipsets.go 569: Bad return code from ‘ipset list’. error=exit status 1 family=“inet” stderr=“ipset v7.11: Kernel error received: Invalid argument\n”
2024-08-28 03:33:01.994 [WARNING][3119790] felix/ipsets.go 319: Failed to resync with dataplane error=exit status 1 family=“inet”
Then I run the following command：
root@k8s-master:/home/nvidia# lsmod | grep ip_set
root@k8s-master:/home/nvidia# uname -r
5.10.104-tegra
root@k8s-master:/home/nvidia# modprobe ip_set
modprobe: FATAL: Module ip_set not found in directory /lib/modules/5.10.104-tegra
find /lib/modules/$(uname -r) -type f -name ‘ip_set’
The kernel seems to be missing the ip_set module？Is there any solution？thank you very much

3

Hi,
It looks like certain configs are not enabled. Please check what confgis are required and refer to Kernel section in developer guide to rebuild/replace kernel image:

Kernel — NVIDIA Jetson Linux Developer Guide 1 documentation

4

Thank you very much. What should I do specifically? Is there any way to add only ip_set related modules without changing the whole kernel?
My NVIDIA Jetson Orin device is running JetPack 5.0.2 and L4T 35.1.0

5

Because I’m new in the kernel configuration, if I am in accordance with the Kernel — NVIDIA Jetson Linux Developer Guide 1 documentation rebuild v35.1 kernel, I’m not sure if ip_set related modules exist, or where to select them

6

Hi,
We don’t have much experience about the command. Would see if other users can share experience.

Did online search and see this post:
Add ipset to Ubuntu 16.04 kernel · Issue #285 · scaleway/kernel-tools · GitHub

You may enable the configs for a try.

Also we suggest use later Jetpack 6.0GA or 5.1.3 release. Some issues are discovered and fixed in later release.

7

Thank you. According to the document you gave me, I manually added the kernel module IP_SET, compiled and replaced the original kernel, and now the problem is solved

10

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.