ARM Workload execution failed in Jetson AGX Orin using pip envrionment from other system

I have executed the ( Ubuntu 22.04.4 LTS) through pip environment but It gets failed with below Error
ERROR Module “cgroups” failed to install on target: Failed to mount “cpuset” controller
ERROR Failed to mount “cpuset” controller
Attached complete build log
run.log (20.3 KB)

If anyone has idea about this issue and let me know

Hi,
If you use Jetpack 6.0GA(r36.3), it may be certain kernel configs not being enabled. Please check what configs are required and refer to developer guide to rebuild kernel.

Thank you Dane
Actually Below configs are already enabled in the Image.
{{{
root@orin-desktop:~# zcat /proc/config.gz | grep -i cpuset
CONFIG_CPUSETS=y
CONFIG_PROC_PID_CPUSET=y
root@orin-desktop:~#
root@orin-desktop:~# zcat /proc/config.gz | grep -i cgroup
CONFIG_CGROUPS=y
CONFIG_BLK_CGROUP=y
CONFIG_CGROUP_WRITEBACK=y
CONFIG_CGROUP_SCHED=y
CONFIG_CGROUP_PIDS=y
# CONFIG_CGROUP_RDMA is not set
CONFIG_CGROUP_FREEZER=y
CONFIG_CGROUP_HUGETLB=y
CONFIG_CGROUP_DEVICE=y
CONFIG_CGROUP_CPUACCT=y
CONFIG_CGROUP_PERF=y
CONFIG_CGROUP_BPF=y
}}}
And I have executed the the workloads by Enabling (by default it is enabled) , disabling and build as module.
When I used the image by disabling these configs halted due mount issue in booting stage (Screenshot Attached).

Warm Regards,
Shreyas

Hi,
It seems like some paths are missing. Is the pip environment run like a docker? Probably certain paths are not included in the environment.

Might be similar in nature but pip environment has only dealt with python dependencies only and docker support full OS.
Can you please elaborate on which Path is required to include in the environment ?

Hi,
From the dmesg, it looks like the paths are absent:

/sys/fs/cgroup/
/sys/fs/cgroup/systemd

Hi DaneLLL,

/sys/fs/cgroup/ is present
/sys/fs/cgroup/systemd is not present

Sharing below information

root@orin-desktop:/var/log# mount | grep cgroup
cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot)
Note - here cgroup is not mounted with cpuset

Nothing is there about cpuset
root@orin-desktop:/var/log# mount | grep cpuset
{{
No O/P
}}
Trying to mount it manually but failed “mount point does not exist” error
root@orin-desktop:/var/log# mount -t cgroup -o cpuset none /sys/fs/cgroup/cpuset
mount: /sys/fs/cgroup/cpuset: mount point does not exist.

Regards,
Shreyas

Hi,
Please share more information about ARM Workload execution. Not sure but it sounds to be a debug tool such as ARM DS5.

Hi DaneLLL,

Following commands executed to execute the ARM Workloads on Orin AGX from Server End

$ git clone git@github.com:ARM-software/workload-automation.git workload-automation
$ cd workload-automation/

Note - For configuring and setting up the pip environment setup, followed below link to install essentials python3 packages.*
User Information — wa 3.4.0.dev1 documentation

$ pipenv sync && pipenv shell

Added orin credentials information in config.yaml file under config directory

$ cat configs/config.yaml
device: ‘generic_linux’

device_config:
host: ‘192.168.1.21’
username: ‘root’
password: ‘orin’

$ wa run dhrystone -f -c configs/config.yaml

Warm Regards,
Shreyas

Hi,
Would suggest try Jetpack 5.1.3 which is Kernel 5.10+Ubuntu 20.04. We don’t have experience about the application. Looks like it doesn’t work on Jetpack 6.0GA(K5.15+Ubuntu 22.04). Suggest try Jetpack 5 for comparison.

Hi Dane,

I will try with Jetpack 5.1.3 ( Kernel 5.10+Ubuntu 20.04) and check this cgoup and cpuset kconfig information. Apart from that I will execute the same workload too

Regards,
Shreyas

Hi Dayne,

I have flashed JetPack 5.1.3 using sdkmanager on Jetson ORIN AGX successfully. Below is the details about the system
{{{
root@ubuntu:~# cat /etc/os-release
NAME=“Ubuntu”
VERSION=“20.04.6 LTS (Focal Fossa)”
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME=“Ubuntu 20.04.6 LTS”
VERSION_ID=“20.04”
HOME_URL=“https://www.ubuntu.com/
SUPPORT_URL=“https://help.ubuntu.com/
BUG_REPORT_URL=“Bugs : Ubuntu
PRIVACY_POLICY_URL=“https://www.ubuntu.com/legal/terms-and-policies/privacy-policy
VERSION_CODENAME=focal
UBUNTU_CODENAME=focal
root@ubuntu:~# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 20.04.6 LTS
Release: 20.04
Codename: focal
root@ubuntu:~# uname -r
5.10.192-tegra
root@ubuntu:~# uname -a
Linux ubuntu 5.10.192-tegra #1 SMP PREEMPT Mon Feb 19 20:19:53 PST 2024 aarch64 aarch64 aarch64 GNU/Linux
root@ubuntu:~#
}}}
Then I executed the workloads from pip environment and facing below issue
{{{
ERROR Connection lost: [Errno None] Unable to connect to port 22 on 192.168.1.21
}}}

Although I have enabled below configuration on sshd_config file under /etc/ssh/ directory
{{{
PermitRootLogin yes
PasswordAuthentication yes
}}}
After that I restarted the ssh service (as per my understanding after enabling this is worked properly, even I have tried new ethernet cables)
Kindly let me know, how to proceed further

Regards,
Shreyas

Hi,
Does it work if you run it on AGX Orin developer kit? Not sure why it needs ssh login. If you run it on the device directly, it may not be triggered.

This part I am not getting Dane, could you please little elaborate this description

Regards,
Shreyas

Hi,
We are wondering why ssh is required. Do you have idea?

Hi Dane,

SSH is required because we are running the workloads from pip Environment and collecting the results of workloads execution, then copy this to our server.
We have automated the setup, then through pip environment we logged in ORIN AGX SoCs through root user.
But some issue is there, So again I will reflash the image and verify it, is this issue persistent or not ?

Regards,
Shreyas

There is no update from you for a period, assuming this is not an issue anymore.
Hence, we are closing this topic. If need further support, please open a new one.
Thanks

Is this still an issue to support? Any result can be shared?