Jetson orin (devkit 64GB) cannot run the cross compiled program of ue5.1.1

We found a confusing issue:
When running UE5.1.1’s cross compilation program, orin devkit with 32GB of memory can run. but the device with 64GB of memory cannot run, with the error “cannot create a Vulkan device, Try updating your video driver to a more recent version”.

both 32GB and 64GB device are jetPack5.1.1, even ./flash.sh clone and flash .img(So we can assume that the components and packages are the same
).We also tested two 32GB devices and two 64GB devices.

The right side of the image shows the logs and error reports of 64GB running failures, while the left side shows the logs of 32GB successfully running:


Is there any solution to this problem?

Hi,
Please compile it on Orin 64GB device and check if the issue occurs. It may be an issue in the cross compilation environment.

Sorry, we are editing the project on the Windows operating system and cross compiling it to the LinuxArm64 version. There is no way to compile on orin 64GB.

And during cross compilation, we did not set any special configurations, just followed the default configuration of UnrealEngine5.

Hi,
We don’t have experience in the environment. Would need other users to provide suggestion. Generaly we use host PC in Linux Ubuntu OS.

Looks like the error is related to DRAM size. May check if there is configuration about memory size that you can set up and try.

1 Like

I have no idea, but is the same exact binary executable that works on the 32GB model used in the case of the 64GB model that does not work? If so, then the mention of Vulkan implies maybe it is just a missing library. If you were to gather this information, once on each the working and non-working units, along with making sure these logs are labelled clearly as to which one it is, what is the output for each given (you might need to “sudo apt-get install mesa-utils”):

head -n 1 /etc/nv_tegra_release
glxinfo | egrep -i '(version|nvidia)'
dpkg -l | egrep -i 'vulkan'

Thanks, I will try.

sorry, clarify one mistake, left part is 64GB (fail), and right is 32GB (it work success)

Have you been able to run the comparisons on the AGX Orin 32GB and 64GB devices to see what’s going on?

This is not a solution if the user hasn’t confirmed any details. Can someone like @DaneLLL or others actually run these tests since you have a bunch of these devices to figure out what’s wrong?

Hi,
We would need a method to replicate the error. Do you hit the issue while building and running our default sample?
Vulkan SC Samples — Jetson Linux Developer Guide documentation

I don’t personally have the hardware to test. It would be up to @1903009055 to examine that output to see what the difference is, perhaps posting the result here. The information given is for examination, and would not actually change anything other than giving information.

As per my post, I am unable to get those samples running on a fresh install of Jetpack 5.1.2. I haven’t found anyone who has on the 64GB Orin AGX.

I ran the following commands on my AGX 64GB Orin and received this response:

nvidia@ubuntu:~$ head -n 1 /etc/nv_tegra_release
# R35 (release), REVISION: 4.1, GCID: 33958178, BOARD: t186ref, EABI: aarch64, DATE: Tue Aug  1 19:57:35 UTC 2023

nvidia@ubuntu:~$ glxinfo | egrep -i '(version|nvidia)'
server glx vendor string: NVIDIA Corporation
server glx version string: 1.4
client glx vendor string: NVIDIA Corporation
client glx version string: 1.4
GLX version: 1.4
OpenGL vendor string: NVIDIA Corporation
OpenGL renderer string: NVIDIA Tegra Orin (nvgpu)/integrated
OpenGL core profile version string: 4.6.0 NVIDIA 35.4.1
OpenGL core profile shading language version string: 4.60 NVIDIA
OpenGL version string: 4.6.0 NVIDIA 35.4.1
OpenGL shading language version string: 4.60 NVIDIA
OpenGL ES profile version string: OpenGL ES 3.2 NVIDIA 35.4.1
OpenGL ES profile shading language version string: OpenGL ES GLSL ES 3.20
    GL_EXT_shader_group_vote, GL_EXT_shader_implicit_conversions, 

nvidia@ubuntu:~$ dpkg -l | egrep -i 'vulkan'
ii  libvulkan-dev:arm64                          1.2.131.2-1                          arm64        Vulkan loader library -- development files
ii  libvulkan1:arm64                             1.2.131.2-1                          arm64        Vulkan loader library
ii  nvidia-l4t-libvulkan                         35.4.1-20230801124926                arm64        NVIDIA Vulkan Loader Package
ii  nvidia-l4t-vulkan-sc                         35.4.1-20230801124926                arm64        NVIDIA Vulkan SC run-time package
ii  nvidia-l4t-vulkan-sc-dev                     35.4.1-20230801124926                arm64        NVIDIA Vulkan SC Dev package
ii  nvidia-l4t-vulkan-sc-samples                 35.4.1-20230801124926                arm64        NVIDIA Vulkan SC samples package
ii  nvidia-l4t-vulkan-sc-sdk                     35.4.1-20230801124926                arm64        NVIDIA Vulkan SC SDK package
ii  vulkan-tools                                 1.2.131.1+dfsg1-1                    arm64        Miscellaneous Vulkan utilities
ii  vulkan-utils                                 1.2.131.1+dfsg1-1                    all          transitional package

Here is how to replicate the errors I ran into here on another ticket and this one:

cd LinuxArm64
chmod +x TestProject2-Arm64.sh
./TestProject2-Arm64.sh

Because of some problems, the 64GB Orin is back to Jetpack5.1. I will update to 5.1.1 or 5.1.2 later.
But in jetpack5.1, the 64GB Orin also cannot run UE_EXE both(@rich25 [quote=“rich25, post:15,topic:273762”]Unreal Third Person base export to LinuxAArch64[/quote]) and our program, the same error “cannot create a Vulkan device, Try updating your video driver to a more recent version”.

this is Orin AGX 64GB jetpack5.1 info:

nvidia@nvidia-desktop:~/UE_EXE/LinuxArm64$ head -n 1 /etc/nv_tegra_release 
# R35 (release), REVISION: 2.1, GCID: 32413640, BOARD: t186ref, EABI: aarch64, DATE: Tue Jan 24 23:38:33 UTC 2023

nvidia@nvidia-desktop:~/UE_EXE/LinuxArm64$ glxinfo | egrep -i '(version|nvidia)'
server glx vendor string: NVIDIA Corporation
server glx version string: 1.4
client glx vendor string: NVIDIA Corporation
client glx version string: 1.4
GLX version: 1.4
OpenGL vendor string: NVIDIA Corporation
OpenGL renderer string: NVIDIA Tegra Orin (nvgpu)/integrated
OpenGL core profile version string: 4.6.0 NVIDIA 35.2.1
OpenGL core profile shading language version string: 4.60 NVIDIA
OpenGL version string: 4.6.0 NVIDIA 35.2.1
OpenGL shading language version string: 4.60 NVIDIA
OpenGL ES profile version string: OpenGL ES 3.2 NVIDIA 35.2.1
OpenGL ES profile shading language version string: OpenGL ES GLSL ES 3.20
    GL_EXT_shader_group_vote, GL_EXT_shader_implicit_conversions, 
    
nvidia@nvidia-desktop:~/UE_EXE/LinuxArm64$ dpkg -l | egrep -i 'vulkan'
ii  libvulkan-dev:arm64                        1.2.131.2-1                          arm64        Vulkan loader library -- development files
ii  libvulkan1:arm64                           1.2.131.2-1                          arm64        Vulkan loader library
ii  nvidia-l4t-libvulkan                       35.2.1-20230124153320                arm64        NVIDIA Vulkan Loader Package
ii  nvidia-l4t-vulkan-sc                       35.2.1-20230124153320                arm64        NVIDIA Vulkan SC run-time package
ii  nvidia-l4t-vulkan-sc-dev                   35.2.1-20230124153320                arm64        NVIDIA Vulkan SC Dev package
ii  nvidia-l4t-vulkan-sc-samples               35.2.1-20230124153320                arm64        NVIDIA Vulkan SC samples package
ii  nvidia-l4t-vulkan-sc-sdk                   35.2.1-20230124153320                arm64        NVIDIA Vulkan SC SDK package
ii  vulkan-tools                               1.2.131.1+dfsg1-1                    arm64        Miscellaneous Vulkan utilities
ii  vulkan-utils      

jtop:


What does your 32GB AGX Orin outputs look like @1903009055 ? That’s what would really be helpful, especially if it’s working on there.

Here is my jtop info on my 64GB.

If you are referring to some differences under libraries, I don’t think this is the cause. Because in 64GB 5.1.1 and 5.1.2, the things under libraries are the same as 32GB. The current 64GB 5.1 is my colleague’s other operation…
I will update the 64GB Orin to 5.1.1 or 5.1.2 as soon as possible.

You’re saying the libraries match on both the 32GB and the 64GB?

32GB Orin jetpack 5.1.1 info:

nvidia@nvidia:~$ head -n 1 /etc/nv_tegra_release 
# R35 (release), REVISION: 3.1, GCID: 32827747, BOARD: t186ref, EABI: aarch64, DATE: Sun Mar 19 15:19:21 UTC 2023

nvidia@nvidia:~$ glxinfo | egrep -i '(version|nvidia)'
server glx vendor string: NVIDIA Corporation
server glx version string: 1.4
client glx vendor string: NVIDIA Corporation
client glx version string: 1.4
GLX version: 1.4
OpenGL vendor string: NVIDIA Corporation
OpenGL renderer string: NVIDIA Tegra Orin (nvgpu)/integrated
OpenGL core profile version string: 4.6.0 NVIDIA 35.3.1
OpenGL core profile shading language version string: 4.60 NVIDIA
OpenGL version string: 4.6.0 NVIDIA 35.3.1
OpenGL shading language version string: 4.60 NVIDIA
OpenGL ES profile version string: OpenGL ES 3.2 NVIDIA 35.3.1
OpenGL ES profile shading language version string: OpenGL ES GLSL ES 3.20
    GL_EXT_shader_group_vote, GL_EXT_shader_implicit_conversions, 

nvidia@nvidia:~$ dpkg -l | egrep -i 'vulkan'
ii  libvulkan-dev:arm64                        1.2.131.2-1                          arm64        Vulkan loader library -- development files
ii  libvulkan1:arm64                           1.2.131.2-1                          arm64        Vulkan loader library
ii  nvidia-l4t-libvulkan                       35.3.1-20230319081403                arm64        NVIDIA Vulkan Loader Package
ii  nvidia-l4t-vulkan-sc                       35.3.1-20230319081403                arm64        NVIDIA Vulkan SC run-time package
ii  nvidia-l4t-vulkan-sc-dev                   35.3.1-20230319081403                arm64        NVIDIA Vulkan SC Dev package
ii  nvidia-l4t-vulkan-sc-samples               35.3.1-20230319081403                arm64        NVIDIA Vulkan SC samples package
ii  nvidia-l4t-vulkan-sc-sdk                   35.3.1-20230319081403                arm64        NVIDIA Vulkan SC SDK package
ii  vulkan-tools                               1.2.131.1+dfsg1-1                    arm64        Miscellaneous Vulkan utilities
ii  vulkan-utils                               1.2.131.1+dfsg1-1                    all          transitional package

jtop


yes, we created the 32GB system img and flash its img into 64GB.
https://docs.nvidia.com/jetson/archives/r35.1/DeveloperGuide/text/SD/FlashingSupport.html#to-clone-a-jetson-device-and-flash

I flash the 32GB img into 64GB again, now the Orin AGX 64GB jetpack 5.1.1 info as folw:

nvidia@nvidia:~$ head -n 1 /etc/nv_tegra_release
# R35 (release), REVISION: 3.1, GCID: 32827747, BOARD: t186ref, EABI: aarch64, DATE: Sun Mar 19 15:19:21 UTC 2023
nvidia@nvidia:~$ 
nvidia@nvidia:~$ glxinfo | egrep -i '(version|nvidia)'
server glx vendor string: NVIDIA Corporation
server glx version string: 1.4
client glx vendor string: NVIDIA Corporation
client glx version string: 1.4
GLX version: 1.4
OpenGL vendor string: NVIDIA Corporation
OpenGL renderer string: NVIDIA Tegra Orin (nvgpu)/integrated
OpenGL core profile version string: 4.6.0 NVIDIA 35.3.1
OpenGL core profile shading language version string: 4.60 NVIDIA
OpenGL version string: 4.6.0 NVIDIA 35.3.1
OpenGL shading language version string: 4.60 NVIDIA
OpenGL ES profile version string: OpenGL ES 3.2 NVIDIA 35.3.1
OpenGL ES profile shading language version string: OpenGL ES GLSL ES 3.20
    GL_EXT_shader_group_vote, GL_EXT_shader_implicit_conversions, 
hud@hud-desktop:~$ 
hud@hud-desktop:~$ dpkg -l | egrep -i 'vulkan'
ii  libvulkan-dev:arm64                        1.2.131.2-1                           arm64        Vulkan loader library -- development files
ii  libvulkan1:arm64                           1.2.131.2-1                           arm64        Vulkan loader library
ii  nvidia-l4t-libvulkan                       35.3.1-20230319081403                 arm64        NVIDIA Vulkan Loader Package
ii  nvidia-l4t-vulkan-sc                       35.3.1-20230319081403                 arm64        NVIDIA Vulkan SC run-time package
ii  nvidia-l4t-vulkan-sc-dev                   35.3.1-20230319081403                 arm64        NVIDIA Vulkan SC Dev package
ii  nvidia-l4t-vulkan-sc-samples               35.3.1-20230319081403                 arm64        NVIDIA Vulkan SC samples package
ii  nvidia-l4t-vulkan-sc-sdk                   35.3.1-20230319081403                 arm64        NVIDIA Vulkan SC SDK package
ii  vulkan-tools                               1.2.131.1+dfsg1-1                     arm64        Miscellaneous Vulkan utilities
ii  vulkan-utils                               1.2.131.1+dfsg1-1                     all          transitional package

jtop