Performance in Xavier

Autonomous Vehicles DRIVE AGX Xavier DRIVE AGX Xavier General
1

Please provide the following info (check/uncheck the boxes after creating this topic):
Software Version
DRIVE OS Linux 5.2.6
DRIVE OS Linux 5.2.0
[yes] DRIVE OS Linux 5.2.0 and DriveWorks 3.5
NVIDIA DRIVE™ Software 10.0 (Linux)
NVIDIA DRIVE™ Software 9.0 (Linux)
other DRIVE OS version
other

Target Operating System
[yes] Linux
QNX
other

Hardware Platform
[yes] NVIDIA DRIVE™ AGX Xavier DevKit (E3550)
NVIDIA DRIVE™ AGX Pegasus DevKit (E3550)
other

SDK Manager Version
[yes] 1.6.0.8170
other

Host Machine Version
[yes] native Ubuntu 18.04
other

Hello, how can I get utilization about gpu and dla core in Xavier?
Is There nvidia-smi like in Xavier?
I install gdm3 in Xavier and if gdm3 will affect performance?
I have a model which run in 3090(trt7.2) costing 8ms, but in Xavier(trt6.3) consting56ms, is it normal?

3

Dear @wang_chen2,
how can I get utilization about gpu and dla core in Xavier?
Is There nvidia-smi like in Xavier?

There is no nvidia-smi tool for AGX. You can check tegrastats to know iGPU utilization. There is no tool which shows DLA core utilization percentage, However, You can use NSight systems(https://developer.nvidia.com/nsight-systems) to know if DLA is being used and also CUDA API trace.

I install gdm3 in Xavier and if gdm3 will affect performance?

If you use iGPU for computation and the same is used for display, You can expect to have some perf drop as the same GPU is used for both display and computation. Please check if you notice any difference with and without display.

I have a model which run in 3090(trt7.2) costing 8ms, but in Xavier(trt6.3) consting56ms, is it normal?

Xavier Devkit has only iGPU. iGPU is less powerful(less SMs and old architecture) compared to RTX3090 discrete GPU. So it is expected. Please check using INT8 precision to boost performance further using iGPU.

4

Hi， @SivaRamaKrishnaNV，
Thanks for your reply.
Can you help me to explain the meanings about the output of tegrastatus. Some abbreviations are hard to understand.
What is iGPU, and what is the different between GPU?

5

Dear @wang_chen2,
Could you check https://docs.nvidia.com/drive/drive-os-5.2.0.0L/drive-os/index.html#page/DRIVE_OS_Linux_SDK_Development_Guide/Utilities/util_tegrastats.html#wwconnect_header to understand tegrastats output.

iGPU(integrated GPU) is a GPU which is integrated into Xavier SoC.

6

Hi， @SivaRamaKrishnaNV，
I get it. Thank you very much.