Individual GPU core loads

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
1

Hi

We would like to access the individual loads of each GPU core in a C++ program

we already have a way to access the individual load of each CPU and the total load of all GPU’s. but would like something more in depth on GPU usage

how do we check the load of individual cores?

thanks

etay markman

4

Hi,

Do you want to separate the resources for different tasks?
Currently, we only provide overall GPU core usage with tegrastats.

$ sudo tegrastats

Thanks.

5

Thanks for answering

Yes, we want to separate the resources for different tasks so we can maximize the use of available hardware,

hence why we want to be able to monitor our usage of the resources

sincerely

Etay Markman

6

Hi, do you have anything that can help up separate the GPU resources?

7

Hi,

We don’t have a profiler to monitor specific GPU cores.

The simplest way to share the GPU resources from tasks is to use different streams so they can run in parallel.
Does this meet your requirements?

Thanks.

8

“We don’t have a profiler to monitor specific GPU cores.”

wow, not even simply monitor which ones are active?

“The simplest way to share the GPU resources from tasks is to use different streams so they can run in parallel.”
do you guys have a good example code for that?

“Does this meet your requirements?”
once you give an example we will look at it and tell you

9

Hi,

GPU is different from the CPU.

For Orin, it has 2048 GPU cores so usually we check the overall utilization.
This info can simply be found from tegrastats.

Multiple streams are common to run concurrent tasks on GPU.
You can find a basic sample below:

Thanks.

11

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.