Record ram usage and gpu mem usage

A question is asked here.

Any advice is welcome. thank you.

For Jetson platform, please refer to Tegrastats Utility doc: Tegrastats Utility — Jetson Linux
Developer Guide 34.1 documentation (nvidia.com)

Hi, kayccc, thank you for you info.
But what if I’d like to know specific process resource consumption(RAM and GPU mem), I mean I want to record specific model ram & gpu mem consumption when inferring, The more accurate the better.
So are there any APIs to be called for this purpose?

Hi,

You can find an example below:

Thanks.

Thank you @AastaLLL for your quick response.
From the link you provide to me, I see we can get gpu mem free & all gpu mem in the system via cudaGetMemInfo API just as I said from the link I post.

Now the question is how can I get mem usage in view of RAM. do I get the right way to query RAM usage.
Thanks.

Hi,

Jetson is a shared memory system, which indicates that the physical memory is used by both CPU and GPU.
So the available memory for CUDA will be similar to the physical memory that remains.

Thanks.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.