Regarding the AGX Xavier GPU memory?

I have a question regarding the AGX Xavier memory uses. Currently, I am using 1080 Ti GPU for my application. It has 11 GB memory which means that I can run my PyTorch(with Cuda) program on it which does not exceed 11 GB memory.
Now, with AGX Xavier, how much big program i.e. a PyTorch(with Cuda) , can I run with AGX Xavier. I have gone through all the specs. but still not clear about it?

2 Likes

Jetson/Xavier platform has shared memory for CPU and GPU. With the AGX Xavier you can use up to 16/32GB (depending on the model you have) minus memory consumed by OS and your application.

4 Likes

@dkreutz Thanks a lot for the quick reply. Now it’s crystal clear.