Deep Learning Inference Speed - Jetson Xavier versus GPU cluster

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Xavier
1

Hi,

For deep learning inference speed, would the Jetson Xavier be faster than using a cluster of GPUs. I need to analyse 3468x5472 pixel images as fast as possible.

Thank you,

2

Hi,

Inference performance depends on which model do you use.
Here are some performance report of Xavier for your reference:
https://developer.nvidia.com/embedded/jetson-agx-xavier-dl-inference-benchmarks

Not sure which generation of your GPU cluster is.
Our suggestion is to apply the similar benchmark on your GPU cluster for comparison directly.

Thanks.

3

I would suggesting running ML-Perf inference benchmark for comparison.

1 Like