Tensorflow is not using GPU on Jetson Orin

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
,
1

Hi ,
I have flashed Jetson Orin with jetpack 5.1.2 and installed TensorFlow 2.12.0+nv23.06 as per documentation : https://docs.nvidia.com/deeplearning/frameworks/install-tf-jetson-platform/index.html/. I have added CUDA to the library path as well.

tf_list_gpu
tf_list_gpu756×158 7.18 KB

I was able to list the device as well, while running application TensorFlow is not using GPU. Ideally TensorFlow should use GPU if it is available right?
should i specify anything in the application such that TensorFlow uses GPU always?
PFA for your reference:
bashrc
bashrc717×47 3.07 KB

image
image1086×943 36.6 KB

3

Hi,

It looks like your TensorFlow package does have CUDA support.
How do you check the model run on the CPU?

By default, the inference should run on the GPU.
But you can enable the device placement to check it further.

tf.debugging.set_log_device_placement(True)

Thanks.

5

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.