For training, TAO Toolkit is supported on discrete GPUs, such as H100, A100, A40, A30, A2, A16, A100x, A30x, V100, T4, Titan-RTX, and Quadro-RTX, etc.
TAO docker is designed to run on x86 systems with discrete GPUs. It was mentioned in an old document. NVIDIA TAO - NVIDIA Docs
→ Overview - NVIDIA Docs
The TAO docker cannot support running on arm-based devices yet.
Since Jetson devices are arm based, so the tao docker in TAO Toolkit | NVIDIA NGC do not support running on them.
But for deployment, users can run in any devices. In Jetson devices, you can generate engine and run inference with it. More can be found in TAO Deploy Installation - NVIDIA Docs,
GitHub - NVIDIA/tao_deploy: Package for deploying deep learning models from TAO Toolkit and Tao-deploy on Orin AGX CLI Error - #14.