Good point about GPU memory bandwidth. The datasheets claim 32GB 256-bit LPDDR5 at 204.8 GB/s for Jetson AGX Orin and 8GB 128-bit GDDR6 at 224 GB/s for RTX 3050. A small bandwidth penalty for Orin, but much larger fast memory.
Isn’t the most current CUDA version available for Jetson Orin too?