Either way should work. As you can see “Ubuntu packages are built for the following distros and architectures.” stated in melodic/Installation/Ubuntu - ROS Wiki.
Thank You. I did notice the wiki page says arm64 is supported but saw a lot of discussion related to cross-compiling too. So was not sure if Drive AGX Xavier needs it to be cross-compiled or the pre-compiled binaries available can work.