Hi,
A user has shared a working design for Jetson Nano. It is similar for Xavier NX. Please take a look:
USB 2.0 Functionality - #15 by arvindprksh
You would need to have a proper design of VBUS and ID pins on the custom board, and define extcon states correctly in device tree.