Hi,
Is the FTDI device connected to Xavier NX developer kit? For using Xavier NX developer kit, there’s a power limit in the 4 type-A ports:
3x USB 3 Camera one freezes - #10 by DaneLLL
Not sure if it is possible to have external power supply to the device for a try.