According to this table, the orange light should come on on the right side when connected with 100 megabytes, but it is strange that it doesn’t.
Can you test it yourself with the xavier nx devkit?
I have a JNX dev kit which has 4.6 JetPack.
An amber LED shows link activity and a green LED does link speed.
when 1 Gbps, green LED is ON and when 10 or 100 Mbps, it is OFF.
You can test it with ethtool command: $ sudo ethtool -s eth0 speed 10/100/1000 duplex full autoneg on
And check whether kernel detects the link speed: $ sudo cat /sys/class/net/eth0/speed