No network in DRIVE OS 6.0.5 on AGX Orin

The machine without networking:

adi@tegra-ubuntu:~$ cat /etc/nvidia/version-ubuntu-rootfs.txt 
6.0.5.0-31732390
adi@tegra-ubuntu:~$ sudo bash /etc/systemd/scripts/nv_aurix_check_fw.sh 
[sudo] password for adi: 
starting Aurix FW checking...
Checking arguments...
Checking Ping to AURIX 
***************************
Ping to AURIX failed. Exit Aurix Updater.
adi@tegra-ubuntu:~$ 

The machine with working network:

adi@rc:~$ cat /etc/nvidia/version-ubuntu-rootfs.txt 
6.0.5.0-31732390
adi@rc:~$ sudo bash /etc/systemd/scripts/nv_aurix_check_fw.sh 
[sudo] password for adi: 
starting Aurix FW checking...
Checking arguments...
Checking Ping to AURIX 
Ping to Aurix successful
Flashed UPDATE FW version is 1.48.01.00
Aurix Update : Main FW selected: AFW
Aurix Update : Alternate FW selected: NV
Rootfs FW version is 5.06.05.0, DRIVE-V6.0.5-P3710-AFW-Aurix-StepB-5.06.05
Response_From_Aurix
Flashed FW version is 5.06.05.00
Aurix is booted with Latest FW
Rootfs UPDATE FW version is 1.48.01.0
Flashed UPDATE FW version is 1.48.01.00
Aurix is flashed with Latest UPDATE FW

Please try to check the version with “version” command in Aurix Console.

Shell>version

DDPX Aurix Serial Console
P3710-A05
with TLF35584 B/C-Step
SW Version  1.46.12
DRIVE-v6.x.x-P3710-NV-Aurix-IFW-StepB-1.46.12
Patch 0
* P3710-TS5 bringup firmware
* this binary does not support P3710 TS1 ~ TS3

TC397 Step BD

Any advice on this?

As I posted at Bootburn error decoding utf-8 - #24 by VickNV, let’s follow up on this issue with that topic. We are still checking internally on how to upgrade the firmware.

@jace.mogill1
From the syslog, looks like MAC addresses are missing from the Tegra:

Oct 21 03:08:50 tegra-ubuntu kernel: [ 1.817831] ether_get_mac_address_dtb: bad mac address at /chosen/nvidia,ether-mac0: NULL.
Oct 21 03:08:50 tegra-ubuntu kernel: [ 1.817843] nvethernet 2310000.ethernet: No MAC address in local DT!
Oct 21 03:08:50 tegra-ubuntu kernel: [ 1.817844] nvethernet 2310000.ethernet: failed to get MAC address

From the Tegra console please do this to confirm if MAC addresses are there or not.

cat /proc/device-tree/chosen/nvidia,ether-mac0
cat /proc/device-tree/chosen/nvidia,ether-mac2
cat /proc/device-tree/chosen/nvidia,ether-mac4
cat /proc/device-tree/chosen/nvidia,ether-mac6
cat /proc/device-tree/chosen/nvidia,ether-mac8

If these are empty, you will need to be re-flashed. Please get the starting MAC address with the following command also from the Tegra:

sudo i2cdump -y -r 0x44-0x49 0 0x50

This issue may be the root cause of firmware isn’t upgraded automatically after flashing DRIVE OS 6.0.5 in Bootburn error decoding utf-8.

None of the ether-mac# files exist.

adi@tegra-ubuntu:~$ sudo i2cdump -y -r 0x44-0x49 0 0x50
No size specified (using byte-data access)
     0  1  2  3  4  5  6  7  8  9  a  b  c  d  e  f    0123456789abcdef
40:             98 d9 85 2d b0 48                          ???-?H      

I’m not sure what you mean by “need to be re-flashed”, I’ve repeatedly tried flashing this machine with the SDKManager using 6.0.4 and 6.0.5, scripts you recommended, and the container, but re-flashing this machine is not fixing this problem.

I meant reflashing the MAC addresses instead of DRIVE OS.
Thanks for the information. will get back to you.

@jace.mogill1
Please help run “inforom dump” in Aurix Console and provide the output. Thanks.

Shell>inforom dump
Reading data from address 0 ~ 999

54 41 4F 01 00 40 00 40 1F 53 
59 53 40 00 31 4D 53 80 00 57 
53 00 20 1F FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF 2A 53 59 53 06 00 40 
00 16 06 22 20 30 30 44 2D 30 
31 30 30 2D 30 31 37 33 36 2D 
30 34 39 00 00 00 00 00 00 41 
4E 30 30 31 30 30 30 32 32 34 
32 31 34 31 00 00 00 53 45 41 
00 00 00 00 00 FF FF AC 31 4D 
53 02 00 78 00 35 53 54 2D 30 
30 30 30 2D 38 31 37 33 36 2D 
39 39 36 00 00 00 00 00 00 04 
41 41 4E 36 32 36 30 30 30 32 
32 31 32 31 34 31 00 00 00 00 
00 00 00 53 45 29 3D 63 2D B0 
48 00 00 05 FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF AC FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
FF FF FF FF FF FF FF FF FF FF 
Shell>

@jace.mogill1

{
“customer-data-signed”: {

            "macInUseCount": 5,
            "macId0": "mac0 0x48B02D633d29 2",
            "macId1": "mac1 0x48B02D633d2B 2",
            "macId2": "mac2 0x48B02D633d2D 2",
            "macId3": "mac3 0x48B02D633d2F 2",
            "macId4": "mac4 0x48B02D633d31 2"
    }

}

  • From Aurix console put the board in recovery:
    > tegrarecovery x1 on
    > tegrareset x1

  • Then from another window on the host make sure two nvidia USB devices appear:
    $ lsusb -d 0955:

  • flash with MAC addresses reprogrammed
    $ cd ~/nvidia/nvidia_sdk/DRIVE_OS_6.0.5_SDK_Linux_DRIVE_AGX_ORIN_DEVKITS/DRIVEOS/drive-foundation
    $ make/bind_partitions -b p3710-10-s05 linux
    $ cd tools/flashtools/bootburn
    $ ./bootburn.py -b p3710-10-s05 -B qspi --customer-data {Absolute Path to}/customer_data_orin.json

  • Once flashing is complete do the followng on the target again to confirm MAC addresses are present:
    cat /proc/device-tree/chosen/nvidia,ether-mac0
    cat /proc/device-tree/chosen/nvidia,ether-mac2
    cat /proc/device-tree/chosen/nvidia,ether-mac4
    cat /proc/device-tree/chosen/nvidia,ether-mac6
    cat /proc/device-tree/chosen/nvidia,ether-mac8

Because the serial number does not appear on the Orin itself, only on the cardboard shipping box, I don’t know if the machine we’re working on now is S/N 1412422000100 or 1412422000069. How can I confirm the S/N for this hardware?

We already confirmed it’s 1412422000100 so you can use the JSON file provided.

Besides reprogramming MAC address, please elaborate on what had been done on the system before the first time aware of network issues and help us figure out why the MAC address got erased.

Except flashing with sdkmanager or docker (following DRIVE OS 6.0.5 Installation Guide for NVIDIA Developers), had you ever run any commands manually (e.g. bootburn.py)? Have you ever run bootburn command with --clean option?

does this have anything to do with this MAC issue?

After rebooting the machine comes up with a working network and the MAC addresses are:

adi@tegra-ubuntu:~$ cat /proc/device-tree/chosen/nvidia,ether-mac0                                                                       
48:b0:2d:63:3d:29
adi@tegra-ubuntu:~$ cat /proc/device-tree/chosen/nvidia,ether-mac2                                                                       
48:b0:2d:63:3d:2b
adi@tegra-ubuntu:~$ cat /proc/device-tree/chosen/nvidia,ether-mac4                                                                       
48:b0:2d:63:3d:2d
adi@tegra-ubuntu:~$ cat /proc/device-tree/chosen/nvidia,ether-mac6                                                                       
48:b0:2d:63:3d:2f
adi@tegra-ubuntu:~$ cat /proc/device-tree/chosen/nvidia,ether-mac8                                                                       
48:b0:2d:63:3d:31

I never issued commands from the NVidia distributions that were not provided by you, I relied entirely on SDKmanager. The network on this machine was working until the SDKmanager was used to update it to DRIVE OS 6.0.4. The system came up with the 6.0.4 desktop, but no network.

The system date is now reporting Jan 1 1970, I presume without the network the OS install skipped NTP and has other problems. Does this system need to be re-flashed to fix the OS?

Is there any remaining network issue?

The network interface itself appears to work.
Do I need to start another ticket just to ask if I need to re-flash this machine because the OS did not install properly due to this problem?

I don’t know how the MAC addresses were wiped out previously.
After reprogramming MAC addresses, now please try if able to check and update the firmware with the method (confirm no “Ping to AURIX failed. Exit Aurix Updater”).

$ sudo /bin/bash /etc/systemd/scripts/nv_aurix_check_fw.sh
$ sudo /bin/bash /etc/systemd/scripts/nv_aurix_check_fw.sh -auto_update

adi@tegra-ubuntu:~$ sudo bash /etc/systemd/scripts/nv_aurix_check_fw.sh 
[sudo] password for adi: 
starting Aurix FW checking...
Checking arguments...
Checking Ping to AURIX 
Ping to Aurix successful
Flashed UPDATE FW version is 1.48.01.00
Aurix Update : Main FW selected: AFW
Aurix Update : Alternate FW selected: NV
Rootfs FW version is 5.06.05.0, DRIVE-V6.0.5-P3710-AFW-Aurix-StepB-5.06.05
Response_From_Aurix
Flashed FW version is 5.06.05.00
Aurix is booted with Latest FW
Rootfs UPDATE FW version is 1.48.01.0
Flashed UPDATE FW version is 1.48.01.00
Aurix is flashed with Latest UPDATE FW
adi@tegra-ubuntu:~$ sudo /bin/bash /etc/systemd/scripts/nv_aurix_check_fw.sh -auto_update
starting Aurix FW checking...
Checking arguments...
Checking Ping to AURIX 
Ping to Aurix successful
Flashed UPDATE FW version is 1.48.01.00
Aurix Update : Main FW selected: AFW
Aurix Update : Alternate FW selected: NV
Rootfs FW version is 5.06.05.0, DRIVE-V6.0.5-P3710-AFW-Aurix-StepB-5.06.05
Response_From_Aurix
Flashed FW version is 5.06.05.00
Aurix is booted with Latest FW
Rootfs UPDATE FW version is 1.48.01.0
Flashed UPDATE FW version is 1.48.01.00
Aurix is flashed with Latest UPDATE FW
adi@tegra-ubuntu:~$ 

The network issue seems to be fixed by reprogramming MAC addresses (still don’t know what’s done previously wiped them out though).
You can use flash to it with docker again. If no network issue, everything should be good.