# Enabling Orin Dev Kit Ethernet over PCIe

**URL:** <https://forums.developer.nvidia.com/t/enabling-orin-dev-kit-ethernet-over-pcie/232901>\
**Category:** Jetson AGX Orin\
**Tags:** nvbugs, pcie, ethernet\
**Created:** [November 4, 2022, 11:16pm UTC](https://forums.developer.nvidia.com/t/enabling-orin-dev-kit-ethernet-over-pcie/232901 "2022-11-04T23:16:29Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![predrag12](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@predrag12](https://forums.developer.nvidia.com/u/predrag12)\
**Post date:** [November 4, 2022, 11:16pm UTC](https://forums.developer.nvidia.com/t/enabling-orin-dev-kit-ethernet-over-pcie/232901/1 "2022-11-04T23:16:29Z")

</div>

Hi,

Following [Bringing up an Ethernet Interface over PCIe](https://docs.nvidia.com/jetson/archives/r35.1/DeveloperGuide/text/SD/Communications/PcieEndpointMode.html#bringing-up-an-ethernet-interface-over-pcie) and using tvnet in order to check bulk transfer between Orin EP and PC RP, am getting very low speeds relative to theoretical for PCIe 4.0 x8 which is ~16GB/s or ~ **128Gb/s**. Uplink and downlink depending on which side initiates transfer with iperf3 are only **259-481Mb/s**.

iperf3 -c 192.168.2.1  
[ID] Interval Transfer Bitrate Retr  
[5] 0.00-10.04 sec 310 MBytes 259 Mbits/sec 0 sender  
[5] 0.00-10.04 sec 310 MBytes 259 Mbits/sec receiver

iperf3 -c 192.168.2.2  
[ID] Interval Transfer Bitrate Retr  
[5] 0.00-10.00 sec 574 MBytes 481 Mbits/sec 86 sender  
[5] 0.00-10.01 sec 571 MBytes 479 Mbits/sec receiver

From some other posts **40Gb/s** should be expected, since virtual Ethernet transfer is less efficient than direct DMA calls (~128Gb/s), but measured speeds are 100x smaller than that. From logs, [RP.eth0.log](https://forums.developer.nvidia.com/uploads/short-url/xtjoos7Pmaq7DW0tsbqmWSncbLk.log) (6.2 KB)  
lists LnkSta: Speed **8GT/s** Width **x8** and [EP.eth1.log](https://forums.developer.nvidia.com/uploads/short-url/prEqUOBasE9gN22309ghlq8pouR.log) (6.3 KB) lists LnkSta: Speed **2.5GT/s** Width **x1** , which seems odd, but even with PCIe 4.0 x1 2GB/s should be **16Gb/s**.

Does virtual Ethernet use DMA and does it require patching Orin EP kernel, or PC RP kernal or tvnet, for PCIe or Ethernet buffer sizes etc.?

Thanks.

---

<div class="post-metadata">

**Author:** ![DaneLLL](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/danelll/32/14043_2.png) [@DaneLLL](https://forums.developer.nvidia.com/u/DaneLLL)\
**Post date:** [November 7, 2022, 1:50am UTC](https://forums.developer.nvidia.com/t/enabling-orin-dev-kit-ethernet-over-pcie/232901/3 "2022-11-07T01:50:55Z")

</div>

Hi,  
There is a known issue about PCIe throughput on Jetpack 5.0.2. There is a relevant topic:  
[R35.1 PCIe i210 throughput slow](https://forums.developer.nvidia.com/t/r35-1-pcie-i210-throughput-slow/230951)

We are checking this and trying to have improvement in next release.

---

<div class="post-metadata">

**Author:** ![predrag12](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@predrag12](https://forums.developer.nvidia.com/u/predrag12)\
**Post date:** [November 7, 2022, 5:18pm UTC](https://forums.developer.nvidia.com/t/enabling-orin-dev-kit-ethernet-over-pcie/232901/5 "2022-11-07T17:18:51Z")

</div>

Hi,

The referred topic is custom carrier board and physical NIC chip, so is that issue related to this topic, Dev Kit PCIe EP virtual Ethernet, by association because of the same underlying PCIe instability and not because how the tvnet driver is using PCIe? Do you have any noncommittal projection when the next release might be, or perhaps if there are any kernel patches that can be tried at the moment?

Thanks.

---

<div class="post-metadata">

**Author:** ![predrag12](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@predrag12](https://forums.developer.nvidia.com/u/predrag12)\
**Post date:** [November 21, 2022, 4:21pm UTC](https://forums.developer.nvidia.com/t/enabling-orin-dev-kit-ethernet-over-pcie/232901/6 "2022-11-21T16:21:38Z")

</div>

Hi,

Any update on the expectation of a tentative official release date or perhaps availability of prerelease patch? There are two observations that may or may not be related.

The uplink and downlink speed while 2% of theoretical change 50% depending on which side initiates iperf3, is there a way to check raw PCIe EP/DMA speed without using tvnet driver?

The EP shows LnkSta: Speed 2.5GT/s (downgraded), Width x1 (ok) instead of x8 (PCIe connector width) on the PC RP side. Is the root cause same as referred topic, or is there something else as well that needs to be patched meanwhile in the kernel config or source code?

Thanks.

---

<div class="post-metadata">

**Author:** ![DaneLLL](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/danelll/32/14043_2.png) [@DaneLLL](https://forums.developer.nvidia.com/u/DaneLLL)\
**Post date:** [January 30, 2023, 8:36am UTC](https://forums.developer.nvidia.com/t/enabling-orin-dev-kit-ethernet-over-pcie/232901/8 "2023-01-30T08:36:40Z")

</div>

Hi,  
Please upgrade to Jetpack 5.1 and try again.

---

<div class="post-metadata">

**Author:** ![system](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/system/32/68080_2.png) [@system](https://forums.developer.nvidia.com/u/system)\
**Post date:** [February 13, 2023, 8:37am UTC](https://forums.developer.nvidia.com/t/enabling-orin-dev-kit-ethernet-over-pcie/232901/9 "2023-02-13T08:37:35Z")

</div>

Closed on February 13, 2023, 8:37am UTC

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.
