One core 100% IRQ some times

Infrastructure & Networking Adapters and Cables Ethernet Adapter Cards
21

а смысл переносить?
если они (интерапты) локально должны быть на CPU2 ? Что это даст?

22

Это тоже странная штука. Вот еще один сервер с идентичным конфигом. Там вообще нет интераптов :)

Screenshot 2022-09-17 195256
Screenshot 2022-09-17 1952561047×1396 391 KB

Кстати еще вспомнил, на одном из серверов, его графики тут приводил самыми первыми в итоге поменяли просто сетевую карту на Intel E810-C, проблема ушла сама собой.

23

Иногда помогало выйти с этого затыка. Ну, и еще был эксперимент, пытались трафик делить на 2 сетевуху, тогда ее интерапты перекидывали на второй проц. Но в итоге получалось только 86 Гбит/с в сумме.

25

First of all, you need select NPS1 in BIOS that mean one node per socket. Second, use set_irq_affinity_bynode.sh script for your NIC. For 30 Gbps this should be enough. My problem not resolved yet with latest drivers and firmware. At most problem servers Mellanox was changed by Intel NICs.

1 Like
27

Thanks for the feedback, my output card is 100gbps I can only get 30gbps before cutting due to high core usage,

What do I need to do to get good results?

I have another server with an intel card this one with an average of 36 40gbps before the cut can you guide me what should I do to achieve at least 90gbps?

28

You need to use all 63 interrupts
You can made 2 big NUMA nodes: select NPS1 in BIOS (Advanced → CBS → DF Common options → Memory Addressing) and run script:

set_irq_affinity_bynode.sh 0 eth0

or run another script:

set_irq_affinity_cpulist.sh 1-64 eth0
29

thaks,

Screenshot_842
Screenshot_8421863×963 43.9 KB

understood for intel network card this command does not work what could I do besides changing to NSP1 because I am also facing with some bursting cores

a1:00.0 Ethernet controller: Broadcom Inc. and subsidiaries BCM57508 NetXtreme-E

30

For Intel you can download sources for ice driver Download ice-1.11.14.tar.gz (Intel Ethernet Drivers and Utilities) and there you can find scripts/set_irq_affinity
Just run:

./set_irq_affinity all eth0
1 Like
31

understood, only this already solves the problem of intel?

32

I haven’t problems with Intel

1 Like
34

We changed Mellanox to Intel on almost all servers. Now we haven’t problem with IRQ imbalance

1 Like