Hallo Mellanox Community,
I observe a performance decrease by ~15% if I plug in my Connect X5 CX556A into a PCIe slot belonging to numa node1. On node0 I get better results.
But I remember a test some month ago I saw the performance penalty on node0 (on the same machine) and node1 works perfect. So I am assuming it is not caused by the HW (or by other PCIe components) itself.
Is their any Mellanox configuration in the driver about numa nodes ?
I am using a DPDK application.
My command on numa node1:
“l3fwd-bounce -v -w 0000:d8:00.0 --socket-mem=0,16384 -l 1,5,9,49,53,57 – -p 0x1 --config ‘(0,0,1),(0,1,49),(0,2,5),(0,3,53),(0,4,9),(0,5,57)’ -P”
My command on numa node0:
"l3fwd-bounce -v -w 0000:3b:00.0 --socket-mem=16384,0 -l 4,8,10,52,56,58 – -p 0x1 --config ‘(0,0,4),(0,1,52),(0,2,8),(0,3,56),(0,4,10),(0,5,58)’ -P "
All used cores are isolated (isolcpus).
Do you have any hints for me, how I can come to better results ?