Bluefield 2 CPS performance

Infrastructure & Networking BlueField
1

Hi, In this NVIDIA slide https://www.sie.es/wp-content/uploads/2022/05/RamiroAlvarezHPC2022.pdf
it mentions that BF2 support upto 1.5M connection per second (page 28).

However, when I tried to measured it on our system, with OvS inside BF2, run in kernel mode, DOCA, or DPDK, with hw-offload enabled/disabled, I never been able to achieve higher than 120k CPS. My OvS setup follow official document here: Virtual Switch on BlueField - NVIDIA Docs
For traffic gen, I use trex, with exactly same setup as here, exept that OvS runs inside BF2: https://developers.redhat.com/articles/2022/11/17/benchmarking-improved-conntrack-performance-ovs-300#performance_improvements_in_version_3_0_0_of_open_vswitch
Is there anything wrong? what setup/tunning should I use to achieve higher CPS? was this number (1.5 M CPS) measured when connection tracking enable or disable?

Additional info: I use DOCA 2.9.2 bundle image for BF2. Without connection tracking rule in OvS, I can easily achieve 2M CPS so I think the traffic gen part is not the issue.

Thank you.

2

Hi @vantu.bkhn ,

Due to the lack of more detailed information of your operations and topology, I can’t help to analyze your situation.

Could you please provide more detailed information of your testing, including but not limited:

  • Topology of your env.
  • Configurations and operations of your testing.
  • Reproduce steps.
  • More information you think would help to analyze the issue.

Best regards!