Innova IPsec - problems setting up SR-IOV

Hi,

I have a Innova IPsec and I am trying to set up some SR-IOV interfaces to test the docker-passthrough-plugin (https://github.com/Mellanox/docker-passthrough-plugin https://github.com/Mellanox/docker-passthrough-plugin ).

The setup of the card seems (apparently) correct. I have reached out to the docker-passthrough-plugin developers and its seems the problem is more fundamental (i.e. not on the plugin). After some debugging (https://github.com/Mellanox/docker-passthrough-plugin/issues/4 https://github.com/Mellanox/docker-passthrough-plugin/issues/4 ), it dmesg throughs up a couple of problems when I am trying to ask docker for an SR-IOV network - please see below.

Any hints on what is the problem and how can I overcome this?

Thanks!

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.310139] (0000:04:00.0): E-Switch: E-Switch enable SRIOV: nvfs(4) mode (1)

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.458403] (0000:04:00.0): E-Switch: SRIOV enabled: active vports(5)

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.562856] pci 0000:04:00.1: [15b3:1016] type 00 class 0x020000

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.563383] pci 0000:04:00.1: Max Payload Size set to 256 (was 128, max 512)

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.563963] iommu: Adding device 0000:04:00.1 to group 48

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564165] mlx5_core 0000:04:00.1: enabling device (0000 → 0002)

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564634] mlx5_core 0000:04:00.1: firmware version: 14.98.3410

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564674] mlx5_core 0000:04:00.1: mlx5_pcie_print_link_status:411:(pid 143482): PCIe width is lower than device’s capability

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564678] mlx5_core 0000:04:00.1: PCIe link speed is 8.0GT/s, device supports 8.0GT/s

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564681] mlx5_core 0000:04:00.1: PCIe link width is x0, device supports x8

Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564751] DMAR: 64bit 0000:04:00.1 uses identity mapping

Mar 15 14:21:58 ct-analytcis-2 kernel: [73145.237041] mlx5_core 0000:04:00.1: mlx5_cmd_check:731:(pid 143482): ACCESS_REG(0x805) op_mod(0x1) failed, status bad parameter(0x3), syndrome (0x5a98c0)

Mar 15 14:21:58 ct-analytcis-2 kernel: [73145.237048] mlx5_core 0000:04:00.1: FPGA: mlx5_fpga_device_load_check:152:(pid 143482): Failed to query status: -22

Mar 15 14:21:58 ct-analytcis-2 kernel: [73145.237051] mlx5_core 0000:04:00.1: fpga device start failed -22

Mar 15 14:21:58 ct-analytcis-2 kernel: [73145.259140] mlx5_core 0000:04:00.1: tools char device 243:2 destroyed

Mar 15 14:21:59 ct-analytcis-2 kernel: [73145.637372] mlx5_core 0000:04:00.1: mlx5_load_one failed with error code -22

Mar 15 14:21:59 ct-analytcis-2 kernel: [73145.637538] mlx5_core: probe of 0000:04:00.1 failed with error -22