I have a fat node which has 2TB memory. With the new Connect-IB card, I want to increase the MTT, so I could register a large memory region. I found this post for HowTo Increase Memory Size used by Mellanox Adapters https://community.mellanox.com/s/article/howto-increase-memory-size-used-by-mellanox-adapters , but it didn’t mention how to increase that for Connect-IB. Could anyone give me any suggestion?
Have you tried seeing that you cannot actually allocate DMA of the requires size with the default settings ? The parameters in mlx4 (ConnectX-3Pro and below) were configurable as the default values on some occasions were too low for some users. The mlx5 driver should have a much larger default pool.