No link on QM8790 HDR Switch on Certain Ports

We have a ConnectX-6 Adapter which we are trying to connect to our QM8790 HDR switch. When we connect it to ports toward the end of the switch (we have tried port 29 - 36 as they are free) we do not get any link. We were able to test with one other port (port 22) and there we immediately got link. This is with the same cable, which is an active optical EDR cable. Is there any reason link would not come up on certain switch ports?

Hi Psolanki,
Could you let me know the PN of HCA and Cable?
And Could you let me know the firmware version of both switch and HCA?
Thanks,
Suo