Opensm failed to start, indicating another instance

opensm cannot start, indicating that there are other instances, but I do not find any opensm processes

Is it because the optical module is not inserted into the IB network adapter port?

I have four IB network cards, but optical modules 1 and 4 are not inserted, and optical modules 2 and 3 are inserted and connected through optical fibers. For some reasons, I cannot re-insert and remove the optical modules. Currently, opensm cannot be started normally using the guid of network cards 1 and 4, indicating that there are other opensm instances.

Nic driver version: MLNX_OFED_LINUX-23.10-0.5.5.0-ubuntu22.04-x86_64

opensm can be started using the network adapter guid inserted into the optical module
image