Can we use RTX A6000 and A100 in the same system?

Our group has one server with 4x RTX A6000 and 4x A100 PCIE 80GB on board. However, the A100s are not working properly (stuck at P0 state even there is no job and slower than a RTX 4090 on double precision jobs). While the A6000s are working just fine

I wonder if it is possible to have both the datacenter GPUs and A6000s working in the same system. Does the A100s requires a specialized driver which is different than A6000s? Currently I installed the driver:nvidia-headless-535 on this system. Do I need to install anything else to make the A100s work properly? Thanks!