Struggling to install NVIDIA drivers on Lenovo thinkstation t640 / RHEL 8.8

Hey everyone

Trying to install Nvidia driver on a workstation ,

Kernel 4.18.0-477.10.1.el8_8.x86_64
GPU 61:00.0 VGA compatible controller: NVIDIA Corporation GA104GL [RTX A4000] (rev a1)

Tried the latest driver from nvidia website via .run
Tried installing via package from cuda repo
Tried installing from epel

Driver installation succeeds but the driver is not loaded :
NVIDIA-SMI has failed because it couldn’t communicate with the NVIDIA driver

where do i look for error messages that could cause this?