K20 as a computation Card

Hi,
we recently purchased a server with a Matrox graphics card and a K20 aimed for calculations only.
During the toolkit installation, do i need the NVIDIA drivers or shall i go with the matrox ones?
K20 is not going to provide X-server graphics…!!!

Cheers,
Thanasio