I’ve never installed DL stuff on Linux therefore I don’t know if there is a "special" requirement other than the NV drivers. In Passthrough CUDA is enabled and on Windows VMs there is nothing that needs to be installed in addition to run apps with CUDA.
I don’t think there is any difference compared to a local machine so if you ever installed Caffe on a local machine you should be able to replicate your knowledge for the VM…