Need Help Troubleshooting CUDA 10 install over SSH

I have a remote machine wit a brand new GTX1050 installed in it. Using Ubuntu 18.04. I am trying to use it as an offsite Meshroom computer for photogrammetry. Meshroom requires CUDA >3.0 for calculations. I have used these instructions to install CUDA: Installation Guide Linux :: CUDA Toolkit Documentation Trying to install 10.0 When you do that and install cuda, I assumed it would install the nvidia driver as well. I guess the other factor is I am doing this all over ssh in terminal. I even compiled all the samples. Also blacklisted nouveau.

Problem nvidia driver is not showing up.
No /dev/nvidia

GPU shows up
$ sudo lshw -C display
*-display
description: VGA compatible controller
product: GP107 [GeForce GTX 1050]
vendor: NVIDIA Corporation
physical id: 0
bus info: pci@0000:01:00.0
version: a1
width: 64 bits
clock: 33MHz
capabilities: pm msi pciexpress vga_controller bus_master cap_list rom
configuration: driver=nouveau latency=0
resources: irq:38 memory:d2000000-d2ffffff memory:c0000000-cfffffff memory:d0000000-d1ffffff ioport:e000(size=128) memory:c0000-dffff
*-display
description: VGA compatible controller
product: Xeon E3-1200 v3/4th Gen Core Processor Integrated Graphics Controller
vendor: Intel Corporation
physical id: 2
bus info: pci@0000:00:02.0
version: 06
width: 64 bits
clock: 33MHz
capabilities: msi pm vga_controller bus_master cap_list
configuration: driver=i915 latency=0
resources: irq:35 memory:d3400000-d37fffff memory:b0000000-bfffffff ioport:f000(size=64)

$ sudo nvidia-smi
NVIDIA-SMI has failed because it couldn’t communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

./deviceQuery
./deviceQuery Starting…

CUDA Device Query (Runtime API) version (CUDART static linking)

cudaGetDeviceCount returned 38
→ no CUDA-capable device is detected
Result = FAIL

Any ideas?

Some more info. I just installed inxi and this is the Graphics output over ssh:
Graphics:
. Card-1: Intel Xeon E3-1200 v3/4th Gen Core Processor Integrated Graphics Controller
Card-2: NVIDIA GP107 [GeForce GTX 1050]
Display Server: X.Org 1.20.8
drivers: modesetting,nvidia (unloaded: fbdev,vesa,nouveau)
Resolution: 1920x1080@60.00hz
OpenGL: renderer: llvmpipe (LLVM 10.0.0, 256 bits)
version: 3.3 Mesa 20.0.8

Any idea why it would be going to Nouveau even though I have it black listed?

$ cat /etc/modprobe.d/blacklist-nouveau.conf
blacklist nouveau
options nouveau modeset=0