CUDA set up for Nvidia Quadro 5000

Hi,
I am very new to CUDA and parallel computing so have few very basic doubts that needs clearing. My machine is Ubuntu 20.04 and has a single GPU (see below) that runs X-Server on two dual monitors.

~$ lspci |egrep “VGA”
03:00.0 VGA compatible controller: NVIDIA Corporation GF100GL [Quadro 5000] (rev a3)

Question-1: Can a single GPU do both the tasks namely display and run CUDA?

Question-2: CUDA installation seems to run fine but it still does not work and get an error like:

$ nvprof ./add_cuda
======== Warning: This version of nvprof doesn’t support the underlying device, GPU profiling skipped
======== Error: Application received signal 139

Here is the output from nvidia-smi:
$ nvidia-smi
Sun May 17 21:04:47 2020
±----------------------------------------------------------------------------+
| NVIDIA-SMI 390.132 Driver Version: 390.132 |
|-------------------------------±---------------------±---------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 Quadro 5000 Off | 00000000:03:00.0 On | Off |
| 37% 82C P1 N/A / N/A | 775MiB / 2487MiB | 0% Default |
±------------------------------±---------------------±---------------------+

±----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 1818 G /usr/lib/xorg/Xorg 64MiB |
| 0 2454 G /usr/lib/xorg/Xorg 176MiB |
| 0 2645 G /usr/bin/gnome-shell 144MiB |
| 0 3849 G …AAAAAAAAAAAACAAAAAAAAAA= --shared-files 130MiB |
| 0 12191 G …quest-channel-token=3762008067591887993 95MiB |
±----------------------------------------------------------------------------+

So my assumption is that my GPU is used for display and not available for CUDA. Would adding a /etc/X11/xorg.conf file like the one below help solve the problem?

Section “ServerLayout”
Identifier “layout”
Screen 0 “nvidia”
Screen 1 “nvidia”
EndSection

Section “Device”
Identifier “nvidia”
Driver “nvidia”
BusID “PCI:1@03:00.0”
Option “ConstrainCursor” “off”
EndSection

Section “Screen”
Identifier “nvidia”
Device “nvidia”
Option “AllowEmptyInitialConfiguration” “on”
Option “IgnoreDisplayDevices” “CRT”
EndSection

Thanks,