OK, given you are stuck here and I’m not sure why it isn’t mounting the CSV’s, what if you added "default-runtime": "nvidia" to your /etc/docker/daemon.json file. If you go back to using l4t-base, when you docker build the the nvidia runtime will be used. I do this for example when I need to run TensorRT engine generation during the docker build.
BTW I have also used this project to build a new base image before, when I needed to install CUDA inside the container: https://github.com/jetsistant/docker-cuda-jetpack