I am using DIGITS as a Docker container running on AWS with and EFS and am training with a subset of data from the ILSVRC12 dataset. The output from the jobs is using all of my storage. How do I control where this output goes and how do I find it on my instance? i should have plenty of storage under my digits-jobs folder, but data is not being written to that location.
Launching with this Docker command:
docker run --shm-size=1g --ulimit memlock=-1 --runtime=nvidia --name digits -d -it -p 5000:5000 -v /home/ubuntu/efs/data/12_classes:/efs/data/12_classes -v /home/ubuntu/efs/digits-jobs:/workspace/jobs nvidia/digits