I executed codes example from “Performance” jupyter notebook (https://ngc.nvidia.com/catalog/resources/nvidia:med:getting_started.) ) I have encountered exception errors when execute this cell:
! $MMAR_ROOT/commands/train_FakeDS.sh trn1_BT.json 0
The errors are showing about out of resources
Resource exhausted: OOM when allocating tensor
I understand that a model with data is too big to fit in the memory of GPU or physical memory.
I use Tesla V100 with 16GB of memory and 64Gb of physical memory to run the above example.
Please kindly suggest me the configuration that I could run this example in the notebook.