Where do i set enable_amp?


Where do I need to set the enable_amp=True to trigger automatic mixed precision training? Is that going to be on training commandline e.g.

!tlt-train mask_rcnn -e train_resnet50.txt -d dir_unpruned -k $KEY --gpus 2 --enable_amp=True

See https://docs.nvidia.com/metropolis/TLT/tlt-getting-started-guide/index.html#auto_mixed_precision

In TLT, enabling AMP is as simple as setting the environment variable TF_ENABLE_AUTO_MIXED_PRECISION=1 when running tlt-train. This will help speedup the training by using FP16 tensor cores. Note that AMP is only supported on GPUs with Volta or above architecture.