Originally published at: NVIDIA Makes BERT Fly | NVIDIA Technical Blog
Training Script now Available on GitHub and NGC Script Section Late last year, we described how teams at NVIDIA had achieved a 4X speedup on the Bidirectional Encoder Representations from Transformers (BERT) network, a cutting-edge natural language processing (NLP) network. Since then, we’ve further refined this accelerated implementation, and will be releasing a script to…