Originally published at: NVIDIA BioBERT for Domain Specific NLP in Biomedical and Clinical Applications | NVIDIA Technical Blog
At GTC DC in Washington DC, NVIDIA announced NVIDIA BioBERT, an optimized version of BioBERT. BioBERT is an extension of the pre-trained language model BERT, that was created specifically for biomedical and clinical domains. For context, over 4.5 billion words were used to train BioBERT, compared to 3.3 billion for BERT. BioBERT was built to…