Hi,
I want to use GatorTron LM for learning purpose in my local machine. i have file download the files (config.json, hparam.yml, MegtronBERT.nemo, MegatronBERT.pt, vocab.txt) from https://catalog.ngc.nvidia.com/orgs/nvidia/teams/clara/models/gatortron_og. Also i have NVIDIA GPU. How should i send the prompt message to this model? Guide me.
Hey shehbaz.shaikh,
I might not have been clear enough last time when I stated that this requires NeMo and a GPU cluster or access to one. These models are not designed to run on a local workstation with just any GPU.
Please read carefully through the documentation on NVIDIA NeMo and understand the requirements.
thanks!