For the two new Gatortron models I see issues loading the MegatronBERT.pt checkpoint file in pytorch. The call torch.load(‘dir/MegatronBERT.pt’, map_location=‘cpu’) should work but I get this error below.
[enforce fail at inline_container.cc:145] . PytorchStreamReader failed reading zip archive: failed finding central directory.
-RIchard