I tried to use the BioMegatron model to do the classification task in the NeMo package. However, an error message occurred because of “fuse_layer_norm.py” in the apex package.
And then I went into the GitHub of the apex package. I found the support of the “FastLayerNorm” was just hidden on last month which is a function used in the “fuse_layer_norm.py” file.
So, I would like to know is there any way that I could use the BioMegatron model in the NeMo package right now?