Cannot use BioMegatron due the function in apex

I tried to use the BioMegatron model to do the classification task in the NeMo package. However, an error message occurred because of “fuse_layer_norm.py” in the apex package.


And then I went into the GitHub of the apex package. I found the support of the “FastLayerNorm” was just hidden on last month which is a function used in the “fuse_layer_norm.py” file.

So, I would like to know is there any way that I could use the BioMegatron model in the NeMo package right now?

Hello,

Welcome to the NVIDIA Developer forums! You posted in our community feedback category, there is no support offered here. I will move this to a proper category so our support teams have visibility.

Best,
Tom K