cudnnActivationForward doesn't work with CUDNN_ACTIVATION_IDENTITY

AI & Data Science Deep Learning (Training & Inference) cuDNN
1

As the title says.

cudnnSetActivationDescriptor(desc, CUDNN_ACTIVATION_IDENTITY, CUDNN_NOT_PROPAGATE_NAN, 0.0f);

This causes cudnnActivationForward to return Bad Param. Oddly enough, it you used cudnnConvolutionBiasActivationForward() it worked fine.

Please fix or explain why. Thanks,
-Chris

EDIT: Messing around, I’m noticing a lot of differences between cudnnActivationForward and cudnnConvolutionBiasActivationForward. Why is cuDNN such a mess?

2

Hi @ezbDoubleZero ,
Can you please share the logs with us so we can help better.
Also cudnnActivationForward and cudnnConvolutionBiasActivationForward(API Reference - NVIDIA Docs) are explained here for your reference.

Thanks

thanks