Subject sums it up. Is there any effort ongoing, or anticipated, to allow activation choices besides the default?
On a somewhat related note, maybe I’m missing something, but as far as I can see, there is no search function for these forums. Hopefully my question is not redundant.
cudnnActivationMode_t() is an enumerated type used to select the activation
function used in cudnnActivationForward() and cudnnActivationBackward(), which includes sigmoid, rlu, tanh, clipped relu. Are you looking for more activation functions or use a custom function?