It would be very useful if cudnnOpTensor could be extended to support common element-wise/unary operations that are missing but have since been added to TensorRT only.
Currently cudnnOpTensor supports the following ops:
element-wise: add, mul, min/max
unary: sqrt, neg (aka not)
In contrast, TensorRT supports:
element-wise: add/sub, mul/div, max, pow
unary: exp/log, sqrt, abs, neg, recip
It would be great if cudnnOpTensor could be updated to add the currently TensorRT-only ops:
element-wise: sub, div, pow
unary: exp/log, abs, recip
I’ve been wishing these were available for a long time, but it would especially make sense to add them now that they are available via TensorRT!
Is there any possibility of these being added?