cudnn conv2d_grad costs much more time than conv2d

AI & Data Science Deep Learning (Training & Inference) cuDNN
#1

Hello everyone,

I am using cudnn to do training on v100, now I found conv2d grad costs much more time than conv2d, so is it normal that grad costs much time than forward on conv2d?

Thanks in advance!