Cudnn TF32 performs no better than FP32 on RTX3090

[AakankshaS]

Hi @824023604,
is this really the problem size?

@824023604

x_in = np.array([[
  [[2], [1], [2], [0], [1]],
  [[1], [3], [2], [2], [3]],
  [[1], [1], [3], [3], [0]],
  [[2], [2], [0], [1], [1]],
  [[0], [0], [3], [1], [2]], ]])
kernel_in = np.array([
 [ [[2, 0.1]], [[3, 0.2]] ],
 [ [[0, 0.3]],[[1, 0.4]] ], ])

if so, these are quite small and unable to fully occupy even 1 SM.

Thanks!