Winograd in NVDLA

Autonomous Vehicles DRIVE AGX Xavier DRIVE AGX Xavier General
1

I am evaluating the performance of NVDLA, and are familiar with the Winograd convolutions to accelerate 3x3 filters.
My questions are:

  1. Does the Winograd transform work in 16 bit integer format? Does it work in 8 bit data format?
  2. Are the Winograd convolutions bit exact to regular 3x3 convolutions? If not, what are the accuracy implications of using Winograd transforms?
  3. Can we train the network to use the Winograd convolutions to minimize the accuracy impact? If so, please outline some procedure for doing that using any of TensorFlow, Keras, TensorRT, PyTorch code.
2

Hi alonyaakov18,

Which platform you’re using? DRIVE AGX or DRIVE PX2?

Thanks

3

DRIVE AGX which uses the NVDLA deep learning accelerator

4

Dear alonyaakov18,

I would say that convolution is never exact in FP in the sense that different orders of operation yield different results.

5

Can you quantify how inexact the results will be?

6

Dear alonyaakov18,

Not that I know of. Thanks.

7

How do I train the network for Winograd?