NHWC inputs/outputs

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Hello, could you please tell me, does TensorRT support NHWC inputs without internal forced transpose of inputs? If not, why?

Internally all convolutions are NHWC anyway for Tensor Cores so why is there a NCHW input requirement?
Can we have a simple flag that disables the internal transpose of inputs and outputs?

5

TensorRT supports both NHCW and NCHW. It automatically taken care by TRT,
TRT internally tries all kinds of tensor layouts.

6

TensorRT supports NHWC inputs?

7

Please refer,

8

Thank you. How do i specify that the input to the network is in NHWC format?

10

You can use “setAllowedFormats” API for input tensor, see on NvInfer.h
https://docs.nvidia.com/deeplearning/tensorrt/api/c_api/classnvinfer1_1_1_i_tensor.html