Hello, could you please tell me, does TensorRT support NHWC inputs without internal forced transpose of inputs? If not, why? Internally all convolutions are NHWC anyway for Tensor Cores so why is there a NCHW input requirement? Can we have a simple flag that disables the internal transpose of inpu…

TensorRT supports both NHCW and NCHW. It automatically taken care by TRT, TRT internally tries all kinds of tensor layouts.

Please refer, [image] TRT 7 - NHWC support? TensorRT Hi, NHWC is supported in TRT. Using NHWC will have some benefit according to device you use. In general: with tensor cores, NHWC is (generally) preferred. for non-tensor-core, NCHW is preferred. Thanks

Thank you. How do i specify that the input to the network is in NHWC format?

You can use “setAllowedFormats” API for input tensor, see on NvInfer.h https://docs.nvidia.com/deeplearning/tensorrt/api/c_api/classnvinfer1_1_1_i_tensor.html

NHWC inputs/outputs

AI & Data Science Deep Learning (Training & Inference) TensorRT

spolisetty July 17, 2021, 4:05pm 7

Please refer,

Topic		Replies	Views
Can we make TensorRT handle nhwc Tensor? TensorRT	7	1619	June 4, 2020
TRT 7 - NHWC support? TensorRT	3	771	April 21, 2020
TensorRT 5 Input Tensor Format NCHW / NHWC TensorRT	6	5515	October 24, 2019
Should I retrain the model when the TensorRT uses NCHW as input and the pre-trained model uses NHWC format TensorRT	1	610	August 27, 2019
How can I define the input data format into NHWC? TensorRT tensorrt	2	943	September 24, 2020
TensorRT specify layer NCHW -> NHWC Jetson TX2	6	2265	December 27, 2018
TensorRT support NHWC model? Jetson TX2	3	3362	June 25, 2018
How to disable NCHW to NHWC conversion of inputs and outputs? TensorRT	1	490	September 24, 2019
Giving input in NHWC format to tensor rt network in trt7 TensorRT	1	747	September 30, 2020
TensorRT NCHW vs cuDNN NHWC TensorRT tensorrt	3	1979	August 3, 2023

NHWC inputs/outputs

Related topics