Data size is always the same when using half2 or int8 mode ?

In giexec.cpp, the createMemory function, this lines means it will always create the same size when using half2 or int8 mode.
“size_t eltCount = dimensions.c()*dimensions.h()*dimensions.w()*gParams.batchSize, memSize = eltCount * sizeof(float);”

When using int8 mode, should it create a samller size, such as “size_t eltCount = dimensions.c()*dimensions.h()*dimensions.w()*gParams.batchSize, memSize = eltCount * sizeof(char);”

Hello, I think you meant trtexec.cpp? which compiles into giexec binary. But the same question applies. I’ll forward to our engineers and keep you updated.

hello,

TensorRT does not allow INT8 input/outputs. Hence the input and output tensor allocations are done based on sizeof float.