I came across multiple threads where it was mentioned that TX2 does not have hardware support for 8 bit computation. What does this mean from a hardware point of view? What is missing in the TX2, that if it were available, would allow 8 bit computation?
I was under the impression that if we have a 32 or 64 bit FPU, we could pack multiple 8 bit values together for computation. This should be possible from the software side. To me, 8 bit computation seems to be a software hack rather than a hardware feature.What am i missing here?
I would like to do inference of neural network models on the TX2 and INT8 could potentially give a decent speedup. I am trying to understand why Tx2 does not support INT8.
Thanks in advance!