There is little specificity from NVIDIA (that I’ve been able to find) regarding the relative performance of the Xavier AGX for several common metrics. Namely, the technical splash page for the AGX specifies a FP16 metric of 16 TFLOPs. Yet, I get the sense that this is NOT raw FP16 compute but rather Tensor ‘mixed precision’ compute? Is this assumption correct?
Further, there is no mention of raw FP32 or INT4 compute expectations. Since this architecture is Volta, I presume INT4 is not supported? But what are compute expectations for FP32? Some sources cite 1.4 TFLOPs, but I’m struggling to find anything official from NVIDIA.