# Jetson series TOPS mean in FLOPS or INTS?

**URL:** <https://forums.developer.nvidia.com/t/jetson-series-tops-mean-in-flops-or-ints/272948>\
**Category:** Jetson AGX Orin\
**Tags:** performance\
**Created:** [November 15, 2023, 11:23am UTC](https://forums.developer.nvidia.com/t/jetson-series-tops-mean-in-flops-or-ints/272948 "2023-11-15T11:23:12Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![rownasser](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@rownasser](https://forums.developer.nvidia.com/u/rownasser)\
**Post date:** [November 15, 2023, 11:23am UTC](https://forums.developer.nvidia.com/t/jetson-series-tops-mean-in-flops-or-ints/272948/1 "2023-11-15T11:23:12Z")

</div>

I need to know if the TOPS are in int8s or floating-point? anyone knows?

---

<div class="post-metadata">

**Author:** ![AastaLLL](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/aastalll/32/14043_2.png) [@AastaLLL](https://forums.developer.nvidia.com/u/AastaLLL)\
**Post date:** [November 16, 2023, 2:49am UTC](https://forums.developer.nvidia.com/t/jetson-series-tops-mean-in-flops-or-ints/272948/3 "2023-11-16T02:49:48Z")

</div>

Hi,

TOPs indicate INT8 performance. TFLOPs is used for the FP32 performance score.

For example, in [NVIDIA Jetson AGX Orin Series Technical Brief](https://www.nvidia.com/content/dam/en-zz/Solutions/gtcf21/jetson-orin/nvidia-jetson-agx-orin-technical-brief.pdf):

> Jetson AGX Orin 64GB … up to 170 Sparse TOPs of INT8 Tensor compute, and up to 5.3 FP32 TFLOPs of CUDA compute.

Thanks.

---

<div class="post-metadata">

**Author:** ![rownasser](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@rownasser](https://forums.developer.nvidia.com/u/rownasser)\
**Post date:** [November 16, 2023, 3:15am UTC](https://forums.developer.nvidia.com/t/jetson-series-tops-mean-in-flops-or-ints/272948/5 "2023-11-16T03:15:40Z")

</div>

So the sparse word involves something about the nvidia tensor cores i’m thinking correct? so i’m thinking it would make it 275 int8 and 5_2==10(fp16) and 10_2(fp8) which aren’t the tensor cores which involve the “sparse” ints… correct? so i can still get 276 int8 for calculations per second… correct?

---

<div class="post-metadata">

**Author:** ![rownasser](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@rownasser](https://forums.developer.nvidia.com/u/rownasser)\
**Post date:** [November 16, 2023, 3:19am UTC](https://forums.developer.nvidia.com/t/jetson-series-tops-mean-in-flops-or-ints/272948/6 "2023-11-16T03:19:17Z")

</div>

sorry that’s:

5 multiply 2 == 10 (FP16)  
10 MULTIPLY 2 == 20(fp8)

---

<div class="post-metadata">

**Author:** ![AastaLLL](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/aastalll/32/14043_2.png) [@AastaLLL](https://forums.developer.nvidia.com/u/AastaLLL)\
**Post date:** [November 20, 2023, 3:21am UTC](https://forums.developer.nvidia.com/t/jetson-series-tops-mean-in-flops-or-ints/272948/7 "2023-11-20T03:21:26Z")

</div>

Hi,

No, it means sparse operation.  
The performance is achieved with tensor cores + cuda cores.

Thanks.

---

<div class="post-metadata">

**Author:** ![system](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/system/32/68080_2.png) [@system](https://forums.developer.nvidia.com/u/system)\
**Post date:** [December 19, 2023, 6:47am UTC](https://forums.developer.nvidia.com/t/jetson-series-tops-mean-in-flops-or-ints/272948/9 "2023-12-19T06:47:49Z")

</div>

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.