We want to do TensorRT int8 inference.
According to documentation, ZOTAC GAMING GeForce RTX 3070 Twin Edge has Tensor Core, but information about int8 inference is still missing:
We want to know, does RTX 3070 support int8 inference? What is the int8 computation power in TOPS?
NVIDIA GA104, 1725 MHz, 5888 Cores, 184 TMUs, 96 ROPs, 8192 MB GDDR6, 1750 MHz, 256 bit
The FP32 (float) performance is 20.31 TFLOPS.
How about FP16/int8 performance?
Hi, Please refer to the below links to perform inference in INT8
Thanks for your reply.
We want to buy 3070 for int8 inference. But we don’t know if 3070 support int8.
My question is:
1.does 3070 support int8 inference?
2.If it does, what is the computation power in TOPs?
Thanks a lot.
Please refer support marix guide to check more details. Based on doc 3070 supports int8 inference.
Your GPU Compute Capability Are you looking for the compute capability for your GPU, then check the tables below. NVIDIA GPUs power millions of desktops, notebooks, workstations and supercomputers around the world, accelerating...