Trtexec throughput numbers look low for multi gpu

on a server with 4 GPUs, do the throughput numbers using trtexec give the throughput for just one device or do they show the total throughput (from all four GPUs)?

For one device.

Ok great, thank you for the confirmation. Running the triton server numbers and perf_analyzer numbers now to show the aggregated 4 GPU performance

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.