What metrics should I focus on to measure how much work a GPU can do?

Accelerated Computing CUDA CUDA Programming and Performance
1

I’m looking to create a benchmarking tool.

2

Why not take a look at the current benchmarking tools that exist within CUDA samples and generate an idea from those?

BandwidthTest is probably a good starting point. deviceQuery will also provide you some information.

3

Seldom seen such a broad question around here.

As an nVidia GPU can compute nearly everything, you could also benchmark nearly everything.

4

FLOPS

5

Best Answer hahaha.