In the Nsight system, when I click a kernel for its description, I see the Latency: ←2.006 ms on the right box. What is the meaning of that latency? Is that a launch latency, like the time between the job was scheduled and executed?
Check out this blog post I wrote covering most of this terminology Understanding the Visualization of Overhead and Latency in NVIDIA Nsight Systems | NVIDIA Technical Blog