How to figure out CPU and GPU activity parallelism using Nsight Systems or Nsight Compute?

Developer Tools Nsight Systems Profiling Linux Targets
1

I am using nsys and nv-nsight-cu-cli executables to profile an application. I am try get the CPU activity and visualize how effective the application is with respect of parts of CPU activity being running in parallel with GPU kernel. I have the sqlite report generated from the nsys (Nsigt Systems command line interface). Can someone let me know how can I get that sort of information? Is nsys the correct tool? If yes, please tell me the metric that I should be looking at. If not, please let me know which tool should I be using.

Thanks
Lakshay Bhandari

2

Yes nsys is the correct tool for this analysis. You can use the nsys timeline to view the overlap between CPU and GPU activities.

Note that I have moved this topic under Nsight Systems.

3

Hello

Thank you for the reply.

I am still quite unsure as to which metric should I be looking at in order to find the relevant data.

For example, I can get the data pertaining to kernel runtime from CUPTI_ACTIVITY_KIND_KERNEL table. But how do I get the similar data for CPU functions from sqlite report?

Thanks
Lakshay

4

In your initial question you say: I am try get the CPU activity and visualize how effective the application is with respect of parts of CPU activity being running in parallel with GPU kernel.

The Nsight Systems GUI will already show you that visualization.

External Media

The top part is the CPU CUDA usage, the bottom is the GPU CUDA usage, and I have clicked on a particular kernel so the teal items are correlated.

Is there something this does not give you?