Memory Table Missing in ncu-ui only for H100

Developer Tools Nsight Compute
1

Hi,

I am looking for equations for calculating utilization of the shared memory, l1, l2, and hbm of a H100. I generated a ncu-rep file with --set detailed to see the memory table. I confirmed this table exists by using a ncu-rep file I found on this forum taken by an rtx3060 ti. I was able to mouse over the Peak % columns and get an equation.

image
image2642×1138 145 KB

However I was worried these equations might have changed for the H100, so I generated the file on H100s that I am profiling. This time when I loaded the ncu-rep file the table was missing.

image
image2663×1119 139 KB

How can I get these equations that I could see for the rtx3060 ti? Are they hidden for the H100? Are they the same?

2

The memory tables are not part of the “detailed” set, you need to collect --set full. See the file MemoryWorkloadAnalysis_Tables.section in the ncu sections directory for reference. You can also use ncu --list-sets or ncu --list-sections, or the respective UI tool window to get the information.

3

Darn, I tried running like this:

ncu -f --target-processes all --profile-from-start no -o small_full --set full --replay-mode application

and I’m still missing the table…
small_full.ncu-rep.gz (22.2 MB)

4

The report has it. You just need to select the tables in the Memory Workload Analysis section’s header dropdown.

5

oops thank you!!!

6

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.