Interesting you ask that question. I get this output from activity_trace and callback_event:
[khuck@cyclops activity_trace]$ ./activity_trace
Device Name: Tesla V100-SXM2-32GB
Device Name: Tesla V100-SXM2-32GB
Device Name: Tesla V100-SXM2-32GB
Device Name: Tesla V100-SXM2-32GB
activity_trace.cpp:355: error: function cuptiActivityFlushAll(0) failed with error CUPTI_ERROR_INSUFFICIENT_PRIVILEGES.
[khuck@cyclops callback_event]$ ./callback_event 0
Usage: ./callback_event [device_num] [event_name]
CUDA Device Number: 0
CUDA Device Name: Tesla V100-SXM2-32GB
callback_event.cu:239:Error CUPTI_ERROR_INSUFFICIENT_PRIVILEGES for CUPTI API function ‘cuptiSubscribe’.
Which I know about the fix for that, but waiting for an administrator (who knows what they are doing) to set the modprobe flag. But we don’t get that error when subscribing to the asynchronous activity API.