CUPTI is a dynamic library that enables the creation of profiling and tracing tools that target CUDA applications.