Now the graph mode is based on the graph structure to call the kernel, see the document description has pre_compile and runtime-compile: pre-compile refers to the binary compiled in advance, select the corresponding binary at run time, and runtime-compile refers to the need to compile at run time? What is the specific compilation? Is the previous version of cudnn using pre-compile when there was no graph API?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Runtime API? Driver API? | 2 | 6133 | May 7, 2008 | |
CUDA Runtime API or CUDA Driver API | 2 | 5050 | October 1, 2014 | |
cuda driver api vs. runtime api | 1 | 1001 | January 14, 2020 | |
Can Multiple kernals run at the same time? | 3 | 2785 | July 30, 2009 | |
Graph scheduling and __const__ data | 2 | 451 | October 13, 2020 | |
startup overhead | 1 | 1933 | May 22, 2009 | |
Module support in the runtime API | 0 | 4303 | January 30, 2009 | |
Conceptual questions about how to use cuDNN v9 | 2 | 103 | January 3, 2025 | |
Execution time is different in Profiller and Console. why? | 4 | 3742 | August 3, 2009 | |
'CUDA runtime API' term explain meaning of the term in order to translate into other languag | 4 | 1606 | December 25, 2009 |