TensorRT vs cuDNN

Hello Experts,

Both TensorRT and cuDNN is given as the Deep Learning library.
What is the real use-case and difference between each library.

Also which one will be most efficient for running CNN based models


The performance should be the same.

cuDNN is a operation level API and user will need to convert the model layer by layer.
TensorRT provide several parsers and can support most public dnn model format directly.


Hi @AastaLLL,

Does that mean, TensorRT internally uses the cuDNN library or both are two independently developed SW libraries for the same hardware


YES. TensorRT internally use cuDNN for inference but with some extension.


1 Like