TensorRT vs cuDNN

Robotics & Edge Computing Jetson & Embedded Systems Jetson Nano
,
1

Hello Experts,

Both TensorRT and cuDNN is given as the Deep Learning library.
What is the real use-case and difference between each library.

Also which one will be most efficient for running CNN based models

3

Hi,

The performance should be the same.

cuDNN is a operation level API and user will need to convert the model layer by layer.
TensorRT provide several parsers and can support most public dnn model format directly.

Thanks.

4

Hi @AastaLLL,

Does that mean, TensorRT internally uses the cuDNN library or both are two independently developed SW libraries for the same hardware

5

Hi,

YES. TensorRT internally use cuDNN for inference but with some extension.

Thanks.

3 Likes