Are Tensors in CUDNN Row-major or Column-major?

Hello, I am developing a low level library in C to manage large machine learning models. In my library i would like to be totally compatible with NVidia whenever i can to reuse CUDNN + CUBLAS calls.
in CuBlas all operators take matrices in Column-major.

In CUDNN, i am not very sure, but i saw most operators are ROW-major? Is that true?

That’s row major. See Section 2.5.2 of cuDNN Developer Guide below (or search “row major”).
https://docs.nvidia.com/deeplearning/sdk/cudnn-developer-guide/index.html

Thanks a lot