Are cudnn tensor descriptors context dependent?

I’ve looked into the documentation but I couldn’t figure out if I need to create different tensor descriptors for different devices. I use one cuda context per GPU (as is recommended) but I initialise all tensor descriptors I need for CUDNN before I start launching CUDNN computation calls. Do I need to create multiple tensor descriptors - one for each context?