Cufft crash in version after CUDA 11.5

We use Cufft in order to compute fft and others operations on frames grayscale 1 byte. While using CUDA version 11.6 or more
a GPU assert : an illegal memory access occurs when performing an fft on this call
cudaStreamSynchronize(stream);

However, it worked perfectly fine on CUDA version 11.5. We read the changelog from version 11.5 but do not know where is the root of the problem

It would be better if you can provide a reproducer