At least according to my search through the documentation, CUFFT_NOT_SUPPORTED (0x10) is not a result code that is returned by cufftXtSetCallback(), however that is what I’m receiving. Any ideas why that might be the case? It’s not easy to reproduce, and seems to only occur when other FFTs have already been performed. I can only reproduce on a system with a V100 but not on a system with a Titan V. I don’t know if that’s relevant. Also, I’ve tried with CUDA 11.7, 11.8, and 12.2 and each exhibit the problem. compute-sanitizer shows no errors up to and including when the error is returned by cufftXtSetCallback().
Is it possible to reproduce issue with smaller code you could share with us? (filling bug would be also good idea)