I am trying to implement D = A * B + C where C is a vector of bias. Because cublasLtMatmul currently only supports the case where C == D and Cdesc == Ddesc, I turns to the solution directly setting the bias when I found that I can use cublasLtMatmulDescSetAttribute, CUBLASLT_MATMUL_DESC_EPILOGUE and CUBLASLT_MATMUL_DESC_BIAS_POINTER to satisfy my purpose.
I set CUBLASLT_MATMUL_DESC_BIAS_POINTER with a fake pointer, then I load the bias later and re-set it.
But I got CUBLAS_STATUS_NOT_SUPPORTED with cublasLtMatmulAlgoGetHeuristic if the CUBLASLT_MATMUL_DESC_EPILOGUE and CUBLASLT_MATMUL_DESC_BIAS_POINTER was set.
So I searched for examples, there are nothing. I can set the CUBLASLT_MATMUL_DESC_BIAS_POINTER with a real one to try it again, but I’m not sure if it works, and I think that I may encounter other problems in future, so I want to ensure this mechanism is really ready to use, and hope that I can find some example to help me properly use it.
Any help or clue is appreciated!