hi,
I have a problem with wrong parameters when using cudnn api cudnnMultiHeadAttnForward(), LogInfo is attached。
Shape is as follows
bathsize=1
qo_beam_size=1
kv_beam_size=1
qo_seq_len=4
kv_seq_len=4
q_in_len=4 // vector size of each word
k_in_len=4
v_in_len=4
q_proj_len=4
k_proj_len=4
v_proj_len=4
o_proj_len=4
I tried LogWarn and LogErr, but get nothing.
CUDNN_STATUS_BAD_PARAMS occured when calling cudnnMultiHeadAttnForward() function.
Everthing works fine when I set param currIndx=-1. what is the limit between qkv shapes when curId>=0?
thanks