cudnnMultiHeadAttnForward with bad params

hi,

I have a problem with wrong parameters when using cudnn api cudnnMultiHeadAttnForward(), LogInfo is attached。

Shape is as follows
bathsize=1
qo_beam_size=1
kv_beam_size=1
qo_seq_len=4
kv_seq_len=4
q_in_len=4 // vector size of each word
k_in_len=4
v_in_len=4
q_proj_len=4
k_proj_len=4
v_proj_len=4
o_proj_len=4

I tried LogWarn and LogErr, but get nothing.

CUDNN_STATUS_BAD_PARAMS occured when calling cudnnMultiHeadAttnForward() function.

Everthing works fine when I set param currIndx=-1. what is the limit between qkv shapes when curId>=0?

thanks

Can you please share the error logs with us?
Thanks