Issue with cv::cuda::remap in multiple threads : the content will be disordered

two cameras ,two decode threads,when i remap the decoded frame,the pictures of the two cameras will be disordered! i have to block the thread when cv::cuda::remap,is there any other solutions?Could someone help me? Best wishes to you all!