How to Use AIO in dsexample?

[15618561709]

Hi,
i need to save croped image asynchronously while without slow down the stream.

for example, using cuda or openmp

NvDsMetaList *l_obj = NULL;
        NvDsObjectMeta *obj_meta = NULL;
#pragma omp parallel for
        for (l_obj = object_list; l_obj != NULL; l_obj = l_obj->next)
        {
            save_to_desk(_cuda_crop((uint8) stream, ROI_w,Roi_h))
        }

while in my mind, this code will block the stream.
i just want to ask is there any AIO just like libaio in linux??? Or Another way to speed up the save process ??

Thank u very much!!!Hope you have a greate life !!

[ChrisDing]

cuda kernel will return asynchronously except you do “cudaDeviceSynchronize” after it.

You can try to use cudaLaunchHostFunc() OR cudaStreamAddCallback() to add callback
If so, the callback is a CPU function and the function to call once preceding stream operations are complete

Host Functions (Callbacks) use cudaLaunchHostFunc() instead of the deprecated cudaStreamAddCallback() now.
And both of them have the same behavior.
The commands that are issued in a stream after a host function do not start executing before the function has completed.

https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#stream-callbacks