Hi,
If VIC is always heavy in th euse-case, please refer t the steps to enable it always at maximum clock:
Nvvideoconvert issue, nvvideoconvert in DS4 is better than Ds5? - #3 by DaneLLL
You can get CUDA pointer of an NvBuffer by calling:
NvEGLImageFromFd();
cuGraphicsEGLRegisterImage();
cuGraphicsResourceGetMappedEglFrame();
And call cudaMemcpy() to copy the data.
If you need to use hardware encoder or renderer, the frame data has to be in NvBuffer.