Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU) GPU • DeepStream Version 6.1.1 • JetPack Version (valid for Jetson only) • TensorRT Version 8.4.1.5-1+cuda11.6 • NVIDIA GPU Driver Version (valid for GPU only) 515.65.01 • Issue Type( questions, new requirements, bugs) question • How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing) • Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
My requirement to crop input frame based on ROI and pad cropped image with black pixel to meet model inference requirement. I have tried to use gst-nvdsexample plugin in full frame mode and updated inMat as my requirement but if I see original image is being sent for inferencing not updated one by gst-nvdsexample plugin. I have dumped jpg from gst-nvdsexample and it shows correct updated image.
Please find attached updated dsexample.cpp for reference. gstdsexample.cpp (36.3 KB)
you can use nvpreprocss + nvinfer to do this, nvpreprocess supports ROI, nvinfer supports padding by symmetric-padding and maintain-aspect-ratio property, please refer to nvdspreprocess and nvinfer.
please refer to sample opt\nvidia\deepstream\deepstream\sources\apps\sample_apps\deepstream-preprocess-test
I am using nvinferserver with triton-server over grpc for inferencing. I have tried nvinfer server and it does support but I am not able to pass preprocessed input to triton-server using nvinferserver plugin.
I understood only way with triton-server is to use extraInputProcess or preprocess option of nvinferserver. is it possible to update primary input in extraInputProcess?
Currently, nvprocess+nvinferserver is not supported, but it is already on our roadmap.
In nvdsexample, NvBufSurface *inter_buf will not be sent to downstream plugin, please process NvBufSurface *surface directly in gst_dsexample_transform_ip.
I have added code to update surface in get_converted_mat which is being called from gst_dsexample_transform_ip but I do not see preprocessed image sent to downstream. I have attach updated gstdsexample.cpp.
your code is processing in_mat which is related with dsexample->inter_buf, as the last comment said, n nvdsexample, NvBufSurface *inter_buf will not be sent to downstream plugin, please process NvBufSurface *surface directly in gst_dsexample_transform_ip.