Inference on multiple images from a folder using deepstream

Accelerated Computing Intelligent Video Analytics DeepStream SDK
, , , ,
1

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) - GPU
• DeepStream Version - 6.4
• TensorRT Version - 8.6.1
• NVIDIA GPU Driver Version (valid for GPU only) - NVIDIA RTX A2000

image_pipeline.txt (14.0 KB)

I am trying to run a DeepStream pipeline on multiple images from a folder using the provided pipeline, but I am encountering a CUDA error. When attempting to perform batch-wise inference on a folder containing images, I receive a gi.overrides.Gst.AddError error.

deepstream_image_pipeline
deepstream_image_pipeline1297×621 120 KB

batch-wise-inference
batch-wise-inference1291×562 83.9 KB

Can anyone help me set up inference on a dynamically updating folder with images using DeepStream?

3

If you want to inference on multiple images from a folder, you can consider using multifilesrc.

5

image_pipeline_multifilesrc.txt (11.7 KB)

I tried using multifilesrc still getting cuda failure error.

Screenshot from 2024-06-18 12-45-22
Screenshot from 2024-06-18 12-45-221295×505 72.3 KB

6

Could you refer to the dGPU model Platform and OS Compatibility and check if the version of the softwares you installed match those in the table?

7

Yes.

• TensorRT Version - 8.6.1.6
• NVIDIA GPU Driver Version (valid for GPU only) - NVIDIA RTX A2000
• Ubuntu 22.04

8

When you are using multifilesrc, you don’t need to create multiple ones. You need to modify your demo code to the pipeline like multifilesrc->jpegparser->decoder->nvstreammux->nvinfer.... Please refer in detail to the link I attached. If you create too many source_bins in your code, it will run out of the decoder resources.

9

Hi,

Thank you. I have changed the pipeline to multifilesrc -> jpegparser -> decoder -> nvstreammux -> nvinfer.... However, after processing 4 frames, it stops, even though my folder contains around 1000 images. I tried using the stop-index property in multifilesrc, but it didn’t resolve the issue.

deepstream_image.txt (9.9 KB)

image
image1289×254 42.1 KB

10

Are your images named as consecutive numbers?

11

No, I have changed the image names to consecutive numbers and ran the pipeline; it worked. Thank you.

Is there any way to run this pipeline on images with non-consecutive numbers?

12

No. This is limited by the multifilesrc plugin.

13

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks