How to trigger Smart Record based on detection of a particular Object

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) dGPU T4
• DeepStream Version 5.0
• JetPack Version (valid for Jetson only)
• TensorRT Version TRT7.0
• NVIDIA GPU Driver Version (valid for GPU only) 440.60

How to trigger Smart Record based on detection of a particular Object? A sample code would be helpful.

If you have a look at the deepstream-test5 sample application you’ll see how smart record is used.
In your own app you can have a probe somewhere after your nvinfer element. I typically add the probe to the tracker src pad.
In this probe you have access to all the metadata and can check if detections have been made and for what classes etc. in here you can call NvDsSRStart().

1 Like

Thanks Jason. I must say you have done tremendous work on deepstream. Thanks.

1 Like

@jasonpgf2a hi, i have a same question on this. I’m trying to trigger a smart record on bbox_generated_probe_after_analytics probe, have you ever try on this? Would you mind to provide some way to access the bin within the probe?

@jasonpgf2a I have been struggling to get the Smart Record implemented. Any pointers are highly appreciated.

@Mike I have been able to trigger the smart record within the bbox_generated_probe_after_analytics probe. However, It seems like need to find out a way to trigger the start and hold the until record duration is end before trigger the NvDsSRStop.
Maybe we can find a way together…

static void
bbox_generated_probe_after_analytics (AppCtx * appCtx, GstBuffer * buf,
    NvDsBatchMeta * batch_meta, guint index)
  NvDsObjectMeta *obj_meta = NULL;
  NvDsSRSessionId sessId = 0;
  NvDsSrcParentBin *bin = &appCtx->pipeline.multi_src_bin;
  NvDsSrcBin *src_bin = &bin->sub_bins[index];
  guint startTime = 7;
  guint duration = 8;

  if (src_bin->config->smart_rec_duration >= 0)
    duration = src_bin->config->smart_rec_duration;

  if (src_bin->config->smart_rec_start_time >= 0)
    startTime = src_bin->config->smart_rec_start_time;
  if (src_bin->recordCtx && !src_bin->reconfiguring) {
    NvDsSRContext *ctx = (NvDsSRContext *) src_bin->recordCtx;
    if (ctx->recordOn) {
      NvDsSRStop (ctx, 0);
    } else {
      NvDsSRStart (ctx, &sessId, startTime, duration, NULL);

within the deepstream_source_bin.c it use the g_timeout_add to trigger the smart record_event_generator from every period of record duration from the settings. Need to find out how the g_timeout_add can be use based on detection of particular object.
I think one easiest way is to store the event source id to the appCTX which return by g_timeout_add , and stop the record after the particular object is not detected and frame out.