Deepstream-audio with sync-inputs

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) : dGPU、Jetson
• DeepStream Version : 6.1
• JetPack Version (valid for Jetson only) : 5.0.2
• TensorRT Version : 8.4.1
• NVIDIA GPU Driver Version (valid for GPU only) : 525.147.05
• Issue Type( questions, new requirements, bugs) : bugs
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

If I change configuration file to add sync-inputs=1 and disable file-loop, program keeps to shows FPS 0 before inferencing all data.
Running the sample deepstream-audio with the following configuration file with sync-inputs=1 produced the following output.
Is it a bug?

I run this command in the docker container.
nvcr.io/nvidia/deepstream:6.1-devel
nvcr.io/nvidia/deepstream-l4t:6.1.1-samples

command

cd /opt/nvidia/deepstream/deepstream-6.1/sources/apps/sample_apps/deepstream-audio/configs
deepstream-audio -c ds_audio_sonyc_test_config.txt

configuration file(ds_audio_sonyc_test_config.txt)

################################################################################
# Copyright (c) 2020, NVIDIA CORPORATION. All rights reserved.
#
# Permission is hereby granted, free of charge, to any person obtaining a
# copy of this software and associated documentation files (the "Software"),
# to deal in the Software without restriction, including without limitation
# the rights to use, copy, modify, merge, publish, distribute, sublicense,
# and/or sell copies of the Software, and to permit persons to whom the
# Software is furnished to do so, subject to the following conditions:
#
# The above copyright notice and this permission notice shall be included in
# all copies or substantial portions of the Software.
#
# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.  IN NO EVENT SHALL
# THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
# FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
# DEALINGS IN THE SOFTWARE.
################################################################################

[application]
enable-perf-measurement=1
perf-measurement-interval-sec=5

[source0]
enable=1
#Type - 2=URI
type=6
uri=../../../../../samples/streams/sonyc_mixed_audio.wav
num-sources=1
gpu-id=0

[source1]
enable=1
#Type - 2=URI
type=6
uri=../../../../../samples/streams/sonyc_mixed_audio.wav
num-sources=1
gpu-id=0

[streammux]
batch-size=2
sync-inputs=1 # change to enable

[sink0]
enable=1
#Type - 1=FakeSink
type=1
sync=1
source-id=0
gpu-id=0
nvbuf-memory-type=0

[audio-classifier]
enable=1
gpu-id=0
model-engine-file=../../../../../samples/models/SONYC_Audio_Classifier/sonyc_audio_classify.onnx_b2_gpu0_fp32.engine
#property
batch-size=2
nvbuf-memory-type=0
audio-transform=melsdb,fft_length=2560,hop_size=692,dsp_window=hann,num_mels=128,sample_rate=44100,p2db_ref=(float)1.0,p2db_min_power=(float)0.0,p2db_top_db=(float)80.0
# Specify the desired input audio rate to nvinferaudio
# input source(s) shall be audio resampled to this rate
# Here, using 44.1kHz
audio-input-rate=44100
audio-framesize=441000
audio-hopsize=110250
config-file=config_infer_audio_sonyc.txt

[tests]
file-loop=0 # change to disable

output

max_fps_dur 8.33333e+06 min_fps_dur 2e+08
INFO: [FullDims Engine Info]: layers num: 2
0   INPUT  kFLOAT input.1         1x635x128       min: 1x1x635x128     opt: 2x1x635x128     Max: 2x1x635x128
1   OUTPUT kFLOAT output1         31              min: 0               opt: 0               Max: 0


Runtime commands:
        h: Print this help
        q: Quit

        p: Pause
        r: Resume

** INFO: <bus_callback:137>: Pipeline ready

** INFO: <bus_callback:123>: Pipeline running

max_fps_dur 8.33333e+06 min_fps_dur 2e+08

**PERF: FPS 0 (Avg)
**PERF: 0.00 (0.00)
### label:[ 1_engine ] source_id:[1]
### label:[ 1_engine ] source_id:[0]
### label:[ 1_engine ] source_id:[1]
### label:[ 1_engine ] source_id:[0]
### label:[ 1_engine ] source_id:[1]
### label:[ 1_engine ] source_id:[0]

**PERF: FPS 0 (Avg)
**PERF: 25.89 (0.40)

**PERF: FPS 0 (Avg)
**PERF: 0.00 (0.20)

**PERF: FPS 0 (Avg)
**PERF: 0.00 (0.13)

**PERF: FPS 0 (Avg)
**PERF: 0.00 (0.10)

**PERF: FPS 0 (Avg)
**PERF: 0.00 (0.08)

・
・
・

“sync-inputs” parameter is used to synchronize the multiple live sources. It does not comply to the “deepstream-audio” case.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.