I am running Deepstream 5.0 on T4.
I run the following:
root@mooncake-1604:/opt/nvidia/deepstream/deepstream-5.0/samples/configs/deepstream-app# deepstream-app -c source30_1080p_dec_infer-resnet_tiled_display_int8.txt
The configuration of source30_1080p_dec_infer-resnet_tiled_display_int8.txt is as below.
[source0]
enable=1
#Type - 1=CameraV4L2 2=URI 3=MultiURI 4=RTSP
type=3
uri=file://…/…/streams/sample_1080p_h264.mp4
num-sources=16
#drop-frame-interval=3
gpu-id=0
(0): memtype_device - Memory type Device
(1): memtype_pinned - Memory type Host Pinned
(2): memtype_unified - Memory type Unified
cudadec-memtype=0
[source1]
enable=1
#Type - 1=CameraV4L2 2=URI 3=MultiURI 4=RTSP
type=3
uri=file://…/…/streams/sample_1080p_h264.mp4
num-sources=16
#drop-frame-interval=3
gpu-id=0
(0): memtype_device - Memory type Device
(1): memtype_pinned - Memory type Host Pinned
(2): memtype_unified - Memory type Unified
cudadec-memtype=0
[sink0]
enable=1
#Type - 1=FakeSink 2=EglSink 3=File
type=1
sync=1
source-id=0
gpu-id=0
nvbuf-memory-type=0
I found the frame rate will be < 30fps when the number of sources > 30.
It means T4 can decode up to 30 streams, 1080p@30fps H.264.
But it claims that T4 can decode up to 35 streams of 1080p@30fps H.264 with Object detection using 4-class ResNet10 + three ResNet10 classifiers.
Is there anything I can do to improve the performance to 35 streams @ 30fps?
**PERF: FPS 0 (Avg) FPS 1 (Avg) FPS 2 (Avg) FPS 3 (Avg) FPS 4 (Avg) FPS 5 (Avg) FPS 6 (Avg) FPS 7 (Avg) FPS 8 (Avg) FPS 9 (Avg) FPS 10 (Avg) FPS 11 (Avg) FPS 12 (Avg) FPS 13 (Avg) FPS 14 (Avg) FPS 15 (Avg) FPS 16 (Avg) FPS 17 (Avg) FPS 18 (Avg) FPS 19 (Avg) FPS 20 (Avg) FPS 21 (Avg) FPS 22 (Avg) FPS 23 (Avg) FPS 24 (Avg) FPS 25 (Avg) FPS 26 (Avg) FPS 27 (Avg) FPS 28 (Avg) FPS 29 (Avg) FPS 30 (Avg) FPS 31 (Avg)
**PERF: 26.79 (26.62) 26.91 (26.73) 25.97 (25.82) 23.33 (23.20) 24.43 (24.29) 24.88 (24.74) 28.36 (28.16) 24.43 (24.29) 27.16 (26.99) 26.34 (26.18) 27.02 (26.85) 27.02 (26.85) 28.79 (28.59) 28.79 (28.59) 24.77 (24.63) 25.16 (24.74) 26.28 (25.82) 25.49 (25.34) 23.33 (23.20) 28.36 (28.16) 23.84 (23.71) 25.49 (25.34) 25.49 (25.34) 26.77 (26.60) 26.91 (26.73) 26.64 (26.47) 26.79 (26.62) 28.36 (28.16) 28.36 (28.16) 28.36 (28.16) 25.49 (25.34) 26.47 (26.31)
**PERF: 28.19 (27.66) 28.19 (27.71) 28.19 (27.35) 28.18 (26.18) 28.18 (26.63) 27.99 (26.81) 27.99 (28.05) 27.99 (26.63) 27.99 (27.65) 27.99 (27.35) 27.99 (27.60) 27.99 (27.60) 27.99 (28.19) 27.99 (28.19) 27.99 (26.76) 28.01 (26.94) 28.01 (27.35) 28.19 (27.17) 28.19 (26.30) 28.19 (28.19) 28.19 (26.52) 28.19 (27.17) 28.19 (27.17) 28.19 (27.65) 28.19 (27.71) 28.19 (27.60) 28.19 (27.66) 28.19 (28.19) 28.19 (28.19) 28.19 (28.19) 28.19 (27.17) 28.19 (27.53)
**PERF: 27.98 (27.80) 27.98 (27.82) 27.98 (27.61) 27.99 (26.95) 27.99 (27.24) 28.18 (27.35) 28.18 (28.11) 28.18 (27.24) 28.18 (27.87) 28.18 (27.68) 28.18 (27.84) 28.18 (27.84) 28.18 (28.19) 28.18 (28.19) 28.18 (27.31) 28.18 (27.43) 28.18 (27.68) 28.18 (27.57) 28.18 (27.03) 28.18 (28.19) 28.18 (27.16) 28.18 (27.57) 28.18 (27.57) 28.17 (27.79) 28.17 (27.82) 27.98 (27.76) 27.98 (27.80) 27.98 (28.11) 27.98 (28.11) 27.98 (28.11) 27.98 (27.49) 27.98 (27.72)
**PERF: 28.22 (27.91) 28.22 (27.93) 28.22 (27.77) 28.22 (27.30) 28.22 (27.50) 28.22 (27.59) 28.22 (28.14) 28.22 (27.50) 28.22 (27.96) 28.22 (27.83) 28.22 (27.94) 28.19 (27.88) 28.19 (28.14) 28.02 (28.14) 28.02 (27.50) 28.02 (27.59) 28.02 (27.77) 28.02 (27.69) 28.02 (27.30) 28.02 (28.14) 28.02 (27.39) 28.02 (27.69) 28.02 (27.69) 28.03 (27.91) 28.03 (27.93) 28.22 (27.88) 28.22 (27.91) 28.22 (28.14) 28.22 (28.14) 28.22 (28.14) 28.22 (27.69) 28.22 (27.85)
**PERF: 28.22 (27.93) 28.02 (27.95) 28.02 (27.82) 28.02 (27.45) 28.02 (27.61) 28.02 (27.68) 28.02 (28.10) 28.02 (27.61) 28.02 (27.97) 28.02 (27.87) 28.02 (27.95) 28.05 (27.95) 28.05 (28.15) 28.22 (28.15) 28.22 (27.66) 28.22 (27.72) 28.22 (27.87) 28.22 (27.80) 28.22 (27.49) 28.22 (28.15) 28.22 (27.57) 28.22 (27.80) 28.22 (27.80) 28.22 (27.97) 28.22 (27.99) 28.22 (27.95) 28.22 (27.97) 28.22 (28.15) 28.22 (28.15) 28.22 (28.15) 28.22 (27.80) 28.22 (27.88)
**PERF: 28.01 (27.98) 28.21 (27.99) 28.21 (27.89) 28.21 (27.58) 28.21 (27.72) 28.21 (27.77) 28.21 (28.12) 28.21 (27.72) 28.21 (28.01) 28.21 (27.93) 28.21 (28.00) 28.21 (28.00) 28.21 (28.16) 28.21 (28.16) 28.21 (27.75) 28.21 (27.81) 28.21 (27.93) 28.21 (27.87) 28.21 (27.62) 28.20 (28.12) 28.20 (27.65) 28.01 (27.84) 28.01 (27.84) 28.01 (27.98) 28.01 (27.99) 28.01 (27.96) 28.01 (27.98) 28.01 (28.12) 28.01 (28.12) 28.01 (28.12) 28.01 (27.84) 28.01 (27.94)
**PERF: 28.18 (28.01) 28.18 (28.02) 28.18 (27.94) 28.18 (27.67) 28.18 (27.79) 28.18 (27.83) 28.18 (28.13) 28.16 (27.76) 28.16 (28.01) 27.98 (27.94) 27.98 (28.00) 27.98 (28.00) 27.98 (28.13) 27.98 (28.13) 27.98 (27.79) 27.98 (27.83) 27.98 (27.94) 27.98 (27.89) 27.98 (27.67) 27.99 (28.13) 27.99 (27.73) 28.18 (27.89) 28.18 (27.89) 28.18 (28.01) 28.18 (28.02) 28.18 (28.00) 28.18 (28.01) 28.18 (28.13) 28.18 (28.13) 28.18 (28.13) 28.18 (27.89) 28.18 (27.98)
**PERF: 27.97 (28.01) 27.97 (28.02) 27.97 (27.94) 27.97 (27.72) 27.97 (27.82) 27.97 (27.86) 27.97 (28.12) 27.99 (27.82) 27.99 (28.03) 28.17 (27.97) 28.17 (28.02) 28.17 (28.02) 28.17 (28.14) 28.17 (28.14) 28.17 (27.84) 28.17 (27.88) 28.17 (27.97) 28.17 (27.93) 28.17 (27.74) 28.17 (28.14) 28.17 (27.79) 28.17 (27.93) 28.17 (27.93) 28.17 (28.03) 28.17 (28.05) 28.17 (28.02) 28.17 (28.04) 28.16 (28.12) 28.16 (28.12) 27.97 (28.12) 27.97 (27.91) 27.97 (27.98)
**PERF: 28.25 (28.03) 28.25 (28.04) 28.25 (27.97) 28.25 (27.77) 28.25 (27.86) 28.25 (27.90) 28.25 (28.13) 28.25 (27.86) 28.25 (28.05) 28.25 (28.00) 28.25 (28.04) 28.25 (28.04) 28.25 (28.15) 28.25 (28.15) 28.25 (27.89) 28.24 (27.90) 28.24 (27.97) 28.05 (27.94) 28.05 (27.77) 28.05 (28.13) 28.05 (27.82) 28.05 (27.94) 28.05 (27.94) 28.05 (28.03) 28.05 (28.04) 28.05 (28.02) 28.05 (28.03) 28.06 (28.13) 28.06 (28.13) 28.25 (28.13) 28.25 (27.94) 28.25 (28.01)
**PERF: 28.19 (28.05) 28.19 (28.06) 28.19 (28.00) 28.17 (27.80) 28.17 (27.88) 27.99 (27.91) 27.99 (28.11) 27.99 (27.88) 27.99 (28.05) 27.99 (28.00) 27.99 (28.04) 27.99 (28.04) 27.99 (28.13) 27.99 (28.13) 27.99 (27.90) 28.00 (27.93) 28.00 (28.00) 28.19 (27.97) 28.19 (27.82) 28.19 (28.13) 28.19 (27.86) 28.19 (27.97) 28.19 (27.97) 28.19 (28.05) 28.19 (28.06) 28.19 (28.04) 28.19 (28.05) 28.19 (28.13) 28.19 (28.13) 28.19 (28.13) 28.19 (27.97) 28.19 (28.03)
** INFO: <bus_callback:204>: Received EOS. Exiting …