Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU) Jetson Nano
• DeepStream Version 6.0
• JetPack Version (valid for Jetson only) 4.6
• TensorRT Version 8.0.1
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs) questions
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
Hello, I am studying Deepstream SDK using Jetson Nano.
I explain my environment.
I used the deepstream-nvdsanalytics-test provided in deepstream-6.0.
I downloaded trafficcamnet and converted it to an engine file in fp16 mode using tao-converter.
I converted to the command below.
(./tao-converter -k tlt_encode -d 3,544,960 /opt/nvidia/deepstream/deepstream-6.0/samples/models/tao_pretrained_models/trafficcamnet/resnet18_trafficcamnet_pruned.etlt -t fp16 -c /optnvidia/deepstream/deepstream-6.0/samples/models/tao_pretrained_models/trafficcamnet/trafficcamnet_int8.txt -b 4 -m 8)
And I modified config_nvdsanalytics.txt and nvdsanalytic_pgie_config.
It is as below.
################################################################################
Copyright (c) 2020, NVIDIA CORPORATION. All rights reserved.
Permission is hereby granted, free of charge, to any person obtaining a
copy of this software and associated documentation files (the “Software”),
to deal in the Software without restriction, including without limitation
the rights to use, copy, modify, merge, publish, distribute, sublicense,
and/or sell copies of the Software, and to permit persons to whom the
Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in
all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL
THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
DEALINGS IN THE SOFTWARE.
################################################################################
The values in the config file are overridden by values set through GObject
properties.
[property]
enable=1
#Width height used for configuration to which below configs are configured
config-width=1920
config-height=1080
#osd-mode 0: Dont display any lines, rois and text
1: Display only lines, rois and static text i.e. labels
2: Display all info from 1 plus information about counts
osd-mode=2
#Set OSD font size that has to be displayed
display-font-size=12
Per stream configuration
[roi-filtering-stream-0]
#enable or disable following feature
enable=0
#ROI to filter select objects, and remove from meta data
roi-RF=295;643;579;634;642;913;56;828
#remove objects in the ROI
inverse-roi=0
class-id=-1
Per stream configuration
[roi-filtering-stream-2]
#enable or disable following feature
enable=0
#ROI to filter select objects, and remove from meta data
roi-RF=295;643;579;634;642;913;56;828
#remove objects in the ROI
inverse-roi=1
class-id=0
[overcrowding-stream-1]
enable=0
roi-OC=295;643;579;634;642;913;56;828
#no of objects that will trigger OC
object-threshold=3
class-id=-1
[line-crossing-stream-0]
enable=1
#Label;direction;lc
#line-crossing-Entry=1072;911;1143;1058;944;1020;1297;1020;
#line-crossing-Exit=789;672;1084;900;851;773;1203;732
line-crossing-Exit=870;462;1048;929;637;577;1172;504
class-id=0
#extended when 0- only counts crossing on the configured Line
1- assumes extended Line crossing counts all the crossing
extended=0
#LC modes supported:
#loose : counts all crossing without strong adherence to direction
#balanced: Strict direction adherence expected compared to mode=loose
#strict : Strict direction adherence expected compared to mode=balanced
mode=loose
[direction-detection-stream-0]
enable=0
#Label;direction;
direction-South=284;840;360;662;
direction-North=1106;622;1312;701;
class-id=0
################################################################################
Copyright (c) 2020, NVIDIA CORPORATION. All rights reserved.
Permission is hereby granted, free of charge, to any person obtaining a
copy of this software and associated documentation files (the “Software”),
to deal in the Software without restriction, including without limitation
the rights to use, copy, modify, merge, publish, distribute, sublicense,
and/or sell copies of the Software, and to permit persons to whom the
Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in
all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL
THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
DEALINGS IN THE SOFTWARE.
################################################################################
Following properties are mandatory when engine files are not specified:
int8-calib-file(Only in INT8)
Caffemodel mandatory properties: model-file, proto-file, output-blob-names
UFF: uff-file, input-dims, uff-input-blob-name, output-blob-names
ONNX: onnx-file
Mandatory properties for detectors:
num-detected-classes
Optional properties for detectors:
enable-dbscan(Default=false), interval(Primary mode only, Default=0)
custom-lib-path
parse-bbox-func-name
Mandatory properties for classifiers:
classifier-threshold, is-classifier
Optional properties for classifiers:
classifier-async-mode(Secondary mode only, Default=false)
Optional properties in secondary mode:
operate-on-gie-id(Default=0), operate-on-class-ids(Defaults to all classes),
input-object-min-width, input-object-min-height, input-object-max-width,
input-object-max-height
Following properties are always recommended:
batch-size(Default=1)
Other optional properties:
net-scale-factor(Default=1), network-mode(Default=0 i.e FP32),
model-color-format(Default=0 i.e. RGB) model-engine-file, labelfile-path,
mean-file, gie-unique-id(Default=0), offsets, process-mode (Default=1 i.e. primary),
custom-lib-path, network-mode(Default=0 i.e FP32)
The values in the config file are overridden by values set through GObject
properties.
[property]
gpu-id=0
net-scale-factor=0.0039215697906911373
tlt-model-key=tlt_encode
#tlt-encoded-model=/opt/nvidia/deepstream/deepstream-6.0/samples/models/tao_pretrained_models/trafficcamnet/resnet18_trafficcamnet_pruned.etlt
labelfile-path=labels_trafficnet.txt
int8-calib-file=/opt/nvidia/deepstream/deepstream-6.0/samples/models/tao_pretrained_models/trafficcamnet/trafficcamnet_int8.txt
model-engine-file=/opt/nvidia/deepstream/deepstream-6.0/samples/models/tao_pretrained_models/trafficcamnet/resnet18_trafficcamnet_pruned.etlt_b1_gpu0_fp16.engine
input-dims=3;544;960;0
uff-input-blob-name=input_1
batch-size=1
process-mode=1
model-color-format=0
0=FP32, 1=INT8, 2=FP16 mode
network-mode=2
num-detected-classes=4
interval=0
gie-unique-id=1
output-blob-names=output_bbox/BiasAdd;output_cov/Sigmoid
cluster-mode=2
[class-attrs-all]
pre-cluster-threshold=0.2
eps=0.2
group-threshold=1
And I modified the probe of the source and made it print out the FPS.
(It was the same symptom before modifying probe.)
And
./deepstream-nvdsanalytics-test file://opt/nvidia/deepstream/deepstream-6.0/samples/streams/samples_720p.h264, the terminal output shows about 16 FPS.
(I saw in the document provided by Nvidia that Nano’s trafficcamnet fps is 17. Is this difference normal?)
However, the image output on the monitor looks like the FPS is 1.
It’s the same even if I change the video to something else. (e.g. mkv or rtsp…)
How can I watch this video smoothly?
This is a video that shows the symptoms of the stomach that I took.