Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU) - Jetson Xavier NX
• DeepStream Version - 6.2
• JetPack Version (valid for Jetson only) - 5.1.1
• TensorRT Version - 8.5.2.2
• NVIDIA GPU Driver Version (valid for GPU only) - NA
• Issue Type( questions, new requirements, bugs) - questions
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
Trying to implement Pose Classification Net with DeepStream Python. The current Pipeline looks like this-
streammux(multiple streams) → PGIE (PeopleNet) → tracker(NVDCF) → SGIE1 (BodyPose3D Net) ->nvdspreprocess-> SGIE2 (PoseClassificationNet) ->Tiler → nvvidconv(YUV->RGBA) ->OSD ->nvvidconv2(RGBA->I420) ->CapsFilter(I420) → Encoder → filesink.
The pipeline works seamlessly for all frames. but there is a warning for the nvdspreprocess function. the .so file being taken from deepstream_app_3daction_recognition sample application based on the forum question posted here . Changed the input layer shape in the config file as required by the PoseClassificationNet model. The warning is as follows:
/dvs/git/dirty/git-master_linux/deepstream/sdk/apps/deepstream/sample_apps/deepstream-3d-action-recognition/custom_sequence_preprocess/sequence_image_process.cpp:499, [INFO: CUSTOM_LIB] 2D custom sequence network shape NSHW[3, 300, 34, 1], reshaped as [N: 3, C: 3, S:100, H: 34, W:1]
/dvs/git/dirty/git-master_linux/deepstream/sdk/apps/deepstream/sample_apps/deepstream-3d-action-recognition/custom_sequence_preprocess/sequence_image_process.cpp:522, [INFO: CUSTOM_LIB] Sequence preprocess buffer manager initialized with stride: 1, subsample: 0
/dvs/git/dirty/git-master_linux/deepstream/sdk/apps/deepstream/sample_apps/deepstream-3d-action-recognition/custom_sequence_preprocess/sequence_image_process.cpp:526, [INFO: CUSTOM_LIB] SequenceImagePreprocess initialized successfully
Using user provided processing height = 192 and processing width = 256
Q1- I am not sure how to proceed to rectify the above warning since the input is being reshaped in a wrong way.
Q2- Although the pipeline runs without terminating, I am not sure if the classification is happening accurately. Kindly advice on how to get the SGIE2 classification(Action class) displayed on the frame.
pipeline.py (19.1 KB)
config_infer_secondary_bodypose3dnet.txt (2.5 KB)
config_infer_secondary_poseclassification.txt (2.3 KB)
config_preprocess_3d_custom.txt (3.2 KB)