hi, i am new to deepstream 6.0, i have model plan engine converted from pytorch.
model plan file is successfully loaded by deepstream-segmentation-app, but not able to get inference output of random input jpeg format image.
here is the below error
i ran below command to test deepstream-segmentation-app
deepstream-segmentation-app segmentation_config_semantic.txt /opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_720p.mjpeg
root@33c18080f95b:/opt/nvidia/deepstream/deepstream-6.0/samples# deepstream-segmentation-app segmentation_config_semantic.txt /opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_720p.mjpeg
Now playing: /opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_720p.mjpeg,
0:00:02.072053611 46 0x561dc5e7db60 INFO nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1900> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.0/samples/model.plan
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [FullDims Engine Info]: layers num: 2
0 INPUT kFLOAT input 3x-1x-1 min: 1x3x224x224 opt: 1x3x1026x1282 Max: 1x3x1440x2560
1 OUTPUT kINT32 output 1x-1x-1 min: 0 opt: 0 Max: 0
0:00:02.072147088 46 0x561dc5e7db60 INFO nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2004> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.0/samples/model.plan
0:00:02.087519621 46 0x561dc5e7db60 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<primary-nvinference-engine> [UID 1]: Load new model:segmentation_config_semantic.txt sucessfully
Running...
in videoconvert caps = video/x-raw(memory:NVMM), format=(string)RGBA, framerate=(fraction)1/1, width=(int)512, height=(int)512
0:00:02.348382995 46 0x561dc4b82940 WARN nvinfer gstnvinfer.cpp:2288:gst_nvinfer_output_loop:<primary-nvinference-engine> error: Internal data stream error.
0:00:02.348413055 46 0x561dc4b82940 WARN nvinfer gstnvinfer.cpp:2288:gst_nvinfer_output_loop:<primary-nvinference-engine> error: streaming stopped, reason not-negotiated (-4)
ERROR from element primary-nvinference-engine: Internal data stream error.
Error details: gstnvinfer.cpp(2288): gst_nvinfer_output_loop (): /GstPipeline:dstest-image-decode-pipeline/GstNvInfer:primary-nvinference-engine:
streaming stopped, reason not-negotiated (-4)
Returned, stopping playback
Deleting pipeline
i have also tested with sample app (/opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-segmentation-test) model available in samples, but its giving me same above error.
attached config file
segmentation_config_semantic.txt (3.7 KB)
when i tried with video - from sample streams with below command
deepstream-segmentation-app segmentation_config_semantic.txt /opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_720p.mp4
i got below error
root@33c18080f95b:/opt/nvidia/deepstream/deepstream-6.0/samples# deepstream-segmentation-app segmentation_config_semantic.txt /opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_720p.mp4
Now playing: /opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_720p.mp4,
0:00:02.131119436 59 0x560298e41b60 INFO nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1900> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.0/samples/model.plan
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [FullDims Engine Info]: layers num: 2
0 INPUT kFLOAT input 3x-1x-1 min: 1x3x224x224 opt: 1x3x1026x1282 Max: 1x3x1440x2560
1 OUTPUT kINT32 output 1x-1x-1 min: 0 opt: 0 Max: 0
0:00:02.131206963 59 0x560298e41b60 INFO nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2004> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.0/samples/model.plan
0:00:02.147493739 59 0x560298e41b60 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<primary-nvinference-engine> [UID 1]: Load new model:segmentation_config_semantic.txt sucessfully
Running...
ERROR from element jpeg-parser: No valid frames found before end of stream
Error details: gstbaseparse.c(3603): gst_base_parse_loop (): /GstPipeline:dstest-image-decode-pipeline/GstBin:source-bin-00/GstJpegParse:jpeg-parser
Returned, stopping playback
Deleting pipeline
please help and provide correct resolution with instructions, how to get correct segmented output?