Yolov7 Deepstream application won't start

• Hardware Platform (Jetson / GPU)
TitanRTX

• DeepStream Version
6.1.1 Developer

• Issue Type( questions, new requirements, bugs)
Start problem

• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

Config_infer_primary.txt

[property]
gpu-id=0
net-scale-factor=1.0
offsets=103.939;116.779;123.68
model-color-format=1
labelfile-path=lp_labels.txt
onnx-file=/opt/nvidia/deepstream/deepstream-6.1/samples/configs/tao_pretrained_models/best.onnx
model-engine-file=../../models/tao_pretrained_models/yolov4/yolov7.onnx_b1_gpu0_int8.engine
infer-dims=3;1920;1088
maintain-aspect-ratio=1
uff-input-order=0
uff-input-blob-name=Input
batch-size=1
## 0=FP32, 1=INT8, 2=FP16 mode
network-mode=0
num-detected-classes=80
interval=0
gie-unique-id=1
is-classifier=0
cluster-mode=3
parse-bbox-func-name=NvDsInferParseCustomYoloV7
custom-lib-path=/opt/nvidia/deepstream/deepstream/lib/libnvdsinfer_custom_impl_Yolo.so


[class-attrs-1]
nms-iou-threshold=0.01

deepstream_app_source_yolov7.txt

[application]
enable-perf-measurement=1
perf-measurement-interval-sec=1
gie-kitti-output-dir=/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/labels

[tiled-display]
enable=1
rows=1
columns=1
#width=1280
#height=720
width=3840
height=2160
gpu-id=0
#(0): nvbuf-mem-default - Default memory allocated, specific to particular platform
#(1): nvbuf-mem-cuda-pinned - Allocate Pinned/Host cuda memory, applicable for Tesla
#(2): nvbuf-mem-cuda-device - Allocate Device cuda memory, applicable for Tesla
#(3): nvbuf-mem-cuda-unified - Allocate Unified cuda memory, applicable for Tesla
#(4): nvbuf-mem-surface-array - Allocate Surface Array memory, applicable for Jetson
nvbuf-memory-type=3


[source0]
enable=1
#Type - 1=CameraV4L2 2=URI 3=MultiURI
type=3
num-sources=1
uri=file://../../streams/testvideo_astemo_new.mp4
gpu-id=0
# (0): memtype_device   - Memory type Device
# (1): memtype_pinned   - Memory type Host Pinned
# (2): memtype_unified  - Memory type Unified
cudadec-memtype=0
nvbuf-memory-type=3


[streammux]
gpu-id=0
batch-size=1
batched-push-timeout=80000
## Set muxer output width and height
#width=1280
#height=720
width=3840
height=2160
nvbuf-memory-type=0

[sink0]
enable=1
#Type - 1=FakeSink 2=EglSink 3=File
type=1
sync=0
source-id=0
gpu-id=0
nvbuf-memory-type=3
qos=0

[osd]
enable=1
gpu-id=0
border-width=3
text-size=15
text-color=1;1;1;1;
text-bg-color=0.3;0.3;0.3;1
font=Arial
nvbuf-memory-type=3


[primary-gie]
enable=1
gpu-id=0
# Modify as necessary
batch-size=1
#Required by the app for OSD, not a plugin property
bbox-border-color0=1;0;0;1
bbox-border-color1=0;1;1;1
bbox-border-color2=0;0;1;1
bbox-border-color3=0;1;0;1
gie-unique-id=1
# Replace the infer primary config file when you need to
# use other detection models
#config-file=config_infer_primary_frcnn.txt
#config-file=config_infer_primary_ssd.txt
#config-file=config_infer_primary_dssd.txt
#config-file=config_infer_primary_retinanet.txt
#config-file=config_infer_primary_yolov3.txt
config-file=config_infer_primary_yolov4_lp.txt
#config-file=config_infer_primary_detectnet_v2.txt
nvbuf-memory-type=3


[sink1]
enable=1
type=3
#1=mp4 2=mkv
container=1
#1=h264 2=h265 3=mpeg4
codec=1
#encoder type 0=Hardware 1=Software
enc-type=0
sync=0
bitrate=27000000
#H264 Profile - 0=Baseline 2=Main 4=High
#H265 Profile - 0=Main 1=Main10
profile=0
output-file=output.mp4
source-id=0

[sink2]
enable=1
#Type - 1=FakeSink 2=EglSink 3=File 4=RTSPStreaming 5=Overlay
type=1
#1=h264 2=h265
codec=1
#encoder type 0=Hardware 1=Software
enc-type=0
sync=0
bitrate=4000000
#H264 Profile - 0=Baseline 2=Main 4=High
#H265 Profile - 0=Main 1=Main10
profile=0
# set below properties in case of RTSPStreaming
rtsp-port=8554
udp-port=5400

[tracker]
enable=0
# For NvDCF and DeepSORT tracker, tracker-width and tracker-height must be a multiple of 32, respectively
tracker-width=640
tracker-height=384
ll-lib-file=/opt/nvidia/deepstream/deepstream-6.1/lib/libnvds_nvmultiobjecttracker.so
# ll-config-file required to set different tracker types
# ll-config-file=../deepstream-app/config_tracker_IOU.yml
# ll-config-file=../deepstream-app/config_tracker_NvDCF_perf.yml
 ll-config-file=../deepstream-app/config_tracker_NvDCF_accuracy.yml
# ll-config-file=../deepstream-app/config_tracker_DeepSORT.yml
gpu-id=0
enable-batch-process=1
enable-past-frame=1
display-tracking-id=1

[tests]
file-loop=0

[ds-example]
enable=1
processing-width=1248
processing-height=384
full-frame=0
blur-objects=0
unique-id=15
nvbuf-memory-type=3

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
I have an deepstream application where I want to use a trained yolov7 net. However when I try to run the deepstream application it just stops after telling me that the pipeline is running. The console output is seen above:

(gst-plugin-scanner:7): GStreamer-WARNING **: 10:17:27.724: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstchromaprint.so': libavcodec.so.58: cannot open shared object file: No such file or directory

(gst-plugin-scanner:7): GStreamer-WARNING **: 10:17:29.142: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.0: cannot open shared object file: No such file or directory

(gst-plugin-scanner:7): GStreamer-WARNING **: 10:17:29.640: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so': libtritonserver.so: cannot open shared object file: No such file or directory
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1482 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-6.1/samples/configs/tao_pretrained_models/../../models/tao_pretrained_models/yolov4/yolov7.onnx_b1_gpu0_int8.engine open error
0:00:06.698572688     1 0x564592601290 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-6.1/samples/configs/tao_pretrained_models/../../models/tao_pretrained_models/yolov4/yolov7.onnx_b1_gpu0_int8.engine failed
0:00:06.725895280     1 0x564592601290 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-6.1/samples/configs/tao_pretrained_models/../../models/tao_pretrained_models/yolov4/yolov7.onnx_b1_gpu0_int8.engine failed, try rebuild
0:00:06.725923700     1 0x564592601290 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 1]: Trying to create engine from model files
WARNING: [TRT]: onnx2trt_utils.cpp:369: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
0:03:35.459744384     1 0x564592601290 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 1]: serialize cuda engine to file: /opt/nvidia/deepstream/deepstream-6.1/samples/configs/tao_pretrained_models/best.onnx_b1_gpu0_fp32.engine successfully
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 5
0   INPUT  kFLOAT images          3x1920x1088     
1   OUTPUT kINT32 num_dets        1               
2   OUTPUT kFLOAT det_boxes       1000x4          
3   OUTPUT kFLOAT det_scores      1000            
4   OUTPUT kINT32 det_classes     1000            

0:03:35.518527669     1 0x564592601290 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<primary_gie> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-6.1/samples/configs/tao_pretrained_models/config_infer_primary_yolov4_lp.txt sucessfully

Runtime commands:
	h: Print this help
	q: Quit

	p: Pause
	r: Resume

NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source.
      To go back to the tiled display, right-click anywhere on the window.


**PERF:  FPS 0 (Avg)	
**PERF:  0.00 (0.00)	
** INFO: <bus_callback:194>: Pipeline ready

WARNING from src_elem: No decoder available for type 'audio/mpeg, mpegversion=(int)4, framed=(boolean)true, stream-format=(string)raw, level=(string)2, base-profile=(string)lc, profile=(string)lc, codec_data=(buffer)1190, rate=(int)48000, channels=(int)2'.
Debug info: gsturidecodebin.c(920): unknown_type_cb (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstURIDecodeBin:src_elem
** INFO: <bus_callback:180>: Pipeline running

After this there is no more happening. What is it that I’m doing wrong or what part of my configuration files need to be changed?

Can you run “gst-inspect-1.0” in your enviroment?

Yes this are some of the outputs:

video4linux2:  v4l2radio: Radio (video4linux2) Tuner
video4linux2:  v4l2deviceprovider (GstDeviceProviderFactory)
accurip:  accurip: AccurateRip(TM) CRC element
wavpack:  wavpackdec: Wavpack audio decoder
wavpack:  wavpackenc: Wavpack audio encoder
videotestsrc:  videotestsrc: Video test source
coreelements:  capsfilter: CapsFilter
coreelements:  concat: Concat
coreelements:  dataurisrc: data: URI source element
coreelements:  downloadbuffer: DownloadBuffer
coreelements:  fakesrc: Fake Source
coreelements:  fakesink: Fake Sink
coreelements:  fdsrc: Filedescriptor Source
coreelements:  fdsink: Filedescriptor Sink
coreelements:  filesrc: File Source
coreelements:  funnel: Funnel pipe fitting
coreelements:  identity: Identity
coreelements:  input-selector: Input selector
coreelements:  output-selector: Output selector
coreelements:  queue: Queue
coreelements:  queue2: Queue 2
coreelements:  filesink: File Sink
coreelements:  tee: Tee pipe fitting
coreelements:  typefind: TypeFind
coreelements:  multiqueue: MultiQueue
coreelements:  valve: Valve element
coreelements:  streamiddemux: Streamid Demux
webrtcdsp:  webrtcdsp: Voice Processor (AGC, AEC, filters, etc.)
webrtcdsp:  webrtcechoprobe: Accoustic Echo Canceller probe
1394:  dv1394src: Firewire (1394) DV video source
1394:  hdv1394src: Firewire (1394) HDV video source
imagefreeze:  imagefreeze: Still frame stream generator
ogg:  oggdemux: Ogg demuxer
ogg:  oggmux: Ogg muxer
ogg:  ogmaudioparse: OGM audio stream parser
ogg:  ogmvideoparse: OGM video stream parser
ogg:  ogmtextparse: OGM text stream parser
ogg:  oggparse: Ogg parser
ogg:  oggaviparse: Ogg AVI parser
sdpelem:  sdpdemux: SDP session setup
sdpelem:  sdpsrc: SDP Source
videosignal:  videoanalyse: Video analyser
videosignal:  simplevideomarkdetect: Video detecter
videosignal:  simplevideomark: Video marker
mpegpsdemux:  mpegpsdemux: MPEG Program Stream Demuxer
aiff:  aiffparse: AIFF audio demuxer
aiff:  aiffmux: AIFF audio muxer
overlaycomposition:  overlaycomposition: Overlay Composition
decklink:  decklinkaudiosink: Decklink Audio Sink
decklink:  decklinkvideosink: Decklink Video Sink
decklink:  decklinkaudiosrc: Decklink Audio Source
decklink:  decklinkvideosrc: Decklink Video Source
y4mdec:  y4mdec: YUV4MPEG demuxer/decoder
mms:  mmssrc: MMS streaming source
webp:  webpdec: WebP image decoder
webp:  webpenc: WEBP image encoder
encoding:  encodebin: Encoder Bin
coloreffects:  coloreffects: Color Look-up Table filter
coloreffects:  chromahold: Chroma hold filter
oss4:  oss4sink: OSS v4 Audio Sink
oss4:  oss4src: OSS v4 Audio Source
a52dec:  a52dec: ATSC A/52 audio decoder
dvdspu:  dvdspu: Sub-picture Overlay
ossaudio:  osssrc: Audio Source (OSS)
ossaudio:  osssink: Audio Sink (OSS)
isomp4:  qtdemux: QuickTime demuxer
isomp4:  rtpxqtdepay: RTP packet depayloader
isomp4:  qtmux: QuickTime Muxer
isomp4:  mp4mux: MP4 Muxer
isomp4:  ismlmux: ISML Muxer
isomp4:  3gppmux: 3GPP Muxer
isomp4:  mj2mux: MJ2 Muxer
isomp4:  qtmoovrecover: QT Moov Recover
id3tag:  id3mux: ID3 v1 and v2 Muxer
bayer:  bayer2rgb: Bayer to RGB decoder for cameras
bayer:  rgb2bayer: RGB to Bayer converter
videofilter:  gamma: Video gamma correction
videofilter:  videobalance: Video balance
videofilter:  videoflip: Video flipper
videofilter:  videomedian: Median effect
audiomixmatrix:  audiomixmatrix: Matrix audio mix
sndfile:  sfdec: Sndfile decoder
adpcmenc:  adpcmenc: ADPCM encoder
soup:  souphttpsrc: HTTP client source
soup:  souphttpclientsink: HTTP client sink
udp:  udpsink: UDP packet sender
udp:  multiudpsink: UDP packet sender
udp:  dynudpsink: UDP packet sender
udp:  udpsrc: UDP packet receiver
interleave:  interleave: Audio interleaver
interleave:  deinterleave: Audio deinterleaver
shout2:  shout2send: Icecast network sink
jp2kdecimator:  jp2kdecimator: JPEG2000 decimator
auparse:  auparse: AU audio demuxer
debug:  breakmydata: Break my data
debug:  capssetter: CapsSetter
debug:  rndbuffersize: Random buffer size
debug:  navseek: Seek based on left-right arrows
debug:  pushfilesrc: Push File Source
debug:  progressreport: Progress report
debug:  taginject: TagInject
debug:  testsink: Test plugin
debug:  cpureport: CPU report
sid:  siddec: Sid decoder
dvbsuboverlay:  dvbsuboverlay: DVB Subtitles Overlay
y4menc:  y4menc: YUV4MPEG video encoder
videorate:  videorate: Video rate adjuster
smoothstreaming:  mssdemux: Smooth Streaming demuxer
openal:  openalsink: OpenAL Audio Sink
openal:  openalsrc: OpenAL Audio Source
festival:  festival: Festival Text-to-Speech synthesizer
bs2b:  bs2b: Crossfeed effect
resindvd:  rsndvdbin: rsndvdbin
shm:  shmsrc: Shared Memory Source
shm:  shmsink: Shared Memory Sink
vorbis:  vorbisenc: Vorbis audio encoder
vorbis:  vorbisdec: Vorbis audio decoder
vorbis:  vorbisparse: VorbisParse
vorbis:  vorbistag: VorbisTag
midi:  midiparse: MidiParse
equalizer:  equalizer-nbands: N Band Equalizer
equalizer:  equalizer-3bands: 3 Band Equalizer
equalizer:  equalizer-10bands: 10 Band Equalizer
realmedia:  rmdemux: RealMedia Demuxer
realmedia:  rademux: RealAudio Demuxer
realmedia:  rdtdepay: RDT packet parser
realmedia:  rdtmanager: RTP Decoder
realmedia:  rtspreal: RealMedia RTSP Extension
realmedia:  pnmsrc: PNM packet receiver
pcapparse:  pcapparse: PCapParse
pcapparse:  irtspparse: IRTSPParse
soundtouch:  pitch: Pitch controller
soundtouch:  bpmdetect: BPM Detector
openjpeg:  openjpegdec: OpenJPEG JPEG2000 decoder
openjpeg:  openjpegenc: OpenJPEG JPEG2000 encoder
waylandsink:  waylandsink: wayland video sink
x264:  x264enc: x264enc
audiofx:  audiopanorama: Stereo positioning
audiofx:  audioinvert: Audio inversion
audiofx:  audiokaraoke: AudioKaraoke
audiofx:  audioamplify: Audio amplifier
audiofx:  audiodynamic: Dynamic range controller
audiofx:  audiocheblimit: Low pass & high pass filter
audiofx:  audiochebband: Band pass & band reject filter
audiofx:  audioiirfilter: Audio IIR filter
audiofx:  audiowsinclimit: Low pass & high pass filter
audiofx:  audiowsincband: Band pass & band reject filter
audiofx:  audiofirfilter: Audio FIR filter
audiofx:  audioecho: Audio echo
audiofx:  scaletempo: Scaletempo
audiofx:  stereo: Stereo effect
faceoverlay:  faceoverlay: faceoverlay
bz2:  bz2enc: BZ2 encoder
bz2:  bz2dec: BZ2 decoder
gme:  gmedec: Gaming console music file decoder
audioconvert:  audioconvert: Audio converter
videocrop:  videocrop: Crop
videocrop:  aspectratiocrop: aspectratiocrop
aasink:  aasink: ASCII art video sink
deinterlace:  deinterlace: Deinterlacer
dtmf:  dtmfsrc: DTMF tone generator
dtmf:  rtpdtmfsrc: RTP DTMF packet generator
dtmf:  rtpdtmfdepay: RTP DTMF packet depayloader
flxdec:  flxdec: FLX video decoder
rtponvif:  rtponviftimestamp: ONVIF NTP timestamps RTP extension
rtponvif:  rtponvifparse: ONVIF NTP timestamps RTP extension
cutter:  cutter: Audio cutter
srtp:  srtpenc: SRTP encoder
srtp:  srtpdec: SRTP decoder
timecode:  timecodestamper: Timecode stamper
timecode:  avwait: Timecode Wait
ivfparse:  ivfparse: IVF parser
fbdevsink:  fbdevsink: fbdev video sink
rtspclientsink:  rtspclientsink: RTSP RECORD client
alpha:  alpha: Alpha filter
dashdemux:  dashdemux: DASH Demuxer
vpx:  vp8dec: On2 VP8 Decoder
vpx:  vp8enc: On2 VP8 Encoder
vpx:  vp9dec: On2 VP9 Decoder
vpx:  vp9enc: On2 VP9 Encoder
videomixer:  videomixer: Video mixer 2
musepack:  musepackdec: Musepack decoder
smpte:  smpte: SMPTE transitions
smpte:  smptealpha: SMPTE transitions
asf:  asfdemux: ASF Demuxer
asf:  rtspwms: WMS RTSP Extension
asf:  rtpasfdepay: RTP ASF packet depayloader
volume:  volume: Volume
pnm:  pnmdec: PNM image decoder
pnm:  pnmenc: PNM image encoder
jack:  jackaudiosrc: Audio Source (Jack)
jack:  jackaudiosink: Audio Sink (Jack)
mpeg2dec:  mpeg2dec: mpeg1 and mpeg2 video decoder
zbar:  zbar: Barcode detector
coretracers:  latency (GstTracerFactory)
coretracers:  log (GstTracerFactory)
coretracers:  rusage (GstTracerFactory)
coretracers:  stats (GstTracerFactory)
coretracers:  leaks (GstTracerFactory)
xingmux:  xingmux: MP3 Xing muxer
smooth:  smooth: Smooth effect
monoscope:  monoscope: Monoscope
wildmidi:  wildmididec: WildMidi-based MIDI music decoder
dv:  dvdemux: DV system stream demuxer
dv:  dvdec: DV video decoder
kms:  kmssink: KMS video sink
opusparse:  opusparse: Opus audio parser
dvdsub:  dvdsubdec: DVD subtitle decoder
dvdsub:  dvdsubparse: DVD subtitle parser
ipcpipeline:  ipcpipelinesrc: Inter-process Pipeline Source
ipcpipeline:  ipcpipelinesink: Inter-process Pipeline Sink
ipcpipeline:  ipcslavepipeline: Inter-process slave pipeline
wavenc:  wavenc: WAV audio muxer
mulaw:  mulawenc: Mu Law audio encoder
mulaw:  mulawdec: Mu Law audio decoder
mpeg2enc:  mpeg2enc: mpeg2enc video encoder
removesilence:  removesilence: RemoveSilence
assrender:  assrender: ASS/SSA Render
spectrum:  spectrum: Spectrum analyzer
alphacolor:  alphacolor: Alpha color filter
srt:  srtsrc: SRT source
srt:  srtsink: SRT sink
srt:  srtclientsrc: SRT source
srt:  srtserversrc: SRT source
srt:  srtclientsink: SRT sink
srt:  srtserversink: SRT sink
hls:  hlsdemux: HLS Demuxer
hls:  hlssink: HTTP Live Streaming sink
hls:  hlssink2: HTTP Live Streaming sink
goom:  goom: GOOM: what a GOOM!
audiomixer:  audiomixer: AudioMixer
audiomixer:  liveadder: AudioMixer
audiomixer:  audiointerleave: AudioInterleave
app:  appsrc: AppSrc
app:  appsink: AppSink
level:  level: Level
sbc:  sbcdec: Bluetooth SBC audio decoder
sbc:  sbcenc: Bluetooth SBC audio encoder
dc1394:  dc1394src: 1394 IIDC Video Source
taglib:  id3v2mux: TagLib-based ID3v2 Muxer
taglib:  apev2mux: TagLib-based APEv2 Muxer
autodetect:  autovideosink: Auto video sink
autodetect:  autovideosrc: Auto video source
autodetect:  autoaudiosink: Auto audio sink
autodetect:  autoaudiosrc: Auto audio source
siren:  sirendec: Siren Decoder element
siren:  sirenenc: Siren Encoder element
adpcmdec:  adpcmdec: ADPCM decoder
dvdread:  dvdreadsrc: DVD Source
gdkpixbuf:  gdkpixbufdec: GdkPixbuf image decoder
gdkpixbuf:  gdkpixbufoverlay: GdkPixbuf Overlay
gdkpixbuf:  gdkpixbufsink: GdkPixbuf sink
dtsdec:  dtsdec: DTS audio decoder
mpegpsmux:  mpegpsmux: MPEG Program Stream Muxer
interlace:  interlace: Interlace filter
typefindfunctions: video/x-ms-asf: asf, wm, wma, wmv
typefindfunctions: audio/x-musepack: mpc, mpp, mp+
typefindfunctions: audio/x-au: au, snd
typefindfunctions: video/x-msvideo: avi
typefindfunctions: audio/qcelp: qcp
typefindfunctions: video/x-cdxa: dat
typefindfunctions: video/x-vcd: dat
typefindfunctions: audio/x-imelody: imy, ime, imelody
typefindfunctions: application/x-scc: scc
typefindfunctions: application/x-mcc: mcc
typefindfunctions: audio/midi: mid, midi
typefindfunctions: audio/riff-midi: mid, midi
typefindfunctions: audio/mobile-xmf: mxmf
typefindfunctions: video/x-fli: flc, fli
typefindfunctions: application/x-id3v2: mp3, mp2, mp1, mpga, ogg, flac, tta
typefindfunctions: application/x-id3v1: mp3, mp2, mp1, mpga, ogg, flac, tta
typefindfunctions: application/x-apetag: mp3, ape, mpc, wv
typefindfunctions: audio/x-ttafile: tta
typefindfunctions: audio/x-mod: 669, amf, ams, dbm, digi, dmf, dsm, gdm, far, imf, it, j2b, mdl, med, mod, mt2, mtm, okt, psm, ptm, sam, s3m, stm, stx, ult, umx, xm
typefindfunctions: audio/mpeg: mp3, mp2, mp1, mpga
typefindfunctions: audio/x-ac3: ac3, eac3
typefindfunctions: audio/x-dts: dts
typefindfunctions: audio/x-gsm: gsm
typefindfunctions: video/mpeg-sys: mpe, mpeg, mpg
typefindfunctions: video/mpegts: ts, mts
typefindfunctions: application/ogg: ogg, oga, ogv, ogm, ogx, spx, anx, axa, axv
typefindfunctions: video/mpeg-elementary: mpv, mpeg, mpg
typefindfunctions: video/mpeg4: m4v
typefindfunctions: video/x-h263: h263, 263
typefindfunctions: video/x-h264: h264, x264, 264
typefindfunctions: video/x-h265: h265, x265, 265
typefindfunctions: video/x-nuv: nuv
typefindfunctions: audio/x-m4a: m4a
typefindfunctions: application/x-3gp: 3gp
typefindfunctions: video/quicktime: mov, mp4
typefindfunctions: image/x-quicktime: qif, qtif, qti
typefindfunctions: image/jp2: jp2
typefindfunctions: image/x-jpc: jpc, j2k
typefindfunctions: video/mj2: mj2
typefindfunctions: text/html: htm, html
typefindfunctions: application/vnd.rn-realmedia: ra, ram, rm, rmvb
typefindfunctions: application/x-pn-realaudio: ra, ram, rm, rmvb
typefindfunctions: application/x-shockwave-flash: swf, swfl
typefindfunctions: application/xges: xges
typefindfunctions: application/dash+xml: mpd, MPD
typefindfunctions: application/vnd.ms-sstr+xml: no extensions
typefindfunctions: video/x-flv: flv
typefindfunctions: text/plain: txt
typefindfunctions: text/utf-16: txt
typefindfunctions: text/utf-32: txt
typefindfunctions: text/uri-list: ram
typefindfunctions: application/itc: itc
typefindfunctions: application/x-hls: m3u8
typefindfunctions: application/sdp: sdp
typefindfunctions: application/smil: smil
typefindfunctions: application/ttml+xml: ttml+xml
typefindfunctions: application/xml: xml
typefindfunctions: audio/x-wav: wav
typefindfunctions: audio/x-aiff: aiff, aif, aifc
typefindfunctions: audio/x-svx: iff, svx
typefindfunctions: audio/x-paris: paf
typefindfunctions: audio/x-nist: nist
typefindfunctions: audio/x-voc: voc
typefindfunctions: audio/x-sds: sds
typefindfunctions: audio/x-ircam: sf
typefindfunctions: audio/x-w64: w64
typefindfunctions: audio/x-rf64: rf64
typefindfunctions: audio/x-shorten: shn
typefindfunctions: application/x-ape: ape
typefindfunctions: image/jpeg: jpg, jpe, jpeg
typefindfunctions: image/gif: gif
typefindfunctions: image/png: png
typefindfunctions: image/bmp: bmp
typefindfunctions: image/tiff: tif, tiff
typefindfunctions: image/webp: webp
typefindfunctions: image/x-exr: exr
typefindfunctions: image/x-portable-pixmap: pnm, ppm, pgm, pbm
typefindfunctions: video/x-matroska: mkv, mka, mk3d, webm
typefindfunctions: application/mxf: mxf
typefindfunctions: video/x-mve: mve
typefindfunctions: video/x-dv: dv, dif
typefindfunctions: audio/x-amr-nb-sh: amr
typefindfunctions: audio/x-amr-wb-sh: amr
typefindfunctions: audio/iLBC-sh: ilbc
typefindfunctions: audio/x-sbc: sbc
typefindfunctions: audio/x-sid: sid
typefindfunctions: image/x-xcf: xcf
typefindfunctions: video/x-mng: mng
typefindfunctions: image/x-jng: jng
typefindfunctions: image/x-xpixmap: xpm
typefindfunctions: image/x-sun-raster: ras
typefindfunctions: application/x-bzip: bz2
typefindfunctions: application/x-gzip: gz
typefindfunctions: application/zip: zip
typefindfunctions: application/x-compress: Z
typefindfunctions: subtitle/x-kate: no extensions
typefindfunctions: application/x-subtitle-vtt: vtt
typefindfunctions: audio/x-flac: flac
typefindfunctions: audio/x-vorbis: no extensions
typefindfunctions: video/x-theora: no extensions
typefindfunctions: application/x-ogm-video: no extensions
typefindfunctions: application/x-ogm-audio: no extensions
typefindfunctions: application/x-ogm-text: no extensions
typefindfunctions: audio/x-speex: no extensions
typefindfunctions: audio/x-celt: no extensions
typefindfunctions: application/x-ogg-skeleton: no extensions
typefindfunctions: text/x-cmml: no extensions
typefindfunctions: application/x-executable: no extensions
typefindfunctions: audio/aac: aac, adts, adif, loas
typefindfunctions: audio/x-spc: spc
typefindfunctions: audio/x-wavpack: wv, wvp
typefindfunctions: audio/x-wavpack-correction: wvc
typefindfunctions: audio/x-caf: caf
typefindfunctions: application/postscript: ps
typefindfunctions: image/svg+xml: svg
typefindfunctions: application/x-rar: rar
typefindfunctions: application/x-tar: tar
typefindfunctions: application/x-ar: a
typefindfunctions: application/x-ms-dos-executable: dll, exe, ocx, sys, scr, msstyles, cpl
typefindfunctions: video/x-dirac: no extensions
typefindfunctions: multipart/x-mixed-replace: no extensions
typefindfunctions: application/x-mmsh: no extensions
typefindfunctions: video/vivo: viv
typefindfunctions: audio/x-nsf: nsf
typefindfunctions: audio/x-gym: gym
typefindfunctions: audio/x-ay: ay
typefindfunctions: audio/x-gbs: gbs
typefindfunctions: audio/x-vgm: vgm
typefindfunctions: audio/x-sap: sap
typefindfunctions: video/x-ivf: ivf
typefindfunctions: audio/x-kss: kss
typefindfunctions: application/pdf: pdf
typefindfunctions: application/msword: doc
typefindfunctions: image/vnd.adobe.photoshop: psd
typefindfunctions: image/vnd.wap.wbmp: no extensions
typefindfunctions: application/x-yuv4mpeg: no extensions
typefindfunctions: image/x-icon: no extensions
typefindfunctions: image/x-degas: no extensions
typefindfunctions: application/octet-stream: no extensions
typefindfunctions: application/x-ssa: ssa, ass
typefindfunctions: video/x-pva: pva
typefindfunctions: audio/x-xi: xi
typefindfunctions: audio/audible: aa, aax
typefindfunctions: audio/x-tap-tap: tap
typefindfunctions: audio/x-tap-dmp: dmp
dtls:  dtlsenc: DTLS Encoder
dtls:  dtlsdec: DTLS Decoder
dtls:  dtlssrtpdec: DTLS-SRTP Decoder
dtls:  dtlssrtpenc: DTLS-SRTP Encoder
dtls:  dtlssrtpdemux: DTLS SRTP Demultiplexer
segmentclip:  audiosegmentclip: Audio buffer segment clipper
segmentclip:  videosegmentclip: Video buffer segment clipper
proxy:  proxysrc: Proxy source
proxy:  proxysink: Proxy Sink
rtp:  rtpac3depay: RTP AC3 depayloader
rtp:  rtpac3pay: RTP AC3 audio payloader
rtp:  rtpbvdepay: RTP BroadcomVoice depayloader
rtp:  rtpbvpay: RTP BV Payloader
rtp:  rtpceltdepay: RTP CELT depayloader
rtp:  rtpceltpay: RTP CELT payloader
rtp:  rtpdvdepay: RTP DV Depayloader
rtp:  rtpdvpay: RTP DV Payloader
rtp:  rtpgstdepay: GStreamer depayloader
rtp:  rtpgstpay: RTP GStreamer payloader
rtp:  rtpilbcpay: RTP iLBC Payloader
rtp:  rtpilbcdepay: RTP iLBC depayloader
rtp:  rtpg722depay: RTP audio depayloader
rtp:  rtpg722pay: RTP audio payloader
rtp:  rtpg723depay: RTP G.723 depayloader
rtp:  rtpg723pay: RTP G.723 payloader
rtp:  rtpg726depay: RTP G.726 depayloader
rtp:  rtpg726pay: RTP G.726 payloader
rtp:  rtpg729depay: RTP G.729 depayloader
rtp:  rtpg729pay: RTP G.729 payloader
rtp:  rtpgsmdepay: RTP GSM depayloader
rtp:  rtpgsmpay: RTP GSM payloader
rtp:  rtpamrdepay: RTP AMR depayloader
rtp:  rtpamrpay: RTP AMR payloader
rtp:  rtppcmadepay: RTP PCMA depayloader
rtp:  rtppcmudepay: RTP PCMU depayloader
rtp:  rtppcmupay: RTP PCMU payloader
rtp:  rtppcmapay: RTP PCMA payloader
rtp:  rtpmpadepay: RTP MPEG audio depayloader
rtp:  rtpmpapay: RTP MPEG audio payloader
rtp:  rtpmparobustdepay: RTP MPEG audio depayloader
rtp:  rtpmpvdepay: RTP MPEG video depayloader
rtp:  rtpmpvpay: RTP MPEG2 ES video payloader
rtp:  rtpopusdepay: RTP Opus packet depayloader
rtp:  rtpopuspay: RTP Opus payloader
rtp:  rtph261pay: RTP H261 packet payloader
rtp:  rtph261depay: RTP H261 depayloader
rtp:  rtph263ppay: RTP H263 payloader
rtp:  rtph263pdepay: RTP H263 depayloader
rtp:  rtph263depay: RTP H263 depayloader
rtp:  rtph263pay: RTP H263 packet payloader
rtp:  rtph264depay: RTP H264 depayloader
rtp:  rtph264pay: RTP H264 payloader
rtp:  rtph265depay: RTP H265 depayloader
rtp:  rtph265pay: RTP H265 payloader
rtp:  rtpj2kdepay: RTP JPEG 2000 depayloader
rtp:  rtpj2kpay: RTP JPEG 2000 payloader
rtp:  rtpjpegdepay: RTP JPEG depayloader
rtp:  rtpjpegpay: RTP JPEG payloader
rtp:  rtpklvdepay: RTP KLV Depayloader
rtp:  rtpklvpay: RTP KLV Payloader
rtp:  rtpL8pay: RTP audio payloader
rtp:  rtpL8depay: RTP audio depayloader
rtp:  rtpL16pay: RTP audio payloader
rtp:  rtpL16depay: RTP audio depayloader
rtp:  rtpL24pay: RTP audio payloader
rtp:  rtpL24depay: RTP audio depayloader
rtp:  asteriskh263: RTP Asterisk H263 depayloader
rtp:  rtpmp1sdepay: RTP MPEG1 System Stream depayloader
rtp:  rtpmp2tdepay: RTP MPEG Transport Stream depayloader
rtp:  rtpmp2tpay: RTP MPEG2 Transport Stream payloader
rtp:  rtpmp4vpay: RTP MPEG4 Video payloader
rtp:  rtpmp4vdepay: RTP MPEG4 video depayloader
rtp:  rtpmp4apay: RTP MPEG4 audio payloader
rtp:  rtpmp4adepay: RTP MPEG4 audio depayloader
rtp:  rtpmp4gdepay: RTP MPEG4 ES depayloader
rtp:  rtpmp4gpay: RTP MPEG4 ES payloader
rtp:  rtpqcelpdepay: RTP QCELP depayloader
rtp:  rtpqdm2depay: RTP QDM2 depayloader
rtp:  rtpsbcdepay: RTP SBC audio depayloader
rtp:  rtpsbcpay: RTP packet payloader
rtp:  rtpsirenpay: RTP Payloader for Siren Audio
rtp:  rtpsirendepay: RTP Siren packet depayloader
rtp:  rtpspeexpay: RTP Speex payloader
rtp:  rtpspeexdepay: RTP Speex depayloader
rtp:  rtpsv3vdepay: RTP SVQ3 depayloader
rtp:  rtptheoradepay: RTP Theora depayloader
rtp:  rtptheorapay: RTP Theora payloader
rtp:  rtpvorbisdepay: RTP Vorbis depayloader
rtp:  rtpvorbispay: RTP Vorbis payloader
rtp:  rtpvp8depay: RTP VP8 depayloader
rtp:  rtpvp8pay: RTP VP8 payloader
rtp:  rtpvp9depay: RTP VP9 depayloader
rtp:  rtpvp9pay: RTP VP9 payloader
rtp:  rtpvrawdepay: RTP Raw Video depayloader
rtp:  rtpvrawpay: RTP Raw Video payloader
rtp:  rtpstreampay: RTP Stream Payloading
rtp:  rtpstreamdepay: RTP Stream Depayloading
rtp:  rtpredenc: Redundant Audio Data (RED) Encoder
rtp:  rtpreddec: Redundant Audio Data (RED) Decoder
rtp:  rtpulpfecdec: RTP FEC Decoder
rtp:  rtpulpfecenc: RTP FEC Encoder
rtp:  rtpstorage: RTP storage
subparse: subparse_typefind: srt, sub, mpsub, mdvd, smi, txt, dks, vtt
subparse:  subparse: Subtitle parser
subparse:  ssaparse: SSA Subtitle Parser
dvdlpcmdec:  dvdlpcmdec: DVD LPCM Audio decoder
staticelements:  bin: Generic bin
staticelements:  pipeline: Pipeline object

Total count: 273 plugins (4 blacklist entries not shown), 823 features

But I have just seen that he gave me a new error. Or at least now he shows me an error and not like he did before. The new one is: Floating point exception (core dumped)

Could you run the txt file with our optimized yolov7 model?
https://github.com/NVIDIA-AI-IOT/yolo_deepstream/tree/main/yolov7_qat

Also won’t work with this one.

You cannot use the tiler and more than one sink at same time. You can try to disable the tiler or just use one sink. We suggest you attach your log info by adding GST_DEBUG=3 before the cli.

I don’t really know what you mean by this. Could you try to describe it in other words?

1.We suggest you read our Guide to learn some basic concepts, you can refer the link below:
https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_ref_app_deepstream.html
2.You can learn some basic uses of our plugins,such as nvmultistreamtiler, nvstreamdemux, etc…
3.In your config file, you set [tiled-display] enable = 1 and [sink0] [sink1] [sink2] enable = 1, that is incorrect. You cannot use the [tiled-display] and more than one [sink] at same time. You can just try to use one sink first.
4.You can add GST_DEBUG=3 before the deepstream-app when you run the command.

I tried enabling the tiler or the sinks but neither one of the solutions worked. I still get a floating point exception (core dumped).
This is the new output:

WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.1/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.1/conv/Conv + PWN(PWN(/model/model.1/act/Sigmoid), /model/model.1/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.2/conv/Conv + PWN(PWN(/model/model.2/act/Sigmoid), /model/model.2/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.3/conv/Conv + PWN(PWN(/model/model.3/act/Sigmoid), /model/model.3/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.4/conv/Conv || /model/model.5/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.6/conv/Conv + PWN(PWN(/model/model.6/act/Sigmoid), /model/model.6/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.7/conv/Conv + PWN(PWN(/model/model.7/act/Sigmoid), /model/model.7/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.8/conv/Conv + PWN(PWN(/model/model.8/act/Sigmoid), /model/model.8/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.9/conv/Conv + PWN(PWN(/model/model.9/act/Sigmoid), /model/model.9/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.11/conv/Conv + PWN(PWN(/model/model.11/act/Sigmoid), /model/model.11/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.13/conv/Conv + PWN(PWN(/model/model.13/act/Sigmoid), /model/model.13/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.14/conv/Conv + PWN(PWN(/model/model.14/act/Sigmoid), /model/model.14/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.15/conv/Conv + PWN(PWN(/model/model.15/act/Sigmoid), /model/model.15/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.17/conv/Conv || /model/model.18/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.19/conv/Conv + PWN(PWN(/model/model.19/act/Sigmoid), /model/model.19/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.20/conv/Conv + PWN(PWN(/model/model.20/act/Sigmoid), /model/model.20/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.21/conv/Conv + PWN(PWN(/model/model.21/act/Sigmoid), /model/model.21/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.22/conv/Conv + PWN(PWN(/model/model.22/act/Sigmoid), /model/model.22/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.24/conv/Conv + PWN(PWN(/model/model.24/act/Sigmoid), /model/model.24/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.26/conv/Conv + PWN(PWN(/model/model.26/act/Sigmoid), /model/model.26/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.27/conv/Conv || /model/model.66/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.28/conv/Conv + PWN(PWN(/model/model.28/act/Sigmoid), /model/model.28/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.30/conv/Conv || /model/model.31/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.32/conv/Conv + PWN(PWN(/model/model.32/act/Sigmoid), /model/model.32/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.33/conv/Conv + PWN(PWN(/model/model.33/act/Sigmoid), /model/model.33/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.34/conv/Conv + PWN(PWN(/model/model.34/act/Sigmoid), /model/model.34/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.35/conv/Conv + PWN(PWN(/model/model.35/act/Sigmoid), /model/model.35/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.37/conv/Conv + PWN(PWN(/model/model.37/act/Sigmoid), /model/model.37/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.39/conv/Conv + PWN(PWN(/model/model.39/act/Sigmoid), /model/model.39/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.40/conv/Conv || /model/model.54/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.41/conv/Conv + PWN(PWN(/model/model.41/act/Sigmoid), /model/model.41/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.43/conv/Conv || /model/model.44/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.45/conv/Conv + PWN(PWN(/model/model.45/act/Sigmoid), /model/model.45/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.46/conv/Conv + PWN(PWN(/model/model.46/act/Sigmoid), /model/model.46/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.47/conv/Conv + PWN(PWN(/model/model.47/act/Sigmoid), /model/model.47/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.48/conv/Conv + PWN(PWN(/model/model.48/act/Sigmoid), /model/model.48/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.50/conv/Conv + PWN(PWN(/model/model.50/act/Sigmoid), /model/model.50/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.51/cv1/conv/Conv || /model/model.51/cv2/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.51/cv3/conv/Conv + PWN(PWN(/model/model.51/cv3/act/Sigmoid), /model/model.51/cv3/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.51/cv3/conv/Conv + PWN(PWN(/model/model.51/cv3/act/Sigmoid), /model/model.51/cv3/act/Mul).bias] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.51/cv4/conv/Conv + PWN(PWN(/model/model.51/cv4/act/Sigmoid), /model/model.51/cv4/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.51/cv5/conv/Conv + PWN(PWN(/model/model.51/cv5/act/Sigmoid), /model/model.51/cv5/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.51/cv6/conv/Conv + PWN(PWN(/model/model.51/cv6/act/Sigmoid), /model/model.51/cv6/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.51/cv7/conv/Conv + PWN(PWN(/model/model.51/cv7/act/Sigmoid), /model/model.51/cv7/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.52/conv/Conv + PWN(PWN(/model/model.52/act/Sigmoid), /model/model.52/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.56/conv/Conv || /model/model.57/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.58/conv/Conv + PWN(PWN(/model/model.58/act/Sigmoid), /model/model.58/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.59/conv/Conv + PWN(PWN(/model/model.59/act/Sigmoid), /model/model.59/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.60/conv/Conv + PWN(PWN(/model/model.60/act/Sigmoid), /model/model.60/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.61/conv/Conv + PWN(PWN(/model/model.61/act/Sigmoid), /model/model.61/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.63/conv/Conv + PWN(PWN(/model/model.63/act/Sigmoid), /model/model.63/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.64/conv/Conv + PWN(PWN(/model/model.64/act/Sigmoid), /model/model.64/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.68/conv/Conv || /model/model.69/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.70/conv/Conv + PWN(PWN(/model/model.70/act/Sigmoid), /model/model.70/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.71/conv/Conv + PWN(PWN(/model/model.71/act/Sigmoid), /model/model.71/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.72/conv/Conv + PWN(PWN(/model/model.72/act/Sigmoid), /model/model.72/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.73/conv/Conv + PWN(PWN(/model/model.73/act/Sigmoid), /model/model.73/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.75/conv/Conv + PWN(PWN(/model/model.75/act/Sigmoid), /model/model.75/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.77/conv/Conv + PWN(PWN(/model/model.77/act/Sigmoid), /model/model.77/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.78/conv/Conv + PWN(PWN(/model/model.78/act/Sigmoid), /model/model.78/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.79/conv/Conv + PWN(PWN(/model/model.79/act/Sigmoid), /model/model.79/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.81/conv/Conv || /model/model.82/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.83/conv/Conv + PWN(PWN(/model/model.83/act/Sigmoid), /model/model.83/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.84/conv/Conv + PWN(PWN(/model/model.84/act/Sigmoid), /model/model.84/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.85/conv/Conv + PWN(PWN(/model/model.85/act/Sigmoid), /model/model.85/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.86/conv/Conv + PWN(PWN(/model/model.86/act/Sigmoid), /model/model.86/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.88/conv/Conv + PWN(PWN(/model/model.88/act/Sigmoid), /model/model.88/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.90/conv/Conv + PWN(PWN(/model/model.90/act/Sigmoid), /model/model.90/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.91/conv/Conv + PWN(PWN(/model/model.91/act/Sigmoid), /model/model.91/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.92/conv/Conv + PWN(PWN(/model/model.92/act/Sigmoid), /model/model.92/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.94/conv/Conv || /model/model.95/conv/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.96/conv/Conv + PWN(PWN(/model/model.96/act/Sigmoid), /model/model.96/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.97/conv/Conv + PWN(PWN(/model/model.97/act/Sigmoid), /model/model.97/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.98/conv/Conv + PWN(PWN(/model/model.98/act/Sigmoid), /model/model.98/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.99/conv/Conv + PWN(PWN(/model/model.99/act/Sigmoid), /model/model.99/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.101/conv/Conv + PWN(PWN(/model/model.101/act/Sigmoid), /model/model.101/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.102/rbr_reparam/Conv + PWN(PWN(/model/model.102/act/Sigmoid), /model/model.102/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.103/rbr_reparam/Conv + PWN(PWN(/model/model.103/act/Sigmoid), /model/model.103/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.104/rbr_reparam/Conv + PWN(PWN(/model/model.104/act/Sigmoid), /model/model.104/act/Mul).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.0/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.1/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=/model/model.105/m.2/Conv.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]:  - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
0:19:16.167766382    69 0x55ec88904210 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 1]: serialize cuda engine to file: /opt/nvidia/deepstream/deepstream-6.1/samples/configs/tao_pretrained_models/best.onnx_b1_gpu0_fp16.engine successfully
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 5
0   INPUT  kFLOAT images          3x1920x1088     
1   OUTPUT kINT32 num_dets        1               
2   OUTPUT kFLOAT det_boxes       1000x4          
3   OUTPUT kFLOAT det_scores      1000            
4   OUTPUT kINT32 det_classes     1000            

0:19:16.206171155    69 0x55ec88904210 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<primary_gie> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-6.1/samples/configs/tao_pretrained_models/config_infer_primary_yolov4_lp.txt sucessfully
0:19:16.206782774    69 0x55ec88904210 WARN                 basesrc gstbasesrc.c:3600:gst_base_src_start_complete:<source> pad not activated yet
0:19:16.206990617    69 0x55ec88904210 WARN                 basesrc gstbasesrc.c:3600:gst_base_src_start_complete:<source> pad not activated yet

Runtime commands:
	h: Print this help
	q: Quit

	p: Pause
	r: Resume

NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source.
      To go back to the tiled display, right-click anywhere on the window.


**PERF:  FPS 0 (Avg)	
**PERF:  0.00 (0.00)	
** INFO: <bus_callback:194>: Pipeline ready

0:19:16.247176165    69 0x55ec8898dde0 WARN                 qtdemux qtdemux_types.c:239:qtdemux_type_get: unknown QuickTime node type Xtra
0:19:16.247243036    69 0x55ec8898dde0 WARN                 qtdemux qtdemux.c:3250:qtdemux_parse_trex:<qtdemux0> failed to find fragment defaults for stream 1
0:19:16.247294037    69 0x55ec8898dde0 WARN                 qtdemux qtdemux.c:3250:qtdemux_parse_trex:<qtdemux0> failed to find fragment defaults for stream 2
0:19:16.373778133    69 0x55ec8898dde0 WARN            uridecodebin gsturidecodebin.c:920:unknown_type_cb:<src_elem> warning: No decoder available for type 'audio/mpeg, mpegversion=(int)4, framed=(boolean)true, stream-format=(string)raw, level=(string)2, base-profile=(string)lc, profile=(string)lc, codec_data=(buffer)1190, rate=(int)48000, channels=(int)2'.
WARNING from src_elem: No decoder available for type 'audio/mpeg, mpegversion=(int)4, framed=(boolean)true, stream-format=(string)raw, level=(string)2, base-profile=(string)lc, profile=(string)lc, codec_data=(buffer)1190, rate=(int)48000, channels=(int)2'.
Debug info: gsturidecodebin.c(920): unknown_type_cb (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstURIDecodeBin:src_elem
0:19:16.479752618    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479767788    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat MJPG
0:19:16.479771608    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479778958    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat MJPG
0:19:16.479792019    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479796929    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat AV10
0:19:16.479800269    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479803749    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat AV10
0:19:16.479813659    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479819219    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat DVX5
0:19:16.479824069    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479829399    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat DVX5
0:19:16.479836759    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479841659    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat DVX4
0:19:16.479846389    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479852169    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat DVX4
0:19:16.479860660    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479865610    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat MPG4
0:19:16.479868770    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479875330    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat MPG4
0:19:16.479883250    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479888170    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat MPG2
0:19:16.479892550    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479896630    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat MPG2
0:19:16.479905470    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479909870    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat H265
0:19:16.479914770    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479919110    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat H265
0:19:16.479926011    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479930371    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat VP90
0:19:16.479933631    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479939271    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat VP90
0:19:16.479945851    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479951061    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat VP80
0:19:16.479954401    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479959191    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat VP80
0:19:16.479968361    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479973071    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat H264
0:19:16.479976621    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:19:16.479981071    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat H264
0:19:16.480268686    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:19:16.480275156    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe minimum capture size for pixelformat NM12
0:19:16.480278566    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:19:16.480283196    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe maximum capture size for pixelformat NM12
0:19:16.480289856    69 0x7f0eb8052360 WARN                    v4l2 gstv4l2object.c:2395:gst_v4l2_object_add_interlace_mode:0x7f0eb01133a0 Failed to determine interlace mode
** INFO: <bus_callback:180>: Pipeline running

0:19:16.589704795    69 0x7f0eb8052360 WARN            v4l2videodec gstv4l2videodec.c:1847:gst_v4l2_video_dec_decide_allocation:<nvv4l2decoder0> Duration invalid, not setting latency
0:19:16.590136161    69 0x7f0eb8052360 WARN          v4l2bufferpool gstv4l2bufferpool.c:1082:gst_v4l2_buffer_pool_start:<nvv4l2decoder0:pool:src> Uncertain or not enough buffers, enabling copy threshold
0:19:16.592131711    69 0x7f0eac008ea0 WARN          v4l2bufferpool gstv4l2bufferpool.c:1533:gst_v4l2_buffer_pool_dqbuf:<nvv4l2decoder0:pool:src> Driver should never set v4l2_buffer.field to ANY
Floating point exception (core dumped)

Could you attach your video source testvideo_astemo_new.mp4 or just message me this? I’ll run in our env with our yolov7 model.
You can also use gdb to debug the crash issue in your env.

It isn’t the video file. I tried it with various other videos but non of them worked. It has to be an error with the onnx file. I got another file from a colleague and his worked. So either is my onnx somehow broken or another configuration is not right. But how do I find out what is wrong? Because I also tried converting the original yolov7 weights and they also won’t work.

Do you mean it’s good to use your colleague’s model with your config file?
Could you try to set the [sink2] enable=0, [sink1] type=1?

It looks more like a problem with your model. Could you try to comment out model-engine-file=../../models/tao_pretrained_models/yolov4/yolov7.onnx_b1_gpu0_int8.engine in your config file?

I tried everything I could to check where the error comes from. And because the model from my colleague is similar to mine I thought it would be a fair idea.
However, using your suggestions resolved the same error. I feel this seems to be a problem while converting the pt model to an onnx model. Do you have any past references on a wrong conversion that crashed the inference?

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

At present, we don’t have references for converting pytorch to onnx in DeepStream.Maybe you can check that topic in pytorch forum. Thanks

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.