Gst-launch-1.0 nvcompositor bug in tegra-l4t-r32.5.1?

labi · April 16, 2021, 8:41am

The issue was hit on the devkit jetson also after 2263 loop. (2 of 3 were hang) And I run your command for 10 minutes without success:

gst-launch-1.0 nvcompositor name=comp sink_0::xpos=0 sink_0::ypos=0 sink_0::width=1920 sink_0::height=1080 sink_1::xpos=1920 sink_1::ypos=0 sink_1::width=1920 sink_1::height=1080 sink_2::xpos=0 sink_2::ypos=1080 sink_2::width=1920 sink_2::height=1080 sink_3::xpos=1920 sink_3::ypos=1080 sink_3::width=1920 sink_3::height=1080 ! nvoverlaysink sync=true uridecodebin uri=“file:///tmp/network/192.168.1.2_DEXON//7_Production/8_Test/sample_720p.mp4” ! nvvidconv ! queue ! comp. uridecodebin uri=“file:///tmp/network/192.168.1.2_DEXON//7_Production/8_Test/sample_720p.mp4” ! nvvidconv ! queue ! comp. uridecodebin uri=“file:///tmp/network/192.168.1.2_DEXON//7_Production/8_Test/sample_1080p_h264.mp4” ! nvvidconv ! queue ! comp. uridecodebin uri=“file:///tmp/network/192.168.1.2_DEXON//7_Production/8_Test/jellyfish-120-mbps-4k-uhd-h264.mkv” ! nvvidconv ! comp.
Setting pipeline to PAUSED …
Pipeline is PREROLLING …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
NvRmChannelSubmit: NvError_IoctlFailed with error code 22
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 13, SyncPointValue = 0)
fence_set_name ioctl failed with 22
NvDdkVicExecute Failed
nvbuffer_composite Failed
New clock: GstSystemClock
Got EOS from element “pipeline0”.
Execution ended after 0:00:00.030308281
Setting pipeline to PAUSED …
Setting pipeline to READY …
NvRmChannelSubmit: NvError_IoctlFailed with error code 22
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 25, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 25, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 25, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 25, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 25, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 25, SyncPointValue = 0)
Setting pipeline to NULL …
Freeing pipeline …
nv@DEXONNV:~ nv@DEXONNV:~
nv@DEXONNV:~ gst-launch-1.0 videotestsrc ! nvvidconv ! nvoverlaysink Setting pipeline to PAUSED ... Pipeline is PREROLLING ... Pipeline is PREROLLED ... Setting pipeline to PLAYING ... New clock: GstSystemClock ^Chandling interrupt. Interrupt: Stopping pipeline ... Execution ended after 0:00:13.272896974 Setting pipeline to PAUSED ... Setting pipeline to READY ... Setting pipeline to NULL ... Freeing pipeline ... nv@DEXONNV:~
nv@DEXONNV:~ nv@DEXONNV:~ gst-launch-1.0 nvcompositor name=comp sink_0::xpos=0 sink_0::ypos=0 sink_0::width=1920 sink_0::height=1080 sink_1::xpos=1920 sink_1::ypos=0 sink_1::width=1920 sink_1::height=1080 sink_2::xpos=0 sink_2::ypos=1080 sink_2::width=1920 sink_2::height=1080 sink_3::xpos=1920 sink_3::ypos=1080 sink_3::width=1920 sink_3::height=1080 ! nvoverlaysink sync=true uridecodebin uri=“file:///tmp/network/192.168.1.2_DEXON//7_Production/8_Test/sample_720p.mp4” ! nvvidconv ! queue ! comp. uridecodebin uri=“file:///tmp/network/192.168.1.2_DEXON//7_Production/8_Test/sample_720p.mp4” ! nvvidconv ! queue ! comp. uridecodebin uri=“file:///tmp/network/192.168.1.2_DEXON//7_Production/8_Test/sample_1080p_h264.mp4” ! nvvidconv ! queue ! comp. uridecodebin uri=“file:///tmp/network/192.168.1.2_DEXON//7_Production/8_Test/jellyfish-120-mbps-4k-uhd-h264.mkv” ! nvvidconv ! comp.
Setting pipeline to PAUSED …
Pipeline is PREROLLING …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
Opening in BLOCKING MODE
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
NvRmChannelSubmit: NvError_IoctlFailed with error code 22
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 13, SyncPointValue = 0)
fence_set_name ioctl failed with 22
NvDdkVicExecute Failed
nvbuffer_composite Failed
New clock: GstSystemClock
Got EOS from element “pipeline0”.
Execution ended after 0:00:00.030134948
Setting pipeline to PAUSED …
Setting pipeline to READY …
NvRmChannelSubmit: NvError_IoctlFailed with error code 22
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 23, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 23, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 23, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 23, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 23, SyncPointValue = 0)
Setting pipeline to NULL …
Freeing pipeline …
nv@DEXONNV:~$

labi · April 16, 2021, 9:23am

I rerun the test script with correct colling:

labi · April 16, 2021, 1:34pm

This issue is not depend on the temperature I think.
The issue hit again on the jetson nano on eval board with correct colling:

Ã¡pr. 16., pÃ©ntek, 13:27:26 CEST
loop 302
Setting pipeline to PAUSED …
Pipeline is PREROLLING …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstSystemClock
RAM 1866/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [38%-1479,38%-1479,48%-1479,34%-1479] EMC_FREQ 21%-1600 GR3D_FREQ 0%-76 NVDEC 550 VIC_FREQ 0%-576 APE 25 PLL-25C CPU-30.5C PMIC-100C GPU-28C AO-32.5C thermal-29.25C POM_5V_IN 4440/4440 POM_5V_GPU 39/39 POM_5V_CPU 958/958
RAM 1869/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [37%-518,18%-518,17%-518,20%-518] EMC_FREQ 24%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-627 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32.5C thermal-28.75C POM_5V_IN 4086/4263 POM_5V_GPU 40/39 POM_5V_CPU 480/719
RAM 1868/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [32%-921,15%-921,18%-921,17%-921] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 71%-307 APE 25 PLL-25C CPU-30.5C PMIC-100C GPU-28C AO-32.5C thermal-29C POM_5V_IN 4512/4346 POM_5V_GPU 39/39 POM_5V_CPU 758/732
RAM 1868/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [33%-825,16%-825,17%-825,18%-825] EMC_FREQ 28%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 22%-307 APE 25 PLL-25C CPU-30C PMIC-100C GPU-27.5C AO-32.5C thermal-29C POM_5V_IN 4784/4455 POM_5V_GPU 39/39 POM_5V_CPU 837/758
RAM 1868/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [27%-614,19%-614,18%-614,18%-614] EMC_FREQ 30%-1600 GR3D_FREQ 0%-76 NVDEC 550 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-28C AO-32.5C thermal-28.75C POM_5V_IN 4166/4397 POM_5V_GPU 40/39 POM_5V_CPU 560/718
RAM 1868/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [33%-403,20%-403,19%-403,18%-403] EMC_FREQ 30%-1600 GR3D_FREQ 0%-76 NVDEC 576 VIC_FREQ 0%-192 APE 25 PLL-25C CPU-30.5C PMIC-100C GPU-27.5C AO-32.5C thermal-29C POM_5V_IN 4280/4378 POM_5V_GPU 40/39 POM_5V_CPU 680/712
RAM 1868/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [31%-614,15%-614,19%-614,15%-614] EMC_FREQ 31%-1600 GR3D_FREQ 0%-76 NVDEC 550 VIC_FREQ 17%-409 APE 25 PLL-25C CPU-30.5C PMIC-100C GPU-27.5C AO-32.5C thermal-28.75C POM_5V_IN 4280/4364 POM_5V_GPU 40/39 POM_5V_CPU 600/696
RAM 1868/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [37%-825,19%-825,17%-825,18%-825] EMC_FREQ 32%-1600 GR3D_FREQ 0%-76 NVDEC 576 VIC_FREQ 0%-524 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32.5C thermal-28.75C POM_5V_IN 4360/4363 POM_5V_GPU 40/39 POM_5V_CPU 600/684
RAM 1869/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [32%-614,16%-614,17%-614,17%-614] EMC_FREQ 32%-1600 GR3D_FREQ 0%-76 NVDEC 550 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30.5C PMIC-100C GPU-27.5C AO-32C thermal-29C POM_5V_IN 4280/4354 POM_5V_GPU 40/39 POM_5V_CPU 560/670
RAM 1869/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [32%-614,16%-614,19%-614,17%-614] EMC_FREQ 32%-1600 GR3D_FREQ 0%-76 NVDEC 576 VIC_FREQ 30%-409 APE 25 PLL-24.5C CPU-30.5C PMIC-100C GPU-27.5C AO-32.5C thermal-28.75C POM_5V_IN 4480/4366 POM_5V_GPU 39/39 POM_5V_CPU 599/663
RAM 1869/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [31%-614,18%-614,17%-614,18%-614] EMC_FREQ 32%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-627 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32.5C thermal-29C POM_5V_IN 4240/4355 POM_5V_GPU 40/39 POM_5V_CPU 560/653
handling interrupt.
Interrupt: Stopping pipeline …
Execution ended after 0:00:11.218200464
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …

Setting pipeline to PAUSED …
Setting pipeline to PAUSED …
Pipeline is PREROLLING …
Pipeline is PREROLLING …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
Opening in BLOCKING MODE
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstSystemClock
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstSystemClock
RAM 1790/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [36%-518,50%-518,42%-518,40%-518] EMC_FREQ 24%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-28C AO-32.5C thermal-29.25C POM_5V_IN 4160/4160 POM_5V_GPU 40/40 POM_5V_CPU 560/560
RAM 1786/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [32%-518,16%-518,18%-710,16%-710] EMC_FREQ 25%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-28C AO-32.5C thermal-29.25C POM_5V_IN 4086/4123 POM_5V_GPU 40/40 POM_5V_CPU 560/560
RAM 1787/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [36%-307,15%-307,18%-307,13%-307] EMC_FREQ 25%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-28C AO-32C thermal-29C POM_5V_IN 3966/4070 POM_5V_GPU 40/40 POM_5V_CPU 440/520
RAM 1787/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [34%-403,19%-403,19%-403,13%-403] EMC_FREQ 26%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-25C CPU-30.5C PMIC-100C GPU-27.5C AO-32.5C thermal-29C POM_5V_IN 4006/4054 POM_5V_GPU 40/40 POM_5V_CPU 440/500
RAM 1785/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [39%-518,15%-518,18%-518,18%-518] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-25C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-29C POM_5V_IN 4166/4076 POM_5V_GPU 40/40 POM_5V_CPU 480/496
RAM 1786/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [35%-403,20%-403,20%-403,18%-403] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 576 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-28C AO-32C thermal-29C POM_5V_IN 3892/4046 POM_5V_GPU 40/40 POM_5V_CPU 441/486
RAM 1786/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [36%-614,15%-614,19%-614,15%-614] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32.5C thermal-28.75C POM_5V_IN 3892/4024 POM_5V_GPU 40/40 POM_5V_CPU 400/474
RAM 1786/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [37%-403,17%-403,19%-403,17%-403] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 652 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30.5C PMIC-100C GPU-27.5C AO-32C thermal-28.75C POM_5V_IN 4046/4026 POM_5V_GPU 40/40 POM_5V_CPU 400/465
RAM 1786/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [35%-403,17%-403,17%-403,16%-403] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 576 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-28.75C POM_5V_IN 3812/4002 POM_5V_GPU 40/40 POM_5V_CPU 401/458
RAM 1786/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [38%-921,19%-921,19%-921,19%-921] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-28.75C POM_5V_IN 3926/3995 POM_5V_GPU 40/40 POM_5V_CPU 480/460
RAM 1786/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [35%-403,20%-403,18%-403,16%-403] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 652 VIC_FREQ 0%-192 APE 25 PLL-25C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-28.75C POM_5V_IN 3926/3988 POM_5V_GPU 40/40 POM_5V_CPU 440/458
handling interrupt.
handling interrupt.
Interrupt: Stopping pipeline …
Interrupt: Stopping pipeline …
Execution ended after 0:00:11.549797860
Execution ended after 0:00:11.437325829
Setting pipeline to PAUSED …
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to READY …
Setting pipeline to NULL …
Setting pipeline to NULL …
Freeing pipeline …
Freeing pipeline …

Ã¡pr. 16., pÃ©ntek, 13:27:52 CEST
loop 303
Setting pipeline to PAUSED …
Pipeline is PREROLLING …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstSystemClock
NvRmChannelSubmit: NvError_IoctlFailed with error code 22
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 13, SyncPointValue = 0)
fence_set_name ioctl failed with 22
NvDdkVicExecute Failed
nvbuffer_composite Failed
Got EOS from element “pipeline0”.
Execution ended after 0:00:00.207135885
Setting pipeline to PAUSED …
Setting pipeline to READY …
RAM 1866/3956MB (lfb 195x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [43%-1479,40%-1479,35%-1479,44%-1479] EMC_FREQ 21%-1600 GR3D_FREQ 0%-76 NVDEC 550 VIC_FREQ 0%-192 APE 25 PLL-25C CPU-30C PMIC-100C GPU-27.5C AO-32.5C thermal-28.75C POM_5V_IN 4592/4592 POM_5V_GPU 39/39 POM_5V_CPU 1158/1158
Setting pipeline to NULL …
Freeing pipeline …
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [13%-307,5%-307,10%-307,5%-307] EMC_FREQ 17%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-24C CPU-30C PMIC-100C GPU-27C AO-32C thermal-28.75C POM_5V_IN 2786/3689 POM_5V_GPU 40/39 POM_5V_CPU 201/679
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [10%-102,7%-102,9%-102,5%-102] EMC_FREQ 14%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-24C CPU-29.5C PMIC-100C GPU-27.5C AO-32C thermal-28.5C POM_5V_IN 2746/3374 POM_5V_GPU 40/39 POM_5V_CPU 161/506
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [6%-204,7%-204,10%-204,4%-204] EMC_FREQ 12%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-23.5C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-28.5C POM_5V_IN 2746/3217 POM_5V_GPU 40/39 POM_5V_CPU 161/420
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [7%-204,5%-204,11%-204,5%-204] EMC_FREQ 10%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-24C CPU-29.5C PMIC-100C GPU-27C AO-32C thermal-28.5C POM_5V_IN 2746/3123 POM_5V_GPU 40/39 POM_5V_CPU 161/368
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [6%-102,2%-102,12%-102,5%-102] EMC_FREQ 9%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-23.5C CPU-29.5C PMIC-100C GPU-27C AO-32C thermal-28.5C POM_5V_IN 2746/3060 POM_5V_GPU 40/39 POM_5V_CPU 161/333
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [8%-102,6%-102,11%-102,3%-102] EMC_FREQ 9%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-24C CPU-29.5C PMIC-100C GPU-27.5C AO-32C thermal-28.5C POM_5V_IN 2746/3015 POM_5V_GPU 40/39 POM_5V_CPU 161/309
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [9%-204,3%-204,12%-204,5%-204] EMC_FREQ 8%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-24C CPU-29.5C PMIC-100C GPU-27.5C AO-32C thermal-28.5C POM_5V_IN 2746/2981 POM_5V_GPU 40/39 POM_5V_CPU 161/290
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [4%-102,5%-102,8%-102,8%-102] EMC_FREQ 8%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-24C CPU-29.5C PMIC-100C GPU-27C AO-32C thermal-28.25C POM_5V_IN 2746/2955 POM_5V_GPU 40/39 POM_5V_CPU 161/276
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [6%-204,5%-204,10%-204,5%-204] EMC_FREQ 8%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-23.5C CPU-29.5C PMIC-100C GPU-27.5C AO-32C thermal-28.5C POM_5V_IN 2746/2934 POM_5V_GPU 40/39 POM_5V_CPU 161/264
RAM 1575/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [8%-204,4%-204,9%-204,8%-204] EMC_FREQ 8%-1600 GR3D_FREQ 0%-76 VIC_FREQ 0%-192 APE 25 PLL-24C CPU-29.5C PMIC-100C GPU-27.5C AO-32C thermal-28.5C POM_5V_IN 2746/2917 POM_5V_GPU 40/39 POM_5V_CPU 161/255
gst-launch-1.0: no process found

Setting pipeline to PAUSED …
Setting pipeline to PAUSED …
Pipeline is PREROLLING …
Pipeline is PREROLLING …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstSystemClock
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstSystemClock
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [48%-1479,39%-1479,44%-1479,41%-1479] EMC_FREQ 12%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-28.5C POM_5V_IN 4086/4086 POM_5V_GPU 40/40 POM_5V_CPU 560/560
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [32%-518,17%-518,15%-518,10%-518] EMC_FREQ 17%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-29.5C PMIC-100C GPU-27.5C AO-32C thermal-28.5C POM_5V_IN 4006/4046 POM_5V_GPU 40/40 POM_5V_CPU 440/500
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [34%-518,15%-518,10%-518,15%-518] EMC_FREQ 20%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27C AO-32C thermal-28.75C POM_5V_IN 4046/4046 POM_5V_GPU 40/40 POM_5V_CPU 440/480
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [34%-403,15%-403,17%-403,18%-403] EMC_FREQ 22%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-29.5C PMIC-100C GPU-27.5C AO-31.5C thermal-28.75C POM_5V_IN 4086/4056 POM_5V_GPU 40/40 POM_5V_CPU 440/470
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [33%-403,17%-403,17%-403,19%-403] EMC_FREQ 24%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-29.5C PMIC-100C GPU-27.5C AO-32C thermal-28.75C POM_5V_IN 4006/4046 POM_5V_GPU 40/40 POM_5V_CPU 400/456
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [31%-403,13%-403,19%-403,20%-403] EMC_FREQ 25%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-28.25C POM_5V_IN 3892/4020 POM_5V_GPU 40/40 POM_5V_CPU 400/446
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [36%-518,14%-518,19%-518,16%-518] EMC_FREQ 26%-1600 GR3D_FREQ 0%-76 NVDEC 716 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-29.5C PMIC-100C GPU-27C AO-32C thermal-28.25C POM_5V_IN 3966/4012 POM_5V_GPU 40/40 POM_5V_CPU 440/445
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [33%-403,18%-403,21%-403,22%-403] EMC_FREQ 26%-1600 GR3D_FREQ 0%-76 NVDEC 614 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-28.25C POM_5V_IN 3852/3992 POM_5V_GPU 40/40 POM_5V_CPU 401/440
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [35%-403,14%-403,20%-403,19%-403] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 614 VIC_FREQ 0%-192 APE 25 PLL-24C CPU-29.5C PMIC-100C GPU-27.5C AO-32.5C thermal-28.25C POM_5V_IN 3852/3976 POM_5V_GPU 40/40 POM_5V_CPU 441/440
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [34%-403,18%-403,21%-403,17%-403] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 652 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-28.5C POM_5V_IN 3892/3968 POM_5V_GPU 40/40 POM_5V_CPU 400/436
RAM 1797/3956MB (lfb 196x4MB) SWAP 0/1978MB (cached 0MB) IRAM 0/252kB(lfb 252kB) CPU [37%-518,17%-518,19%-518,16%-518] EMC_FREQ 27%-1600 GR3D_FREQ 0%-76 NVDEC 614 VIC_FREQ 0%-192 APE 25 PLL-24.5C CPU-30C PMIC-100C GPU-27.5C AO-32C thermal-28.75C POM_5V_IN 3926/3964 POM_5V_GPU 40/40 POM_5V_CPU 440/436
handling interrupt.
Interrupt: Stopping pipeline …
Execution ended after 0:00:11.585702027
Setting pipeline to PAUSED …
Setting pipeline to READY …
handling interrupt.
Interrupt: Stopping pipeline …
Execution ended after 0:00:11.475095829
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Setting pipeline to NULL …
Freeing pipeline …
Freeing pipeline …

labi · April 23, 2021, 9:00am

Hi,
Now I can run 8pcs jetson nano in same time and I could see the hang issue all of them the average hang time about 10 hours.

Have you ever face such an issue in your environment?

If not, can we recognize the differences?

I use 10W mode, r35.5.1, Model: P3448 (180-13448-DAAA-B01) (900-13448-0020-000, S/N:1422720005556)

DaneLLL · April 23, 2021, 9:08am

Hi,
So far we have not hit the issue on Jetson Nano devkits. Do you observe it on Nano devkits or your custom boards?

labi · April 23, 2021, 9:17am

I use same type of modules in custom board and evaluation board also (eval board: 945-13450-0000-100, S/N: 1422919091668))

I saw the issue every board…

This module is P3448 (180-13448-DAAA-B01) (900-13448-0020-000, S/N:1422720005556) which is use only eMMC.

Can you use only sd-card module?

labi · April 27, 2021, 8:34am

We use 5V~3A AC adapter, could you tell me what do you use for power supply? Maybe it is another different.

//

This main basic feature is very urgent for us. We are ready to sell our new product, but it is now impossible with this issue.

If there is any possibility to fix this issue faster? If that would cost us additionally towards your support team we are ready to pay this additional cost in order to get it fixed.

DaneLLL · April 27, 2021, 9:48am

Hi,
We are still trying to reproduce the issue.

The production module is Nano-emmc, but looks like you use B01 module for the product. Is there a reason for this? We would expect going to production stage with production module.

labi · April 27, 2021, 10:13am

We use this module:

Is it not a production module?

Honey_Patouceul · April 29, 2021, 8:30pm

You may try the following:

gst-launch-1.0 -e nvcompositor name=mix background-w=3840 background-h=2160   \
   sink_0::xpos=0    sink_0::ypos=0      sink_0::width=1920 sink_0::height=1080   \
   sink_1::xpos=1920 sink_1::ypos=0      sink_1::width=1920 sink_1::height=1080   \
   sink_2::xpos=0    sink_2::ypos=1080   sink_2::width=1920 sink_2::height=1080   \
   sink_3::xpos=1920 sink_3::ypos=1080   sink_3::width=1920 sink_3::height=1080 ! \
   'video/x-raw(memory:NVMM),format=RGBA' ! nvvidconv ! 'video/x-raw(memory:NVMM), width=1920, height=1080, format=NV12' ! nvoverlaysink  \
   rtspsrc location=rtsp://127.0.0.1:8554/test ! application/x-rtp,media=video,encoding-name=H264 ! rtph264depay ! h264parse ! nvv4l2decoder ! 'video/x-raw(memory:NVMM),format=NV12' ! queue ! mix.sink_0      \
   rtspsrc location=rtsp://127.0.0.1:8554/test ! application/x-rtp,media=video,encoding-name=H264 ! rtph264depay ! h264parse ! nvv4l2decoder ! 'video/x-raw(memory:NVMM),format=NV12' ! queue ! mix.sink_1       \
   rtspsrc location=rtsp://127.0.0.1:8554/test ! application/x-rtp,media=video,encoding-name=H264 ! rtph264depay ! h264parse ! nvv4l2decoder ! 'video/x-raw(memory:NVMM),format=NV12' ! queue ! mix.sink_2       \
   filesrc location=./Videos/Big_Buck_Bunny_1080_10s_30MB.mp4 ! qtdemux ! h264parse ! nvv4l2decoder ! 'video/x-raw(memory:NVMM),format=NV12' ! queue ! mix.sink_3

Note that I’m rescaling output because my monitor cannot do more than 1440p, so 2160p would give a red screen with nvoverlaysink.
Additional note: rescaling in RGBA format makes unexpected output, so I also convert into NV12 while scaling.

labi · May 3, 2021, 1:49pm

Thank you. Could you help a little bit?

I would like to try to your suggestion, but I cant create a working pipelines with uridecodebin element. Would you share me a solution for my case?

Honey_Patouceul · May 3, 2021, 5:59pm

Here I compose 4 urls (all reading the same uri from local RTSP server) from uridecodebin, rescale each into 1920x1080, then rescale the whole 3840x2160 into 1920x1080 for display:

gst-launch-1.0 -e nvcompositor name=mix background-w=3840 background-h=2160   \
   sink_0::xpos=0    sink_0::ypos=0      sink_0::width=1920 sink_0::height=1080   \
   sink_1::xpos=1920 sink_1::ypos=0      sink_1::width=1920 sink_1::height=1080   \
   sink_2::xpos=0    sink_2::ypos=1080   sink_2::width=1920 sink_2::height=1080   \
   sink_3::xpos=1920 sink_3::ypos=1080   sink_3::width=1920 sink_3::height=1080 ! \
   'video/x-raw(memory:NVMM),format=RGBA' ! nvvidconv ! 'video/x-raw(memory:NVMM), width=1920, height=1080, format=NV12' ! nvoverlaysink  \
   uridecodebin uri=rtsp://127.0.0.1:8554/test ! nvvidconv ! 'video/x-raw(memory:NVMM),format=NV12, width=1920, height=1080, pixel-aspect-ratio=1/1' ! queue ! mix.sink_0   \
   uridecodebin uri=rtsp://127.0.0.1:8554/test ! nvvidconv ! 'video/x-raw(memory:NVMM),format=NV12, width=1920, height=1080, pixel-aspect-ratio=1/1' ! queue ! mix.sink_1   \
   uridecodebin uri=rtsp://127.0.0.1:8554/test ! nvvidconv ! 'video/x-raw(memory:NVMM),format=NV12, width=1920, height=1080, pixel-aspect-ratio=1/1' ! queue ! mix.sink_2   \
   uridecodebin uri=rtsp://127.0.0.1:8554/test ! nvvidconv ! 'video/x-raw(memory:NVMM),format=NV12, width=1920, height=1080, pixel-aspect-ratio=1/1' ! queue ! mix.sink_3

labi · May 3, 2021, 8:16pm

Thank you so much indeed, I started the test!

labi · May 6, 2021, 11:10am

After several hours I see the error log messages:

loop 1150
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://admin:Dexon1991@192.168.1.209/
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://admin:Dexon1991@192.168.1.210/
Progress: (open) Retrieving server options
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (request) SETUP stream 0
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
Progress: (open) Opened Stream
Setting pipeline to PLAYING …
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
New clock: GstSystemClock
Progress: (request) Sending PLAY request
Progress: (request) SETUP stream 1
Progress: (request) Sending PLAY request
Progress: (request) Sending PLAY request
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Progress: (open) Opened Stream
Progress: (request) Sending PLAY request
Progress: (request) Sent PLAY request
Progress: (request) Sent PLAY request
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 279
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 279
Redistribute latency…
handling interrupt.
Interrupt: Stopping pipeline …
EOS on shutdown enabled – Forcing EOS on the pipeline
Waiting for EOS…
Got EOS from element “pipeline0”.
EOS received - stopping pipeline…
Execution ended after 0:00:13.756546661
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …
Setting pipeline to PAUSED …
Setting pipeline to PAUSED …
Pipeline is PREROLLING …
Pipeline is PREROLLING …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 279
NvMMLiteBlockCreate : Block : BlockType = 261
Redistribute latency…
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstPulseSinkClock
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstPulseSinkClock
Redistribute latency…
NvRmChannelSubmit: NvError_IoctlFailed with error code 22
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 15, SyncPointValue = 0)
fence_set_name ioctl failed with 22
NvDdkVicExecute Failed
nvbuffer_transform Failed
gst_nvvconv_transform: NvBufferTransform Failed
ERROR: from element /GstPipeline:pipeline0/GstURIDecodeBin:bin/GstDecodeBin:decodebin0/GstQTDemux:qtdemux0: Internal data stream error.
Additional debug info:
qtdemux.c(6073): gst_qtdemux_loop (): /GstPipeline:pipeline0/GstURIDecodeBin:bin/GstDecodeBin:decodebin0/GstQTDemux:qtdemux0:
streaming stopped, reason error (-5)
EOS on shutdown enabled – waiting for EOS after Error
Waiting for EOS…
handling interrupt.
handling interrupt.
Interrupt: Stopping pipeline …
Interrupt while waiting for EOS - stopping pipeline…
Execution ended after 0:00:11.245298017
Setting pipeline to PAUSED …
Interrupt: Stopping pipeline …
EOS on shutdown enabled – Forcing EOS on the pipeline
Waiting for EOS…
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …
Got EOS from element “pipeline0”.
EOS received - stopping pipeline…
Execution ended after 0:00:12.923811350
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …
loop 1151
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://admin:Dexon1991@192.168.1.209/
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://admin:Dexon1991@192.168.1.210/
Progress: (open) Retrieving server options
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (request) SETUP stream 0
Progress: (open) Opened Stream
Setting pipeline to PLAYING …
New clock: GstSystemClock
Progress: (request) Sending PLAY request
Progress: (request) Sending PLAY request
Progress: (request) Sending PLAY request
Progress: (request) SETUP stream 1
Progress: (open) Opened Stream
Progress: (request) Sending PLAY request
Progress: (request) Sent PLAY request
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Progress: (request) Sent PLAY request
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 279
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 279
Redistribute latency…
handling interrupt.
Interrupt: Stopping pipeline …
EOS on shutdown enabled – Forcing EOS on the pipeline
Waiting for EOS…
Got EOS from element “pipeline0”.
EOS received - stopping pipeline…
Execution ended after 0:00:13.800286869
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …
Setting pipeline to PAUSED …
Setting pipeline to PAUSED …
Pipeline is PREROLLING …
Pipeline is PREROLLING …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 279
Redistribute latency…
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstPulseSinkClock
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstPulseSinkClock
Redistribute latency…
handling interrupt.
handling interrupt.
Interrupt: Stopping pipeline …
Interrupt: Stopping pipeline …
EOS on shutdown enabled – Forcing EOS on the pipeline
EOS on shutdown enabled – Forcing EOS on the pipeline
Waiting for EOS…
Waiting for EOS…
Got EOS from element “pipeline0”.
EOS received - stopping pipeline…
Execution ended after 0:00:12.795102131
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Got EOS from element “pipeline0”.
EOS received - stopping pipeline…
Execution ended after 0:00:12.715825673
Setting pipeline to PAUSED …
Setting pipeline to READY …
Freeing pipeline …
Setting pipeline to NULL …
Freeing pipeline …

BUT the OS is not stuck, therefore it is a forward step.

BUT after another ~4 hours the OS is stuck, I see this log:

loop 1595
Opening in BLOCKING MODE
handling interrupt.
Interrupt: Stopping pipeline …
Interrupt while waiting for EOS - stopping pipeline…
Execution ended after 0:00:28.313903219
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …
Setting pipeline to PAUSED …
Setting pipeline to PAUSED …
Pipeline is PREROLLING …
Pipeline is PREROLLING …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 279
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 279
Redistribute latency…
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstPulseSinkClock
Redistribute latency…
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstPulseSinkClock
Redistribute latency…
NvRmChannelSubmit: NvError_IoctlFailed with error code 22
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 21, SyncPointValue = 0)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 21, SyncPointValue = 0)
NvRmChannelSubmit: NvError_IoctlFailed with error code 22
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 18, SyncPointValue = 0)
fence_set_name ioctl failed with 22
NvDdkVicExecute Failed
nvbuffer_transform Failed
gst_nvvconv_transform: NvBufferTransform Failed
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 21, SyncPointValue = 0)
ERROR: from element /GstPipeline:pipeline0/GstURIDecodeBin:bin/GstDecodeBin:decodebin0/GstQTDemux:qtdemux0: Internal data stream error.
Additional debug info:
qtdemux.c(6073): gst_qtdemux_loop (): /GstPipeline:pipeline0/GstURIDecodeBin:bin/GstDecodeBin:decodebin0/GstQTDemux:qtdemux0:
streaming stopped, reason error (-5)
NvRmPrivFlush: NvRmChannelSubmit failed (err = 196623, SyncPointIdx = 21, SyncPointValue = 0)
EOS on shutdown enabled – waiting for EOS after Error
Waiting for EOS…
handling interrupt.
Interrupt: Stopping pipeline …
Interrupt while waiting for EOS - stopping pipeline…
Execution ended after 0:00:11.272872548
Setting pipeline to PAUSED …
handling interrupt.
Interrupt: Stopping pipeline …
EOS on shutdown enabled – Forcing EOS on the pipeline
Waiting for EOS…
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …
Got EOS from element “pipeline0”.
EOS received - stopping pipeline…
Execution ended after 0:00:12.920702339
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …

Honey_Patouceul · May 6, 2021, 5:35pm

It’s hard to guess without the exact launched pipeline and details about streams being read and decoded.
I see that you are decoding various block types (261 and 279), but I don’t know the codes for guessing what these are.

I think that all starts with an interrupt. Is it expected ? Are you running some test or is it just unknown cause ?
Then it restarts, but there are only 2 NVMEDIA reading display size messages, and a pulse sink clock message that seems unexpected to me.
Then I see errors maybe related to nvvidconv or nvoverlaysink.

No real idea about what is the error, but as trials to find a workaround, you may try to :

use dedicated RTSP input for a given encoding with rtspsrc instead of uridecodebin (see here).
use RTSP2.0 if your camera/servers support it (as here), Maybe you would get more explicit error launching gst-launch without EOS (-e).
set pixel-aspect-ratio=1/1 in caps before nvoverlaysink
as last desesperate suggestion if nothing works out, if you have gstreamer ugly plugins, try to remove them for a try. These have been known to interfere in RTSP operation, mainly at authentification, but who knows…ugly is ugly.

labi · May 6, 2021, 8:35pm

Its true, so here is the script (these sequences are the same like our final solution)(rtsp ip stream are 720p@20fps) what I’m running:

#!/bin/bash

i=1
while [ "$i" != "655306" ]
do
echo "loop" $i

gst-launch-1.0 -e nvcompositor name=comp background-w=3840 background-h=2160 sink_0::xpos=0 sink_0::ypos=0 sink_0::width=1920 sink_0::height=1080 sink_1::xpos=1920 sink_1::ypos=0 sink_1::width=1920 sink_1::height=1080 sink_2::xpos=0 sink_2::ypos=1080 sink_2::width=1920 sink_2::height=1080 sink_3::xpos=1920 sink_3::ypos=1080 sink_3::width=1920 sink_3::height=1080 ! "video/x-raw(memory:NVMM),format=RGBA" ! nvvidconv ! "video/x-raw(memory:NVMM), width=1920, height=1080, format=NV12" ! nvoverlaysink sync=true uridecodebin uri="rtsp://admin:Dexon1991@192.168.1.210/" ! nvvidconv ! "video/x-raw(memory:NVMM),format=NV12, width=1920, height=1080, pixel-aspect-ratio=1/1" ! queue ! comp.sink_0 uridecodebin uri="rtsp://admin:Dexon1991@192.168.1.209/" ! nvvidconv ! "video/x-raw(memory:NVMM),format=NV12, width=1920, height=1080, pixel-aspect-ratio=1/1" ! queue ! comp.sink_1 uridecodebin uri="file:///tmp/network/192.168.1.2_DEXON_2016//7_Production/8_Test/1080p_demo_videos/Dubai in 4K - City of Gold.mp4" ! nvvidconv ! "video/x-raw(memory:NVMM),format=NV12, width=1920, height=1080, pixel-aspect-ratio=1/1" ! queue ! comp.sink_2 uridecodebin uri="file:///tmp/network/192.168.1.2_DEXON_2016//7_Production/8_Test/1080p_demo_videos/Amazing Nature Full HD 1080p Time Lapse.mp4" ! nvvidconv ! "video/x-raw(memory:NVMM),format=NV12, width=1920, height=1080, pixel-aspect-ratio=1/1" ! queue ! comp.sink_3 &

sleep 12
killall -2 gst-launch-1.0
sleep 5

gst-launch-1.0 -e uridecodebin uri="file:///tmp/network/192.168.1.2_DEXON_2016/7_Production/8_Test/4K_demo_videos/h265/New_York_in_4K_x265.mp4" name=bin ! nvvidconv ! "video/x-raw(memory:NVMM),format=RGBA" ! nvvidconv ! "video/x-raw(memory:NVMM), format=(string)NV12, width=1920, height=2160, pixel-aspect-ratio=1/1" ! queue ! nvoverlaysink overlay=1 overlay-x=0 overlay-y=0 overlay-w=1920 overlay-h=2160 bin. ! queue ! audioconvert ! audioresample ! autoaudiosink async-handling=true  &

gst-launch-1.0 -e uridecodebin uri="file:///tmp/network/192.168.1.2_DEXON_2016//7_Production/8_Test/1080p_demo_videos/Big Buck Bunny 1080p FULL HD Trickfilm animation (1080p HD).mp4" name=bin ! nvvidconv ! "video/x-raw(memory:NVMM),format=RGBA" ! nvvidconv ! "video/x-raw(memory:NVMM), format=(string)NV12, width=1920, height=2160, pixel-aspect-ratio=1/1" ! queue ! nvoverlaysink overlay=2 overlay-x=1920 overlay-y=0 overlay-w=1920 overlay-h=2160 bin. ! queue ! audioconvert ! audioresample ! autoaudiosink async-handling=true  &

sleep 12
killall -2 gst-launch-1.0
sleep 5
    i=$(($i+1))
done

DaneLLL · May 7, 2021, 10:10am

Hi,
Please apply this and give it a try:
Jetson/L4T/r32.5.x patches - eLinux.org
[camera] 3rdparty application fails to open with USB camera

The prebuilt lib is mainly for launching USB camera, but it also helps a usecase which usese nvv4l2decoder:
Gstreamer and v4l2loopback - #5 by DaneLLL

labi · May 12, 2021, 9:55am

I’m afraid this is not a solution, I saw the issue again.

Honey_Patouceul · May 12, 2021, 11:37am

As you are using -e flag, the first signal is catched for sending EOS. You would have to send a second signal than for freeing the pipeline. Or don’t use -e.

nadeemm · October 15, 2021, 3:37am