New nvstreammux sync-inputs and max-latency

philipp.schmidt · April 24, 2023, 4:07pm

Can someone explain the new nvstreammux parameters “sync-inputs” and “max-latency” in more detail?

We use a single RTSP source and ‘new’ nvstreammux with batch-size=1 and sync-inputs=1. We require nvstreammux to “instantly” push the buffer downstream and add no additional latency. Basically we only use nvstreammux to attach the metadata structures, nothing else.

uridecodebin → new nvstreammux batch-size=1 sync-inputs=1 → nvinferserver batch-size=1 → fakesink (with buffer probe)

It only works with sync-inputs=1, but it is unclear why that is the case from just reading the documentation.
Why is the buffer pushed downstream right away with “sync-inputs=1”, but delayed for “sync-inputs=0”? If batch-size=1 is set, every incoming buffer should instantly push a batch (of size 1) downstream? Why is it necessary to set sync-inputs to 1 to enable this behaviour?

philipp.schmidt · April 24, 2023, 4:11pm

Just to clarify: if sync-inputs is set to 0, the buffers at the fakesink arrive in “chunks”, so multiple buffers arrive at once, then there is a “lag” with no buffers arriving. We would like the frames to arrive as close to their presentation timestamp as possible.

fanzh · April 25, 2023, 2:02am

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU)

• DeepStream Version

• JetPack Version (valid for Jetson only)

• TensorRT Version

• NVIDIA GPU Driver Version (valid for GPU only)

• Issue Type( questions, new requirements, bugs)

• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

philipp.schmidt · April 25, 2023, 8:27am

• Hardware Platform (Jetson / GPU): dGPU x86
• DeepStream Version: 6.2-triton docker
• NVIDIA GPU Driver Version: 525.105.17
• Issue Type: questions
• How to reproduce the issue?
uridecodebin (rtsp source) → new nvstreammux batch-size=1 (sync-inputs=0 or 1) → nvinferserver batch-size=1 → fakesink sync=true (with buffer probe on sink)
Attach to buffer probe and observe arrival times of buffers and compare against pts of buffers.
Without sync-inputs=1, multiple buffers will arrive at once, desynced from their pts. With sync-inputs the buffers will arrive in a more timely maner, although not synced to pts (even with sync=true on fakesink).
• Expected outcome:
How can we configure the pipeline so every single frame / buffer arrives at the fakesink buffer probe synced to is pts?

philipp.schmidt · April 25, 2023, 8:29am

Working on an example to illustrate the issue.

philipp.schmidt · April 25, 2023, 9:58am

TimeSinceLastBuffer: Elapsed time since receiving the last buffer/frame on the buffer probe on fakesink
PTS: Presentation time stamp (buf_pts) from NvDsFrameMeta or GstBuffer.pts in case before nvstreammux
NTP-NOW: NTP timestamp (ntp_timestamp) from NvDsFrameMeta minus current time (system time, so time difference from nvstreammux to fakesink?)
DURATION: GstBuffer.duration

uridecodebin (rtsp) → fakesink sync=true (sink buffer probe)

This is the signal from rtsp directly after uridecodebin

Timings

Frame 0: TimeSinceLastBuffer=7840 ms     PTS=7112105750    DURATION=40000000
Frame 1: TimeSinceLastBuffer=1460 ms     PTS=7152646829    DURATION=40000000
Frame 2: TimeSinceLastBuffer=39 ms     PTS=7193716037    DURATION=40000000
Frame 3: TimeSinceLastBuffer=41 ms     PTS=7234244234    DURATION=40000000
Frame 4: TimeSinceLastBuffer=41 ms     PTS=7273183580    DURATION=40000000
Frame 5: TimeSinceLastBuffer=39 ms     PTS=7315287985    DURATION=40000000
Frame 6: TimeSinceLastBuffer=42 ms     PTS=7354768205    DURATION=40000000
Frame 7: TimeSinceLastBuffer=39 ms     PTS=7396315102    DURATION=40000000
Frame 8: TimeSinceLastBuffer=42 ms     PTS=7435803606    DURATION=40000000
Frame 9: TimeSinceLastBuffer=39 ms     PTS=7477325851    DURATION=40000000
Frame 10: TimeSinceLastBuffer=42 ms     PTS=7516822506    DURATION=40000000
Frame 11: TimeSinceLastBuffer=39 ms     PTS=7558320493    DURATION=40000000
Frame 12: TimeSinceLastBuffer=41 ms     PTS=7598811854    DURATION=40000000
Frame 13: TimeSinceLastBuffer=41 ms     PTS=7637825169    DURATION=40000000
Frame 14: TimeSinceLastBuffer=39 ms     PTS=7679782815    DURATION=40000000
Frame 15: TimeSinceLastBuffer=42 ms     PTS=7720262478    DURATION=40000000
Frame 16: TimeSinceLastBuffer=40 ms     PTS=7759299284    DURATION=40000000
Frame 17: TimeSinceLastBuffer=39 ms     PTS=7801210322    DURATION=40000000
Frame 18: TimeSinceLastBuffer=42 ms     PTS=7841678565    DURATION=40000000
Frame 19: TimeSinceLastBuffer=40 ms     PTS=7880738303    DURATION=40000000
Frame 20: TimeSinceLastBuffer=39 ms     PTS=7922603843    DURATION=40000000
Frame 21: TimeSinceLastBuffer=42 ms     PTS=7962143062    DURATION=40000000
Frame 22: TimeSinceLastBuffer=40 ms     PTS=8003514375    DURATION=40000000
Frame 23: TimeSinceLastBuffer=41 ms     PTS=8044018295    DURATION=40000000
Frame 24: TimeSinceLastBuffer=40 ms     PTS=8083060937    DURATION=40000000
Frame 25: TimeSinceLastBuffer=39 ms     PTS=8124604188    DURATION=40000000
Frame 26: TimeSinceLastBuffer=42 ms     PTS=8164893623    DURATION=40000000
Frame 27: TimeSinceLastBuffer=40 ms     PTS=8204312418    DURATION=40000000
Frame 28: TimeSinceLastBuffer=39 ms     PTS=8245465566    DURATION=40000000
Frame 29: TimeSinceLastBuffer=41 ms     PTS=8285748110    DURATION=40000000
Frame 30: TimeSinceLastBuffer=40 ms     PTS=8325180743    DURATION=40000000
Frame 31: TimeSinceLastBuffer=39 ms     PTS=8366306436    DURATION=40000000
Frame 32: TimeSinceLastBuffer=41 ms     PTS=8406028394    DURATION=40000000
Frame 33: TimeSinceLastBuffer=40 ms     PTS=8446855864    DURATION=40000000
Frame 34: TimeSinceLastBuffer=41 ms     PTS=8487127286    DURATION=40000000
Frame 35: TimeSinceLastBuffer=40 ms     PTS=8526582253    DURATION=40000000
Frame 36: TimeSinceLastBuffer=39 ms     PTS=8567396537    DURATION=40000000
Frame 37: TimeSinceLastBuffer=41 ms     PTS=8607928594    DURATION=40000000
Frame 38: TimeSinceLastBuffer=41 ms     PTS=8647663634    DURATION=40000000
Frame 39: TimeSinceLastBuffer=40 ms     PTS=8687868045    DURATION=40000000
Frame 40: TimeSinceLastBuffer=40 ms     PTS=8727838133    DURATION=40000000
Frame 41: TimeSinceLastBuffer=40 ms     PTS=8767898198    DURATION=40000000
Frame 42: TimeSinceLastBuffer=40 ms     PTS=8807749826    DURATION=40000000
Frame 43: TimeSinceLastBuffer=40 ms     PTS=8847779026    DURATION=40000000
Frame 44: TimeSinceLastBuffer=40 ms     PTS=8887720860    DURATION=40000000
Frame 45: TimeSinceLastBuffer=40 ms     PTS=8927808461    DURATION=40000000
Frame 46: TimeSinceLastBuffer=40 ms     PTS=8967663622    DURATION=40000000
Frame 47: TimeSinceLastBuffer=40 ms     PTS=9007692126    DURATION=40000000
Frame 48: TimeSinceLastBuffer=40 ms     PTS=9047635346    DURATION=40000000
Frame 49: TimeSinceLastBuffer=40 ms     PTS=9087607296    DURATION=40000000
Frame 50: TimeSinceLastBuffer=40 ms     PTS=9127551867    DURATION=40000000
Frame 51: TimeSinceLastBuffer=40 ms     PTS=9167579470    DURATION=40000000
Frame 52: TimeSinceLastBuffer=40 ms     PTS=9207497322    DURATION=40000000
Frame 53: TimeSinceLastBuffer=40 ms     PTS=9247524485    DURATION=40000000
Frame 54: TimeSinceLastBuffer=40 ms     PTS=9287470376    DURATION=40000000
Frame 55: TimeSinceLastBuffer=40 ms     PTS=9327417130    DURATION=40000000
Frame 56: TimeSinceLastBuffer=40 ms     PTS=9367443646    DURATION=40000000
Frame 57: TimeSinceLastBuffer=40 ms     PTS=9407364732    DURATION=40000000
Frame 58: TimeSinceLastBuffer=40 ms     PTS=9447390826    DURATION=40000000
Frame 59: TimeSinceLastBuffer=40 ms     PTS=9487313169    DURATION=40000000
Frame 60: TimeSinceLastBuffer=40 ms     PTS=9527287696    DURATION=40000000
Frame 61: TimeSinceLastBuffer=40 ms     PTS=9567338847    DURATION=40000000
Frame 62: TimeSinceLastBuffer=40 ms     PTS=9607237360    DURATION=40000000
Frame 63: TimeSinceLastBuffer=40 ms     PTS=9647262427    DURATION=40000000
Frame 64: TimeSinceLastBuffer=40 ms     PTS=9687187827    DURATION=40000000
Frame 65: TimeSinceLastBuffer=40 ms     PTS=9727212494    DURATION=40000000
Frame 66: TimeSinceLastBuffer=40 ms     PTS=9767115003    DURATION=40000000
Frame 67: TimeSinceLastBuffer=40 ms     PTS=9807139083    DURATION=40000000
Frame 68: TimeSinceLastBuffer=40 ms     PTS=9847091116    DURATION=40000000
Frame 69: TimeSinceLastBuffer=40 ms     PTS=9887163357    DURATION=40000000
Frame 70: TimeSinceLastBuffer=40 ms     PTS=9927043913    DURATION=40000000
Frame 71: TimeSinceLastBuffer=40 ms     PTS=9967067420    DURATION=40000000
Frame 72: TimeSinceLastBuffer=40 ms     PTS=10006997462    DURATION=40000000
Frame 73: TimeSinceLastBuffer=40 ms     PTS=10047020594    DURATION=40000000
Frame 74: TimeSinceLastBuffer=40 ms     PTS=10086951752    DURATION=40000000
Frame 75: TimeSinceLastBuffer=40 ms     PTS=10126974515    DURATION=40000000
Frame 76: TimeSinceLastBuffer=40 ms     PTS=10166906770    DURATION=40000000
Frame 77: TimeSinceLastBuffer=40 ms     PTS=10206929171    DURATION=40000000
Frame 78: TimeSinceLastBuffer=40 ms     PTS=10246228308    DURATION=40000000
Frame 79: TimeSinceLastBuffer=39 ms     PTS=10286452648    DURATION=40000000
Frame 80: TimeSinceLastBuffer=40 ms     PTS=10326005762    DURATION=40000000
Frame 81: TimeSinceLastBuffer=40 ms     PTS=10366678797    DURATION=40000000
Frame 82: TimeSinceLastBuffer=41 ms     PTS=10405784997    DURATION=40000000
Frame 83: TimeSinceLastBuffer=39 ms     PTS=10445565998    DURATION=40000000
Frame 84: TimeSinceLastBuffer=40 ms     PTS=10485133242    DURATION=40000000
Frame 85: TimeSinceLastBuffer=40 ms     PTS=10525348751    DURATION=40000000
Frame 86: TimeSinceLastBuffer=40 ms     PTS=10564707382    DURATION=40000000
Frame 87: TimeSinceLastBuffer=39 ms     PTS=10604919457    DURATION=40000000
Frame 88: TimeSinceLastBuffer=40 ms     PTS=10644288309    DURATION=40000000
Frame 89: TimeSinceLastBuffer=39 ms     PTS=10684497004    DURATION=40000000
Frame 90: TimeSinceLastBuffer=40 ms     PTS=10723672188    DURATION=40000000
Frame 91: TimeSinceLastBuffer=39 ms     PTS=10763875914    DURATION=40000000
Frame 92: TimeSinceLastBuffer=40 ms     PTS=10803470091    DURATION=40000000
Frame 93: TimeSinceLastBuffer=40 ms     PTS=10844081283    DURATION=40000000
Frame 94: TimeSinceLastBuffer=41 ms     PTS=10883070735    DURATION=40000000
Frame 95: TimeSinceLastBuffer=39 ms     PTS=10923269611    DURATION=40000000
Frame 96: TimeSinceLastBuffer=40 ms     PTS=10962677743    DURATION=40000000
Frame 97: TimeSinceLastBuffer=39 ms     PTS=11002873450    DURATION=40000000
Frame 98: TimeSinceLastBuffer=40 ms     PTS=11042291014    DURATION=40000000
Frame 99: TimeSinceLastBuffer=39 ms     PTS=11082483602    DURATION=40000000
Frame 100: TimeSinceLastBuffer=40 ms     PTS=11121910448    DURATION=40000000

uridecodebin (rtsp) → new nvstreammux sync-inputs=0 → fakesink sync=true (sink buffer probe)

This is with sync-inputs=0 disabled, notice multiple buffers arrive “at once”, even though their pts suggest they should arrive later. Also the NTP timestamp (system time at nvstreammux minus now) says the all arrive instantly.

Timings

Frame 0: TimeSinceLastBuffer=6222ms 		 PTS=5472689611 		 NTP-NOW=-0.33ms
Frame 1: TimeSinceLastBuffer=1ms 		 PTS=5512670018 		 NTP-NOW=-0.04ms
Frame 2: TimeSinceLastBuffer=0ms 		 PTS=5552679775 		 NTP-NOW=-0.04ms
Frame 3: TimeSinceLastBuffer=3ms 		 PTS=5592650738 		 NTP-NOW=-0.03ms
Frame 4: TimeSinceLastBuffer=0ms 		 PTS=5632660339 		 NTP-NOW=-0.03ms
Frame 5: TimeSinceLastBuffer=3ms 		 PTS=5672631765 		 NTP-NOW=-0.04ms
Frame 6: TimeSinceLastBuffer=0ms 		 PTS=5712641213 		 NTP-NOW=-0.03ms
Frame 7: TimeSinceLastBuffer=3ms 		 PTS=5752613094 		 NTP-NOW=-0.03ms
Frame 8: TimeSinceLastBuffer=0ms 		 PTS=5792622392 		 NTP-NOW=-0.03ms
Frame 9: TimeSinceLastBuffer=3ms 		 PTS=5832894565 		 NTP-NOW=-0.04ms
Frame 10: TimeSinceLastBuffer=0ms 		 PTS=5872603871 		 NTP-NOW=-0.05ms
Frame 11: TimeSinceLastBuffer=502ms 		 PTS=5913468996 		 NTP-NOW=-0.15ms
Frame 12: TimeSinceLastBuffer=1ms 		 PTS=5953182934 		 NTP-NOW=-0.05ms
Frame 13: TimeSinceLastBuffer=0ms 		 PTS=5994034272 		 NTP-NOW=-0.06ms
Frame 14: TimeSinceLastBuffer=0ms 		 PTS=6033752769 		 NTP-NOW=-0.05ms
Frame 15: TimeSinceLastBuffer=3ms 		 PTS=6074590540 		 NTP-NOW=-0.05ms
Frame 16: TimeSinceLastBuffer=0ms 		 PTS=6114313523 		 NTP-NOW=-0.04ms
Frame 17: TimeSinceLastBuffer=1ms 		 PTS=6154865341 		 NTP-NOW=-0.03ms
Frame 18: TimeSinceLastBuffer=3ms 		 PTS=6195137943 		 NTP-NOW=-0.02ms
Frame 19: TimeSinceLastBuffer=3ms 		 PTS=6235676623 		 NTP-NOW=-0.02ms
Frame 20: TimeSinceLastBuffer=0ms 		 PTS=6275408365 		 NTP-NOW=-0.02ms
Frame 21: TimeSinceLastBuffer=3ms 		 PTS=6316365216 		 NTP-NOW=-0.02ms
Frame 22: TimeSinceLastBuffer=0ms 		 PTS=6355942735 		 NTP-NOW=-0.02ms
Frame 23: TimeSinceLastBuffer=3ms 		 PTS=6397200067 		 NTP-NOW=-0.02ms
Frame 24: TimeSinceLastBuffer=510ms 		 PTS=6436784318 		 NTP-NOW=-0.11ms
Frame 25: TimeSinceLastBuffer=0ms 		 PTS=6478021613 		 NTP-NOW=-0.17ms
Frame 26: TimeSinceLastBuffer=0ms 		 PTS=6517612490 		 NTP-NOW=-0.05ms
Frame 27: TimeSinceLastBuffer=2ms 		 PTS=6558830067 		 NTP-NOW=-0.05ms
Frame 28: TimeSinceLastBuffer=0ms 		 PTS=6598427463 		 NTP-NOW=-0.03ms
Frame 29: TimeSinceLastBuffer=3ms 		 PTS=6639625638 		 NTP-NOW=-0.05ms
Frame 30: TimeSinceLastBuffer=0ms 		 PTS=6679229450 		 NTP-NOW=-0.03ms
Frame 31: TimeSinceLastBuffer=3ms 		 PTS=6720408530 		 NTP-NOW=-0.05ms
Frame 32: TimeSinceLastBuffer=0ms 		 PTS=6760018656 		 NTP-NOW=-0.02ms
Frame 33: TimeSinceLastBuffer=3ms 		 PTS=6801178946 		 NTP-NOW=-0.05ms
Frame 34: TimeSinceLastBuffer=0ms 		 PTS=6840795285 		 NTP-NOW=-0.03ms
Frame 35: TimeSinceLastBuffer=3ms 		 PTS=6881937085 		 NTP-NOW=-0.03ms
Frame 36: TimeSinceLastBuffer=0ms 		 PTS=6921559538 		 NTP-NOW=-0.02ms
Frame 37: TimeSinceLastBuffer=4ms 		 PTS=6962683142 		 NTP-NOW=-0.07ms
Frame 38: TimeSinceLastBuffer=507ms 		 PTS=7002311612 		 NTP-NOW=-0.19ms
Frame 39: TimeSinceLastBuffer=0ms 		 PTS=7043417310 		 NTP-NOW=-0.10ms
Frame 40: TimeSinceLastBuffer=0ms 		 PTS=7083051700 		 NTP-NOW=-0.04ms
Frame 41: TimeSinceLastBuffer=2ms 		 PTS=7124139778 		 NTP-NOW=-0.09ms
Frame 42: TimeSinceLastBuffer=0ms 		 PTS=7163779995 		 NTP-NOW=-0.06ms
Frame 43: TimeSinceLastBuffer=4ms 		 PTS=7204850733 		 NTP-NOW=-0.08ms
Frame 44: TimeSinceLastBuffer=0ms 		 PTS=7244496683 		 NTP-NOW=-0.08ms
Frame 45: TimeSinceLastBuffer=2ms 		 PTS=7285550358 		 NTP-NOW=-0.08ms
Frame 46: TimeSinceLastBuffer=0ms 		 PTS=7325201950 		 NTP-NOW=-0.06ms
Frame 47: TimeSinceLastBuffer=3ms 		 PTS=7366238834 		 NTP-NOW=-0.08ms
Frame 48: TimeSinceLastBuffer=0ms 		 PTS=7405895978 		 NTP-NOW=-0.07ms
Frame 49: TimeSinceLastBuffer=3ms 		 PTS=7446916339 		 NTP-NOW=-0.09ms
Frame 50: TimeSinceLastBuffer=0ms 		 PTS=7486578947 		 NTP-NOW=-0.13ms
Frame 51: TimeSinceLastBuffer=510ms 		 PTS=7527583047 		 NTP-NOW=-0.13ms
Frame 52: TimeSinceLastBuffer=0ms 		 PTS=7567251032 		 NTP-NOW=-0.09ms
Frame 53: TimeSinceLastBuffer=1ms 		 PTS=7607699896 		 NTP-NOW=-0.11ms
Frame 54: TimeSinceLastBuffer=0ms 		 PTS=7647641706 		 NTP-NOW=-0.12ms
Frame 55: TimeSinceLastBuffer=3ms 		 PTS=7687814884 		 NTP-NOW=-0.09ms
Frame 56: TimeSinceLastBuffer=0ms 		 PTS=7727757621 		 NTP-NOW=-0.08ms
Frame 57: TimeSinceLastBuffer=3ms 		 PTS=7767928039 		 NTP-NOW=-0.09ms
Frame 58: TimeSinceLastBuffer=0ms 		 PTS=7807871689 		 NTP-NOW=-0.09ms
Frame 59: TimeSinceLastBuffer=3ms 		 PTS=7848039390 		 NTP-NOW=-0.09ms
Frame 60: TimeSinceLastBuffer=0ms 		 PTS=7887983938 		 NTP-NOW=-0.07ms
Frame 61: TimeSinceLastBuffer=4ms 		 PTS=7928148968 		 NTP-NOW=-0.11ms
Frame 62: TimeSinceLastBuffer=0ms 		 PTS=7968094399 		 NTP-NOW=-0.04ms
Frame 63: TimeSinceLastBuffer=2ms 		 PTS=8008256799 		 NTP-NOW=-0.08ms
Frame 64: TimeSinceLastBuffer=510ms 		 PTS=8048203100 		 NTP-NOW=-0.12ms
Frame 65: TimeSinceLastBuffer=0ms 		 PTS=8088362911 		 NTP-NOW=-0.17ms
Frame 66: TimeSinceLastBuffer=1ms 		 PTS=8128310068 		 NTP-NOW=-0.05ms
Frame 67: TimeSinceLastBuffer=2ms 		 PTS=8168467332 		 NTP-NOW=-0.05ms
Frame 68: TimeSinceLastBuffer=0ms 		 PTS=8208415331 		 NTP-NOW=-0.03ms
Frame 69: TimeSinceLastBuffer=3ms 		 PTS=8248570089 		 NTP-NOW=-0.05ms
Frame 70: TimeSinceLastBuffer=0ms 		 PTS=8288518917 		 NTP-NOW=-0.03ms
Frame 71: TimeSinceLastBuffer=3ms 		 PTS=8328671209 		 NTP-NOW=-0.05ms
Frame 72: TimeSinceLastBuffer=0ms 		 PTS=8368620852 		 NTP-NOW=-0.07ms
Frame 73: TimeSinceLastBuffer=4ms 		 PTS=8408770717 		 NTP-NOW=-0.05ms
Frame 74: TimeSinceLastBuffer=0ms 		 PTS=8448721163 		 NTP-NOW=-0.04ms
Frame 75: TimeSinceLastBuffer=3ms 		 PTS=8488868640 		 NTP-NOW=-0.05ms
Frame 76: TimeSinceLastBuffer=0ms 		 PTS=8528819875 		 NTP-NOW=-0.04ms
Frame 77: TimeSinceLastBuffer=512ms 		 PTS=8568965003 		 NTP-NOW=-0.12ms
Frame 78: TimeSinceLastBuffer=1ms 		 PTS=8608917015 		 NTP-NOW=-0.05ms
Frame 79: TimeSinceLastBuffer=0ms 		 PTS=8649059830 		 NTP-NOW=-0.08ms
Frame 80: TimeSinceLastBuffer=1ms 		 PTS=8689012607 		 NTP-NOW=-0.05ms
Frame 81: TimeSinceLastBuffer=2ms 		 PTS=8729153145 		 NTP-NOW=-0.03ms
Frame 82: TimeSinceLastBuffer=0ms 		 PTS=8769106675 		 NTP-NOW=-0.03ms
Frame 83: TimeSinceLastBuffer=3ms 		 PTS=8809244974 		 NTP-NOW=-0.02ms
Frame 84: TimeSinceLastBuffer=0ms 		 PTS=8849199244 		 NTP-NOW=-0.02ms
Frame 85: TimeSinceLastBuffer=3ms 		 PTS=8889335339 		 NTP-NOW=-0.03ms
Frame 86: TimeSinceLastBuffer=0ms 		 PTS=8929290338 		 NTP-NOW=-0.02ms
Frame 87: TimeSinceLastBuffer=3ms 		 PTS=8969424264 		 NTP-NOW=-0.03ms
Frame 88: TimeSinceLastBuffer=0ms 		 PTS=9009379980 		 NTP-NOW=-0.02ms
Frame 89: TimeSinceLastBuffer=3ms 		 PTS=9049511772 		 NTP-NOW=-0.07ms
Frame 90: TimeSinceLastBuffer=510ms 		 PTS=9089468194 		 NTP-NOW=-0.12ms
Frame 91: TimeSinceLastBuffer=0ms 		 PTS=9129597886 		 NTP-NOW=-0.07ms
Frame 92: TimeSinceLastBuffer=0ms 		 PTS=9169555002 		 NTP-NOW=-0.05ms
Frame 93: TimeSinceLastBuffer=3ms 		 PTS=9209682627 		 NTP-NOW=-0.06ms
Frame 94: TimeSinceLastBuffer=1ms 		 PTS=9249640427 		 NTP-NOW=-0.04ms
Frame 95: TimeSinceLastBuffer=0ms 		 PTS=9289766018 		 NTP-NOW=-0.03ms
Frame 96: TimeSinceLastBuffer=0ms 		 PTS=9329724490 		 NTP-NOW=-0.03ms
Frame 97: TimeSinceLastBuffer=3ms 		 PTS=9369848080 		 NTP-NOW=-0.05ms
Frame 98: TimeSinceLastBuffer=0ms 		 PTS=9409807214 		 NTP-NOW=-0.05ms
Frame 99: TimeSinceLastBuffer=3ms 		 PTS=9449928834 		 NTP-NOW=-0.04ms
Frame 100: TimeSinceLastBuffer=0ms 		 PTS=9489888619 		 NTP-NOW=-0.05ms

uridecodebin (rtsp) → new nvstreammux sync-inputs=1 → fakesink sync=true (sink buffer probe)

This is with sync-inputs=1 enabled, it works fine. NTP also suggests 80ms (two frames) pass before the buffer reaches the fakesink, which I’m not sure why that would be the case (there is no element between streammuxer and sink).

Timings

Frame 0: TimeSinceLastBuffer=10926ms 		 PTS=10539917585 		 NTP-NOW=-0.30ms
Frame 1: TimeSinceLastBuffer=1802ms 		 PTS=10579848397 		 NTP-NOW=-1801.35ms
Frame 2: TimeSinceLastBuffer=38ms 		 PTS=10619779763 		 NTP-NOW=-1838.18ms
Frame 3: TimeSinceLastBuffer=40ms 		 PTS=10659711678 		 NTP-NOW=-1375.24ms
Frame 4: TimeSinceLastBuffer=40ms 		 PTS=10699644138 		 NTP-NOW=-79.78ms
Frame 5: TimeSinceLastBuffer=40ms 		 PTS=10739329947 		 NTP-NOW=-39.98ms
Frame 6: TimeSinceLastBuffer=40ms 		 PTS=10779174734 		 NTP-NOW=-79.57ms
Frame 7: TimeSinceLastBuffer=40ms 		 PTS=10819486412 		 NTP-NOW=-79.46ms
Frame 8: TimeSinceLastBuffer=40ms 		 PTS=10859020763 		 NTP-NOW=-80.03ms
Frame 9: TimeSinceLastBuffer=40ms 		 PTS=10898716506 		 NTP-NOW=-79.70ms
Frame 10: TimeSinceLastBuffer=40ms 		 PTS=10938868024 		 NTP-NOW=-79.16ms
Frame 11: TimeSinceLastBuffer=40ms 		 PTS=10978417098 		 NTP-NOW=-79.77ms
Frame 12: TimeSinceLastBuffer=40ms 		 PTS=11018566201 		 NTP-NOW=-79.60ms
Frame 13: TimeSinceLastBuffer=41ms 		 PTS=11058122461 		 NTP-NOW=-79.95ms
Frame 14: TimeSinceLastBuffer=39ms 		 PTS=11097976908 		 NTP-NOW=-79.55ms
Frame 15: TimeSinceLastBuffer=40ms 		 PTS=11138269188 		 NTP-NOW=-78.92ms
Frame 16: TimeSinceLastBuffer=40ms 		 PTS=11177832519 		 NTP-NOW=-80.28ms
Frame 17: TimeSinceLastBuffer=39ms 		 PTS=11217547198 		 NTP-NOW=-79.75ms
Frame 18: TimeSinceLastBuffer=40ms 		 PTS=11257689286 		 NTP-NOW=-78.97ms
Frame 19: TimeSinceLastBuffer=40ms 		 PTS=11297266424 		 NTP-NOW=-79.70ms
Frame 20: TimeSinceLastBuffer=40ms 		 PTS=11337127719 		 NTP-NOW=-79.61ms
Frame 21: TimeSinceLastBuffer=40ms 		 PTS=11377406247 		 NTP-NOW=-79.27ms
Frame 22: TimeSinceLastBuffer=40ms 		 PTS=11416990124 		 NTP-NOW=-80.00ms
Frame 23: TimeSinceLastBuffer=40ms 		 PTS=11456718228 		 NTP-NOW=-79.80ms
Frame 24: TimeSinceLastBuffer=40ms 		 PTS=11496853630 		 NTP-NOW=-79.17ms
Frame 25: TimeSinceLastBuffer=40ms 		 PTS=11536450664 		 NTP-NOW=-79.77ms
Frame 26: TimeSinceLastBuffer=40ms 		 PTS=11576318485 		 NTP-NOW=-78.69ms
Frame 27: TimeSinceLastBuffer=40ms 		 PTS=11616583909 		 NTP-NOW=-79.36ms
Frame 28: TimeSinceLastBuffer=40ms 		 PTS=11656057292 		 NTP-NOW=-80.06ms
Frame 29: TimeSinceLastBuffer=39ms 		 PTS=11695928260 		 NTP-NOW=-79.60ms
Frame 30: TimeSinceLastBuffer=40ms 		 PTS=11736187364 		 NTP-NOW=-79.25ms
Frame 31: TimeSinceLastBuffer=40ms 		 PTS=11775649423 		 NTP-NOW=-79.02ms
Frame 32: TimeSinceLastBuffer=39ms 		 PTS=11815511675 		 NTP-NOW=-79.57ms
Frame 33: TimeSinceLastBuffer=40ms 		 PTS=11855788282 		 NTP-NOW=-79.29ms
Frame 34: TimeSinceLastBuffer=40ms 		 PTS=11895239476 		 NTP-NOW=-80.01ms
Frame 35: TimeSinceLastBuffer=39ms 		 PTS=11935105008 		 NTP-NOW=-79.60ms
Frame 36: TimeSinceLastBuffer=40ms 		 PTS=11975375029 		 NTP-NOW=-79.17ms
Frame 37: TimeSinceLastBuffer=40ms 		 PTS=12014839291 		 NTP-NOW=-80.04ms
Frame 38: TimeSinceLastBuffer=39ms 		 PTS=12054708024 		 NTP-NOW=-79.70ms
Frame 39: TimeSinceLastBuffer=40ms 		 PTS=12094971616 		 NTP-NOW=-79.21ms
Frame 40: TimeSinceLastBuffer=40ms 		 PTS=12134448632 		 NTP-NOW=-79.99ms
Frame 41: TimeSinceLastBuffer=39ms 		 PTS=12174320491 		 NTP-NOW=-79.56ms
Frame 42: TimeSinceLastBuffer=40ms 		 PTS=12214577807 		 NTP-NOW=-79.24ms
Frame 43: TimeSinceLastBuffer=40ms 		 PTS=12254067276 		 NTP-NOW=-80.08ms
Frame 44: TimeSinceLastBuffer=39ms 		 PTS=12294193375 		 NTP-NOW=-79.68ms
Frame 45: TimeSinceLastBuffer=40ms 		 PTS=12333818095 		 NTP-NOW=-79.44ms
Frame 46: TimeSinceLastBuffer=40ms 		 PTS=12373942185 		 NTP-NOW=-79.63ms
Frame 47: TimeSinceLastBuffer=40ms 		 PTS=12413572886 		 NTP-NOW=-79.63ms
Frame 48: TimeSinceLastBuffer=40ms 		 PTS=12453694998 		 NTP-NOW=-79.60ms
Frame 49: TimeSinceLastBuffer=40ms 		 PTS=12493331584 		 NTP-NOW=-79.75ms
Frame 50: TimeSinceLastBuffer=40ms 		 PTS=12533451750 		 NTP-NOW=-79.63ms
Frame 51: TimeSinceLastBuffer=40ms 		 PTS=12573094128 		 NTP-NOW=-79.63ms
Frame 52: TimeSinceLastBuffer=40ms 		 PTS=12613212379 		 NTP-NOW=-79.74ms
Frame 53: TimeSinceLastBuffer=40ms 		 PTS=12652860456 		 NTP-NOW=-79.65ms
Frame 54: TimeSinceLastBuffer=40ms 		 PTS=12692976823 		 NTP-NOW=-79.58ms
Frame 55: TimeSinceLastBuffer=40ms 		 PTS=12732630507 		 NTP-NOW=-79.63ms
Frame 56: TimeSinceLastBuffer=40ms 		 PTS=12772745020 		 NTP-NOW=-79.68ms
Frame 57: TimeSinceLastBuffer=40ms 		 PTS=12812404223 		 NTP-NOW=-79.79ms
Frame 58: TimeSinceLastBuffer=40ms 		 PTS=12852516911 		 NTP-NOW=-79.70ms
Frame 59: TimeSinceLastBuffer=40ms 		 PTS=12892181545 		 NTP-NOW=-79.68ms
Frame 60: TimeSinceLastBuffer=40ms 		 PTS=12932292437 		 NTP-NOW=-79.66ms
Frame 61: TimeSinceLastBuffer=40ms 		 PTS=12971962415 		 NTP-NOW=-79.69ms
Frame 62: TimeSinceLastBuffer=40ms 		 PTS=13012071540 		 NTP-NOW=-79.69ms
Frame 63: TimeSinceLastBuffer=40ms 		 PTS=13051746777 		 NTP-NOW=-79.68ms
Frame 64: TimeSinceLastBuffer=40ms 		 PTS=13091854163 		 NTP-NOW=-79.77ms
Frame 65: TimeSinceLastBuffer=40ms 		 PTS=13131534576 		 NTP-NOW=-79.68ms
Frame 66: TimeSinceLastBuffer=40ms 		 PTS=13171640250 		 NTP-NOW=-79.68ms
Frame 67: TimeSinceLastBuffer=40ms 		 PTS=13211325757 		 NTP-NOW=-79.71ms
Frame 68: TimeSinceLastBuffer=40ms 		 PTS=13251429747 		 NTP-NOW=-79.69ms
Frame 69: TimeSinceLastBuffer=40ms 		 PTS=13291120266 		 NTP-NOW=-79.71ms
Frame 70: TimeSinceLastBuffer=40ms 		 PTS=13331222599 		 NTP-NOW=-79.65ms
Frame 71: TimeSinceLastBuffer=40ms 		 PTS=13370918049 		 NTP-NOW=-79.68ms
Frame 72: TimeSinceLastBuffer=40ms 		 PTS=13411018751 		 NTP-NOW=-79.16ms
Frame 73: TimeSinceLastBuffer=40ms 		 PTS=13450719054 		 NTP-NOW=-79.69ms
Frame 74: TimeSinceLastBuffer=40ms 		 PTS=13490818152 		 NTP-NOW=-79.72ms
Frame 75: TimeSinceLastBuffer=40ms 		 PTS=13530523231 		 NTP-NOW=-79.66ms
Frame 76: TimeSinceLastBuffer=40ms 		 PTS=13570620749 		 NTP-NOW=-79.74ms
Frame 77: TimeSinceLastBuffer=40ms 		 PTS=13610330529 		 NTP-NOW=-79.60ms
Frame 78: TimeSinceLastBuffer=40ms 		 PTS=13650426493 		 NTP-NOW=-79.70ms
Frame 79: TimeSinceLastBuffer=40ms 		 PTS=13690140897 		 NTP-NOW=-79.73ms
Frame 80: TimeSinceLastBuffer=40ms 		 PTS=13730235332 		 NTP-NOW=-79.69ms
Frame 81: TimeSinceLastBuffer=40ms 		 PTS=13770281403 		 NTP-NOW=-79.70ms
Frame 82: TimeSinceLastBuffer=40ms 		 PTS=13810047217 		 NTP-NOW=-80.05ms
Frame 83: TimeSinceLastBuffer=40ms 		 PTS=13850744170 		 NTP-NOW=-79.74ms
Frame 84: TimeSinceLastBuffer=41ms 		 PTS=13890513716 		 NTP-NOW=-80.45ms
Frame 85: TimeSinceLastBuffer=40ms 		 PTS=13931199562 		 NTP-NOW=-80.32ms
Frame 86: TimeSinceLastBuffer=41ms 		 PTS=13970972780 		 NTP-NOW=-80.29ms
Frame 87: TimeSinceLastBuffer=40ms 		 PTS=14011647697 		 NTP-NOW=-78.36ms
Frame 88: TimeSinceLastBuffer=41ms 		 PTS=14051424529 		 NTP-NOW=-80.35ms
Frame 89: TimeSinceLastBuffer=40ms 		 PTS=14092088690 		 NTP-NOW=-80.41ms
Frame 90: TimeSinceLastBuffer=41ms 		 PTS=14131869079 		 NTP-NOW=-80.34ms
Frame 91: TimeSinceLastBuffer=40ms 		 PTS=14172522655 		 NTP-NOW=-80.36ms
Frame 92: TimeSinceLastBuffer=41ms 		 PTS=14212306544 		 NTP-NOW=-79.88ms
Frame 93: TimeSinceLastBuffer=40ms 		 PTS=14252949705 		 NTP-NOW=-80.32ms
Frame 94: TimeSinceLastBuffer=41ms 		 PTS=14292737038 		 NTP-NOW=-80.39ms
Frame 95: TimeSinceLastBuffer=40ms 		 PTS=14333369949 		 NTP-NOW=-80.31ms
Frame 96: TimeSinceLastBuffer=41ms 		 PTS=14373160671 		 NTP-NOW=-80.30ms
Frame 97: TimeSinceLastBuffer=40ms 		 PTS=14413783496 		 NTP-NOW=-79.68ms
Frame 98: TimeSinceLastBuffer=41ms 		 PTS=14453577553 		 NTP-NOW=-80.31ms
Frame 99: TimeSinceLastBuffer=40ms 		 PTS=14494190453 		 NTP-NOW=-80.36ms
Frame 100: TimeSinceLastBuffer=41ms 		 PTS=14533987792 		 NTP-NOW=-80.30ms

Could I get an explanation of what sync-inputs=1 does exactly in this example? The documentation is rather sparse on this topic.
Can we expect this to work for RTMP, HLS, etc. as well?

EDIT: Previous results were broken because latency of rtspjitterbuffer was set too low which messed up all PTS in the pipeline, fixed now.

philipp.schmidt · April 25, 2023, 12:14pm

Also, it seems to make a difference it sync=true or sync=false is set or whether sync is not set at all on the fakesink in combination with sync-inputs=1:

uridecodebin (rtsp) → new nvstreammux sync-inputs=1 → fakesink sync=false (sink buffer probe)

With sync=false everything is working fine.

Timings

Frame 0: TimeSinceLastBuffer=6129ms	PTS=5475624382	NTP-NOW=-0.30ms
Frame 1: TimeSinceLastBuffer=1524ms	PTS=5515025912	NTP-NOW=-1523.89ms
Frame 2: TimeSinceLastBuffer=38ms	PTS=5553843297	NTP-NOW=-1558.73ms
Frame 3: TimeSinceLastBuffer=39ms	PTS=5594432230	NTP-NOW=-1597.44ms
Frame 4: TimeSinceLastBuffer=41ms	PTS=5632679528	NTP-NOW=-79.27ms
Frame 5: TimeSinceLastBuffer=38ms	PTS=5673259076	NTP-NOW=-78.75ms
Frame 6: TimeSinceLastBuffer=41ms	PTS=5711534305	NTP-NOW=-78.65ms
Frame 7: TimeSinceLastBuffer=38ms	PTS=5752104617	NTP-NOW=-78.78ms
Frame 8: TimeSinceLastBuffer=41ms	PTS=5790407333	NTP-NOW=-40.56ms
Frame 9: TimeSinceLastBuffer=38ms	PTS=5830968556	NTP-NOW=-78.73ms
Frame 10: TimeSinceLastBuffer=41ms	PTS=5868750458	NTP-NOW=-78.72ms
Frame 11: TimeSinceLastBuffer=38ms	PTS=5909298319	NTP-NOW=-77.26ms
Frame 12: TimeSinceLastBuffer=40ms	PTS=5948206979	NTP-NOW=-78.22ms
Frame 13: TimeSinceLastBuffer=39ms	PTS=5989850599	NTP-NOW=-79.32ms
Frame 14: TimeSinceLastBuffer=42ms	PTS=6027133030	NTP-NOW=-80.60ms
Frame 15: TimeSinceLastBuffer=37ms	PTS=6067667848	NTP-NOW=-78.96ms
Frame 16: TimeSinceLastBuffer=40ms	PTS=6106076196	NTP-NOW=-40.55ms
Frame 17: TimeSinceLastBuffer=38ms	PTS=6146602491	NTP-NOW=-76.94ms
Frame 18: TimeSinceLastBuffer=40ms	PTS=6185036204	NTP-NOW=-40.55ms
Frame 19: TimeSinceLastBuffer=38ms	PTS=6225554112	NTP-NOW=-78.86ms
Frame 20: TimeSinceLastBuffer=41ms	PTS=6264012785	NTP-NOW=-0.18ms
Frame 21: TimeSinceLastBuffer=38ms	PTS=6304522439	NTP-NOW=-38.44ms
Frame 22: TimeSinceLastBuffer=41ms	PTS=6342508155	NTP-NOW=-78.68ms
Frame 23: TimeSinceLastBuffer=38ms	PTS=6383005675	NTP-NOW=-78.39ms
Frame 24: TimeSinceLastBuffer=40ms	PTS=6422014615	NTP-NOW=-78.33ms
Frame 25: TimeSinceLastBuffer=39ms	PTS=6463507208	NTP-NOW=-79.48ms
Frame 26: TimeSinceLastBuffer=41ms	PTS=6501525023	NTP-NOW=-80.40ms
Frame 27: TimeSinceLastBuffer=38ms	PTS=6541039348	NTP-NOW=-79.37ms
Frame 28: TimeSinceLastBuffer=40ms	PTS=6580079623	NTP-NOW=-77.48ms
Frame 29: TimeSinceLastBuffer=39ms	PTS=6620557558	NTP-NOW=-78.48ms
Frame 30: TimeSinceLastBuffer=41ms	PTS=6659135192	NTP-NOW=-79.44ms
Frame 31: TimeSinceLastBuffer=39ms	PTS=6699605511	NTP-NOW=-78.93ms
Frame 32: TimeSinceLastBuffer=40ms	PTS=6738205812	NTP-NOW=-78.91ms
Frame 33: TimeSinceLastBuffer=39ms	PTS=6778668636	NTP-NOW=-78.44ms
Frame 34: TimeSinceLastBuffer=40ms	PTS=6817576499	NTP-NOW=-78.99ms
Frame 35: TimeSinceLastBuffer=39ms	PTS=6857291243	NTP-NOW=-79.30ms
Frame 36: TimeSinceLastBuffer=40ms	PTS=6897859473	NTP-NOW=-78.57ms
Frame 37: TimeSinceLastBuffer=41ms	PTS=6937746691	NTP-NOW=-80.17ms
Frame 38: TimeSinceLastBuffer=40ms	PTS=6978413569	NTP-NOW=-80.34ms
Frame 39: TimeSinceLastBuffer=41ms	PTS=7018137634	NTP-NOW=-80.50ms
Frame 40: TimeSinceLastBuffer=40ms	PTS=7058958835	NTP-NOW=-80.30ms
Frame 41: TimeSinceLastBuffer=41ms	PTS=7098687297	NTP-NOW=-80.46ms
Frame 42: TimeSinceLastBuffer=40ms	PTS=7139495412	NTP-NOW=-80.42ms
Frame 43: TimeSinceLastBuffer=41ms	PTS=7179228201	NTP-NOW=-78.58ms
Frame 44: TimeSinceLastBuffer=40ms	PTS=7220023438	NTP-NOW=-80.45ms
Frame 45: TimeSinceLastBuffer=41ms	PTS=7259760485	NTP-NOW=-80.38ms
Frame 46: TimeSinceLastBuffer=40ms	PTS=7300799741	NTP-NOW=-80.46ms
Frame 47: TimeSinceLastBuffer=41ms	PTS=7340543049	NTP-NOW=-80.68ms
Frame 48: TimeSinceLastBuffer=40ms	PTS=7381054380	NTP-NOW=-80.74ms
Frame 49: TimeSinceLastBuffer=40ms	PTS=7420284287	NTP-NOW=-80.19ms
Frame 50: TimeSinceLastBuffer=39ms	PTS=7461557562	NTP-NOW=-79.65ms
Frame 51: TimeSinceLastBuffer=41ms	PTS=7501306981	NTP-NOW=-80.46ms
Frame 52: TimeSinceLastBuffer=40ms	PTS=7542052725	NTP-NOW=-80.88ms
Frame 53: TimeSinceLastBuffer=41ms	PTS=7581806138	NTP-NOW=-80.43ms
Frame 54: TimeSinceLastBuffer=40ms	PTS=7622539998	NTP-NOW=-80.43ms
Frame 55: TimeSinceLastBuffer=41ms	PTS=7662297340	NTP-NOW=-80.38ms
Frame 56: TimeSinceLastBuffer=40ms	PTS=7703019506	NTP-NOW=-39.83ms
Frame 57: TimeSinceLastBuffer=41ms	PTS=7742780715	NTP-NOW=-79.27ms
Frame 58: TimeSinceLastBuffer=40ms	PTS=7783724477	NTP-NOW=-79.53ms
Frame 59: TimeSinceLastBuffer=41ms	PTS=7823491371	NTP-NOW=-80.63ms
Frame 60: TimeSinceLastBuffer=40ms	PTS=7863955718	NTP-NOW=-80.61ms
Frame 61: TimeSinceLastBuffer=40ms	PTS=7903256386	NTP-NOW=-80.18ms
Frame 62: TimeSinceLastBuffer=39ms	PTS=7944412665	NTP-NOW=-79.34ms
Frame 63: TimeSinceLastBuffer=41ms	PTS=7984185109	NTP-NOW=-80.65ms
Frame 64: TimeSinceLastBuffer=40ms	PTS=8024862329	NTP-NOW=-81.11ms
Frame 65: TimeSinceLastBuffer=40ms	PTS=8064638400	NTP-NOW=-80.23ms
Frame 66: TimeSinceLastBuffer=40ms	PTS=8105304828	NTP-NOW=-80.12ms
Frame 67: TimeSinceLastBuffer=41ms	PTS=8145084467	NTP-NOW=-80.29ms
Frame 68: TimeSinceLastBuffer=40ms	PTS=8185740275	NTP-NOW=-80.53ms
Frame 69: TimeSinceLastBuffer=40ms	PTS=8225523426	NTP-NOW=-80.36ms
Frame 70: TimeSinceLastBuffer=40ms	PTS=8266380468	NTP-NOW=-80.21ms
Frame 71: TimeSinceLastBuffer=41ms	PTS=8306168782	NTP-NOW=-80.59ms
Frame 72: TimeSinceLastBuffer=40ms	PTS=8346590461	NTP-NOW=-80.52ms
Frame 73: TimeSinceLastBuffer=40ms	PTS=8385955389	NTP-NOW=-80.16ms
Frame 74: TimeSinceLastBuffer=39ms	PTS=8427005420	NTP-NOW=-79.71ms
Frame 75: TimeSinceLastBuffer=41ms	PTS=8466798774	NTP-NOW=-80.37ms
Frame 76: TimeSinceLastBuffer=40ms	PTS=8507413766	NTP-NOW=-80.80ms
Frame 77: TimeSinceLastBuffer=41ms	PTS=8547210413	NTP-NOW=-80.20ms
Frame 78: TimeSinceLastBuffer=40ms	PTS=8587460090	NTP-NOW=-80.38ms
Frame 79: TimeSinceLastBuffer=40ms	PTS=8627437021	NTP-NOW=-79.94ms
Frame 80: TimeSinceLastBuffer=40ms	PTS=8667505677	NTP-NOW=-80.11ms
Frame 81: TimeSinceLastBuffer=40ms	PTS=8707482975	NTP-NOW=-79.97ms
Frame 82: TimeSinceLastBuffer=40ms	PTS=8747572698	NTP-NOW=-79.87ms
Frame 83: TimeSinceLastBuffer=40ms	PTS=8787550537	NTP-NOW=-80.13ms
Frame 84: TimeSinceLastBuffer=40ms	PTS=8827594682	NTP-NOW=-79.99ms
Frame 85: TimeSinceLastBuffer=40ms	PTS=8867528197	NTP-NOW=-79.84ms
Frame 86: TimeSinceLastBuffer=40ms	PTS=8907638124	NTP-NOW=-79.96ms
Frame 87: TimeSinceLastBuffer=40ms	PTS=8947616490	NTP-NOW=-79.90ms
Frame 88: TimeSinceLastBuffer=40ms	PTS=8987680874	NTP-NOW=-80.21ms
Frame 89: TimeSinceLastBuffer=40ms	PTS=9027659585	NTP-NOW=-79.92ms
Frame 90: TimeSinceLastBuffer=40ms	PTS=9067722943	NTP-NOW=-79.82ms
Frame 91: TimeSinceLastBuffer=40ms	PTS=9107701993	NTP-NOW=-80.00ms
Frame 92: TimeSinceLastBuffer=40ms	PTS=9147764341	NTP-NOW=-79.90ms
Frame 93: TimeSinceLastBuffer=40ms	PTS=9187743725	NTP-NOW=-80.19ms
Frame 94: TimeSinceLastBuffer=40ms	PTS=9227825204	NTP-NOW=-79.94ms
Frame 95: TimeSinceLastBuffer=40ms	PTS=9267805079	NTP-NOW=-79.81ms
Frame 96: TimeSinceLastBuffer=40ms	PTS=9307845168	NTP-NOW=-80.01ms
Frame 97: TimeSinceLastBuffer=40ms	PTS=9347784792	NTP-NOW=-79.92ms
Frame 98: TimeSinceLastBuffer=40ms	PTS=9387884618	NTP-NOW=-79.92ms
Frame 99: TimeSinceLastBuffer=40ms	PTS=9427864972	NTP-NOW=-79.94ms
Frame 100: TimeSinceLastBuffer=40ms	PTS=9467923440	NTP-NOW=-79.94ms
Frame 101: TimeSinceLastBuffer=40ms	PTS=9507904107	NTP-NOW=-79.99ms
Frame 102: TimeSinceLastBuffer=40ms	PTS=9547942618	NTP-NOW=-79.92ms
Frame 103: TimeSinceLastBuffer=40ms	PTS=9587961643	NTP-NOW=-79.94ms
Frame 104: TimeSinceLastBuffer=40ms	PTS=9627999236	NTP-NOW=-79.97ms
Frame 105: TimeSinceLastBuffer=40ms	PTS=9667980515	NTP-NOW=-79.91ms
Frame 106: TimeSinceLastBuffer=40ms	PTS=9708054507	NTP-NOW=-79.97ms
Frame 107: TimeSinceLastBuffer=40ms	PTS=9748036231	NTP-NOW=-79.94ms
Frame 108: TimeSinceLastBuffer=40ms	PTS=9788072636	NTP-NOW=-80.00ms
Frame 109: TimeSinceLastBuffer=40ms	PTS=9828017808	NTP-NOW=-79.95ms
Frame 110: TimeSinceLastBuffer=40ms	PTS=9868108461	NTP-NOW=-79.86ms
Frame 111: TimeSinceLastBuffer=40ms	PTS=9908090620	NTP-NOW=-80.01ms
Frame 112: TimeSinceLastBuffer=40ms	PTS=9948143715	NTP-NOW=-79.96ms

uridecodebin (rtsp) → new nvstreammux sync-inputs=1 → fakesink sync=true (sink buffer probe)

With sync=true it works as well.

Timings

Frame 0: TimeSinceLastBuffer=7176ms	PTS=6571973299	NTP-NOW=-0.30ms
Frame 1: TimeSinceLastBuffer=1614ms	PTS=6612253616	NTP-NOW=-1613.45ms
Frame 2: TimeSinceLastBuffer=40ms	PTS=6652807540	NTP-NOW=-1650.39ms
Frame 3: TimeSinceLastBuffer=41ms	PTS=6692531690	NTP-NOW=-1690.85ms
Frame 4: TimeSinceLastBuffer=40ms	PTS=6733352637	NTP-NOW=-80.14ms
Frame 5: TimeSinceLastBuffer=41ms	PTS=6773081183	NTP-NOW=-80.45ms
Frame 6: TimeSinceLastBuffer=40ms	PTS=6813889047	NTP-NOW=-80.40ms
Frame 7: TimeSinceLastBuffer=41ms	PTS=6853621919	NTP-NOW=-80.38ms
Frame 8: TimeSinceLastBuffer=40ms	PTS=6894416909	NTP-NOW=-80.39ms
Frame 9: TimeSinceLastBuffer=41ms	PTS=6934154038	NTP-NOW=-80.48ms
Frame 10: TimeSinceLastBuffer=40ms	PTS=6975192971	NTP-NOW=-80.45ms
Frame 11: TimeSinceLastBuffer=41ms	PTS=7014936359	NTP-NOW=-80.64ms
Frame 12: TimeSinceLastBuffer=40ms	PTS=7055447531	NTP-NOW=-80.67ms
Frame 13: TimeSinceLastBuffer=40ms	PTS=7094677677	NTP-NOW=-80.14ms
Frame 14: TimeSinceLastBuffer=39ms	PTS=7135950557	NTP-NOW=-79.63ms
Frame 15: TimeSinceLastBuffer=41ms	PTS=7175700054	NTP-NOW=-78.79ms
Frame 16: TimeSinceLastBuffer=40ms	PTS=7216445567	NTP-NOW=-0.15ms
Frame 17: TimeSinceLastBuffer=41ms	PTS=7256199056	NTP-NOW=-40.74ms
Frame 18: TimeSinceLastBuffer=40ms	PTS=7296932688	NTP-NOW=-80.10ms
Frame 19: TimeSinceLastBuffer=41ms	PTS=7336690106	NTP-NOW=-80.42ms
Frame 20: TimeSinceLastBuffer=40ms	PTS=7377412047	NTP-NOW=-78.68ms
Frame 21: TimeSinceLastBuffer=41ms	PTS=7417173330	NTP-NOW=-80.50ms
Frame 22: TimeSinceLastBuffer=40ms	PTS=7456586757	NTP-NOW=-80.38ms
Frame 23: TimeSinceLastBuffer=39ms	PTS=7496859647	NTP-NOW=-79.02ms
Frame 24: TimeSinceLastBuffer=40ms	PTS=7536316050	NTP-NOW=-79.63ms
Frame 25: TimeSinceLastBuffer=39ms	PTS=7577134738	NTP-NOW=-78.32ms
Frame 26: TimeSinceLastBuffer=41ms	PTS=7615781116	NTP-NOW=-80.20ms
Frame 27: TimeSinceLastBuffer=39ms	PTS=7656047509	NTP-NOW=-79.34ms
Frame 28: TimeSinceLastBuffer=40ms	PTS=7695254706	NTP-NOW=-78.68ms
Frame 29: TimeSinceLastBuffer=39ms	PTS=7735516854	NTP-NOW=-79.31ms
Frame 30: TimeSinceLastBuffer=40ms	PTS=7774736686	NTP-NOW=-79.35ms
Frame 31: TimeSinceLastBuffer=39ms	PTS=7814994656	NTP-NOW=-79.38ms
Frame 32: TimeSinceLastBuffer=40ms	PTS=7854226921	NTP-NOW=-40.28ms
Frame 33: TimeSinceLastBuffer=39ms	PTS=7894480780	NTP-NOW=-79.40ms
Frame 34: TimeSinceLastBuffer=40ms	PTS=7933477464	NTP-NOW=-79.38ms
Frame 35: TimeSinceLastBuffer=39ms	PTS=7973725279	NTP-NOW=-79.11ms
Frame 36: TimeSinceLastBuffer=40ms	PTS=8013231632	NTP-NOW=-79.13ms
Frame 37: TimeSinceLastBuffer=40ms	PTS=8053975093	NTP-NOW=-79.67ms
Frame 38: TimeSinceLastBuffer=41ms	PTS=8092745851	NTP-NOW=-80.17ms
Frame 39: TimeSinceLastBuffer=39ms	PTS=8132987766	NTP-NOW=-79.39ms
Frame 40: TimeSinceLastBuffer=40ms	PTS=8172267811	NTP-NOW=-78.88ms
Frame 41: TimeSinceLastBuffer=39ms	PTS=8212505871	NTP-NOW=-79.35ms
Frame 42: TimeSinceLastBuffer=40ms	PTS=8251797390	NTP-NOW=-79.45ms
Frame 43: TimeSinceLastBuffer=39ms	PTS=8292031656	NTP-NOW=-79.47ms
Frame 44: TimeSinceLastBuffer=40ms	PTS=8331334465	NTP-NOW=-79.39ms
Frame 45: TimeSinceLastBuffer=39ms	PTS=8371564998	NTP-NOW=-79.43ms
Frame 46: TimeSinceLastBuffer=40ms	PTS=8410653873	NTP-NOW=-78.19ms
Frame 47: TimeSinceLastBuffer=39ms	PTS=8450878917	NTP-NOW=-79.24ms
Frame 48: TimeSinceLastBuffer=40ms	PTS=8490430629	NTP-NOW=-79.23ms
Frame 49: TimeSinceLastBuffer=40ms	PTS=8531105776	NTP-NOW=-79.69ms
Frame 50: TimeSinceLastBuffer=41ms	PTS=8569989485	NTP-NOW=-80.11ms
Frame 51: TimeSinceLastBuffer=39ms	PTS=8610209171	NTP-NOW=-79.46ms
Frame 52: TimeSinceLastBuffer=40ms	PTS=8649555371	NTP-NOW=-79.01ms
Frame 53: TimeSinceLastBuffer=39ms	PTS=8689771556	NTP-NOW=-79.50ms
Frame 54: TimeSinceLastBuffer=40ms	PTS=8729128175	NTP-NOW=-79.47ms
Frame 55: TimeSinceLastBuffer=39ms	PTS=8769340915	NTP-NOW=-79.46ms
Frame 56: TimeSinceLastBuffer=40ms	PTS=8808707787	NTP-NOW=-79.48ms
Frame 57: TimeSinceLastBuffer=39ms	PTS=8848917137	NTP-NOW=-79.23ms
Frame 58: TimeSinceLastBuffer=40ms	PTS=8888089732	NTP-NOW=-79.47ms
Frame 59: TimeSinceLastBuffer=39ms	PTS=8928294098	NTP-NOW=-79.30ms
Frame 60: TimeSinceLastBuffer=40ms	PTS=8967887001	NTP-NOW=-79.30ms
Frame 61: TimeSinceLastBuffer=40ms	PTS=9008500112	NTP-NOW=-79.71ms
Frame 62: TimeSinceLastBuffer=41ms	PTS=9047486392	NTP-NOW=-40.62ms
Frame 63: TimeSinceLastBuffer=39ms	PTS=9087685892	NTP-NOW=-79.53ms
Frame 64: TimeSinceLastBuffer=40ms	PTS=9127092167	NTP-NOW=-79.40ms
Frame 65: TimeSinceLastBuffer=39ms	PTS=9167288488	NTP-NOW=-79.46ms
Frame 66: TimeSinceLastBuffer=40ms	PTS=9206704225	NTP-NOW=-79.18ms
Frame 67: TimeSinceLastBuffer=39ms	PTS=9246897417	NTP-NOW=-77.44ms
Frame 68: TimeSinceLastBuffer=40ms	PTS=9286322465	NTP-NOW=-40.22ms
Frame 69: TimeSinceLastBuffer=39ms	PTS=9326512578	NTP-NOW=-79.51ms
Frame 70: TimeSinceLastBuffer=40ms	PTS=9366060439	NTP-NOW=-79.48ms
Frame 71: TimeSinceLastBuffer=40ms	PTS=9405946788	NTP-NOW=-79.63ms
Frame 72: TimeSinceLastBuffer=40ms	PTS=9446173181	NTP-NOW=-79.35ms
Frame 73: TimeSinceLastBuffer=40ms	PTS=9486133872	NTP-NOW=-80.01ms
Frame 74: TimeSinceLastBuffer=40ms	PTS=9526395966	NTP-NOW=-80.07ms
Frame 75: TimeSinceLastBuffer=40ms	PTS=9566285021	NTP-NOW=-80.12ms
Frame 76: TimeSinceLastBuffer=40ms	PTS=9606615201	NTP-NOW=-80.03ms
Frame 77: TimeSinceLastBuffer=40ms	PTS=9646506024	NTP-NOW=-80.09ms
Frame 78: TimeSinceLastBuffer=40ms	PTS=9686830943	NTP-NOW=-80.14ms
Frame 79: TimeSinceLastBuffer=40ms	PTS=9726723505	NTP-NOW=-80.13ms
Frame 80: TimeSinceLastBuffer=40ms	PTS=9767043246	NTP-NOW=-80.14ms
Frame 81: TimeSinceLastBuffer=40ms	PTS=9806937521	NTP-NOW=-80.11ms
Frame 82: TimeSinceLastBuffer=40ms	PTS=9847710336	NTP-NOW=-80.13ms
Frame 83: TimeSinceLastBuffer=41ms	PTS=9887252167	NTP-NOW=-80.54ms
Frame 84: TimeSinceLastBuffer=40ms	PTS=9928164840	NTP-NOW=-80.22ms
Frame 85: TimeSinceLastBuffer=41ms	PTS=9967148126	NTP-NOW=-80.37ms
Frame 86: TimeSinceLastBuffer=39ms	PTS=10009062969	NTP-NOW=-79.80ms
Frame 87: TimeSinceLastBuffer=42ms	PTS=10048615708	NTP-NOW=-80.81ms
Frame 88: TimeSinceLastBuffer=40ms	PTS=10089946785	NTP-NOW=-81.38ms
Frame 89: TimeSinceLastBuffer=41ms	PTS=10129506652	NTP-NOW=-80.73ms
Frame 90: TimeSinceLastBuffer=40ms	PTS=10170816516	NTP-NOW=-80.82ms
Frame 91: TimeSinceLastBuffer=41ms	PTS=10210383397	NTP-NOW=-80.80ms
Frame 92: TimeSinceLastBuffer=40ms	PTS=10251672387	NTP-NOW=-80.76ms
Frame 93: TimeSinceLastBuffer=41ms	PTS=10291246170	NTP-NOW=-80.82ms
Frame 94: TimeSinceLastBuffer=40ms	PTS=10333021007	NTP-NOW=-80.84ms
Frame 95: TimeSinceLastBuffer=42ms	PTS=10372514619	NTP-NOW=-81.30ms
Frame 96: TimeSinceLastBuffer=39ms	PTS=10413523343	NTP-NOW=-81.13ms
Frame 97: TimeSinceLastBuffer=41ms	PTS=10452095194	NTP-NOW=-80.32ms
Frame 98: TimeSinceLastBuffer=39ms	PTS=10494515992	NTP-NOW=-79.54ms
Frame 99: TimeSinceLastBuffer=42ms	PTS=10534021661	NTP-NOW=-80.94ms
Frame 100: TimeSinceLastBuffer=39ms	PTS=10575492823	NTP-NOW=-81.87ms

uridecodebin (rtsp) → new nvstreammux sync-inputs=1 → fakesink (sink buffer probe)

Not setting any sync option on the fakesink gives similar results to sync-inputs=0, even though it is set to sync-inputs=1! The buffers are delayed again.

Timings

Frame 0: TimeSinceLastBuffer=6483ms	PTS=5749551306	NTP-NOW=-0.51ms
Frame 1: TimeSinceLastBuffer=1ms	PTS=5790172889	NTP-NOW=-0.07ms
Frame 2: TimeSinceLastBuffer=0ms	PTS=5829863346	NTP-NOW=-0.05ms
Frame 3: TimeSinceLastBuffer=3ms	PTS=5870784566	NTP-NOW=-0.05ms
Frame 4: TimeSinceLastBuffer=0ms	PTS=5910479956	NTP-NOW=-0.04ms
Frame 5: TimeSinceLastBuffer=3ms	PTS=5951386495	NTP-NOW=-0.04ms
Frame 6: TimeSinceLastBuffer=0ms	PTS=5991086739	NTP-NOW=-0.04ms
Frame 7: TimeSinceLastBuffer=3ms	PTS=6031978832	NTP-NOW=-0.06ms
Frame 8: TimeSinceLastBuffer=0ms	PTS=6071683853	NTP-NOW=-0.06ms
Frame 9: TimeSinceLastBuffer=3ms	PTS=6112561729	NTP-NOW=-0.05ms
Frame 10: TimeSinceLastBuffer=0ms	PTS=6152271451	NTP-NOW=-0.05ms
Frame 11: TimeSinceLastBuffer=509ms	PTS=6193135338	NTP-NOW=-0.12ms
Frame 12: TimeSinceLastBuffer=3ms	PTS=6232849685	NTP-NOW=-0.12ms
Frame 13: TimeSinceLastBuffer=1ms	PTS=6273699805	NTP-NOW=-0.07ms
Frame 14: TimeSinceLastBuffer=0ms	PTS=6313418705	NTP-NOW=-0.07ms
Frame 15: TimeSinceLastBuffer=0ms	PTS=6354255278	NTP-NOW=-0.05ms
Frame 16: TimeSinceLastBuffer=0ms	PTS=6393978657	NTP-NOW=-0.06ms
Frame 17: TimeSinceLastBuffer=3ms	PTS=6434801899	NTP-NOW=-0.07ms
Frame 18: TimeSinceLastBuffer=0ms	PTS=6474529686	NTP-NOW=-0.08ms
Frame 19: TimeSinceLastBuffer=3ms	PTS=6515339809	NTP-NOW=-0.07ms
Frame 20: TimeSinceLastBuffer=0ms	PTS=6555071934	NTP-NOW=-0.09ms
Frame 21: TimeSinceLastBuffer=3ms	PTS=6595869147	NTP-NOW=-0.06ms
Frame 22: TimeSinceLastBuffer=0ms	PTS=6635605541	NTP-NOW=-0.05ms
Frame 23: TimeSinceLastBuffer=3ms	PTS=6676507886	NTP-NOW=-0.04ms
Frame 24: TimeSinceLastBuffer=510ms	PTS=6716189799	NTP-NOW=-0.09ms
Frame 25: TimeSinceLastBuffer=0ms	PTS=6757136446	NTP-NOW=-0.14ms
Frame 26: TimeSinceLastBuffer=1ms	PTS=6796823428	NTP-NOW=-0.06ms
Frame 27: TimeSinceLastBuffer=2ms	PTS=6837754989	NTP-NOW=-0.05ms
Frame 28: TimeSinceLastBuffer=0ms	PTS=6877446960	NTP-NOW=-0.05ms
Frame 29: TimeSinceLastBuffer=3ms	PTS=6918363675	NTP-NOW=-0.04ms
Frame 30: TimeSinceLastBuffer=0ms	PTS=6958060554	NTP-NOW=-0.04ms
Frame 31: TimeSinceLastBuffer=3ms	PTS=6998962661	NTP-NOW=-0.04ms
Frame 32: TimeSinceLastBuffer=0ms	PTS=7038664371	NTP-NOW=-0.05ms
Frame 33: TimeSinceLastBuffer=3ms	PTS=7079258565	NTP-NOW=-0.04ms
Frame 34: TimeSinceLastBuffer=1ms	PTS=7119552102	NTP-NOW=-0.03ms
Frame 35: TimeSinceLastBuffer=2ms	PTS=7160184354	NTP-NOW=-0.04ms
Frame 36: TimeSinceLastBuffer=0ms	PTS=7199843290	NTP-NOW=-0.04ms
Frame 37: TimeSinceLastBuffer=510ms	PTS=7240858319	NTP-NOW=-0.13ms
Frame 38: TimeSinceLastBuffer=1ms	PTS=7280522690	NTP-NOW=-0.08ms
Frame 39: TimeSinceLastBuffer=1ms	PTS=7321521543	NTP-NOW=-0.08ms
Frame 40: TimeSinceLastBuffer=0ms	PTS=7361191263	NTP-NOW=-0.04ms
Frame 41: TimeSinceLastBuffer=3ms	PTS=7402174198	NTP-NOW=-0.04ms
Frame 42: TimeSinceLastBuffer=0ms	PTS=7441849181	NTP-NOW=-0.03ms
Frame 43: TimeSinceLastBuffer=3ms	PTS=7482816452	NTP-NOW=-0.04ms
Frame 44: TimeSinceLastBuffer=0ms	PTS=7522496615	NTP-NOW=-0.05ms
Frame 45: TimeSinceLastBuffer=3ms	PTS=7563448472	NTP-NOW=-0.04ms
Frame 46: TimeSinceLastBuffer=0ms	PTS=7603133731	NTP-NOW=-0.03ms
Frame 47: TimeSinceLastBuffer=4ms	PTS=7644070420	NTP-NOW=-0.04ms
Frame 48: TimeSinceLastBuffer=0ms	PTS=7683760695	NTP-NOW=-0.04ms
Frame 49: TimeSinceLastBuffer=3ms	PTS=7724682456	NTP-NOW=-0.04ms
Frame 50: TimeSinceLastBuffer=200ms	PTS=7764377667	NTP-NOW=-200.05ms
Frame 51: TimeSinceLastBuffer=311ms	PTS=7805284739	NTP-NOW=-0.12ms
Frame 52: TimeSinceLastBuffer=0ms	PTS=7844984807	NTP-NOW=-0.05ms
Frame 53: TimeSinceLastBuffer=1ms	PTS=7885447487	NTP-NOW=-0.05ms
Frame 54: TimeSinceLastBuffer=0ms	PTS=7925366440	NTP-NOW=-0.03ms
Frame 55: TimeSinceLastBuffer=3ms	PTS=7965607641	NTP-NOW=-0.03ms
Frame 56: TimeSinceLastBuffer=0ms	PTS=8005527886	NTP-NOW=-0.03ms
Frame 57: TimeSinceLastBuffer=3ms	PTS=8045765242	NTP-NOW=-0.03ms
Frame 58: TimeSinceLastBuffer=0ms	PTS=8085686758	NTP-NOW=-0.03ms
Frame 59: TimeSinceLastBuffer=3ms	PTS=8125920333	NTP-NOW=-0.03ms
Frame 60: TimeSinceLastBuffer=0ms	PTS=8165843099	NTP-NOW=-0.03ms
Frame 61: TimeSinceLastBuffer=3ms	PTS=8206072952	NTP-NOW=-0.03ms
Frame 62: TimeSinceLastBuffer=0ms	PTS=8245996949	NTP-NOW=-0.03ms
Frame 63: TimeSinceLastBuffer=200ms	PTS=8286223139	NTP-NOW=-197.63ms
Frame 64: TimeSinceLastBuffer=314ms	PTS=8326148347	NTP-NOW=-0.18ms
Frame 65: TimeSinceLastBuffer=0ms	PTS=8366370932	NTP-NOW=-0.24ms
Frame 66: TimeSinceLastBuffer=2ms	PTS=8406297332	NTP-NOW=-0.04ms
Frame 67: TimeSinceLastBuffer=1ms	PTS=8446516370	NTP-NOW=-0.05ms
Frame 68: TimeSinceLastBuffer=0ms	PTS=8486443943	NTP-NOW=-0.06ms
Frame 69: TimeSinceLastBuffer=2ms	PTS=8526659491	NTP-NOW=-0.04ms
Frame 70: TimeSinceLastBuffer=0ms	PTS=8566588218	NTP-NOW=-0.04ms
Frame 71: TimeSinceLastBuffer=3ms	PTS=8606800331	NTP-NOW=-0.03ms
Frame 72: TimeSinceLastBuffer=0ms	PTS=8646730194	NTP-NOW=-0.02ms
Frame 73: TimeSinceLastBuffer=3ms	PTS=8686938926	NTP-NOW=-0.03ms
Frame 74: TimeSinceLastBuffer=0ms	PTS=8726869907	NTP-NOW=-0.03ms
Frame 75: TimeSinceLastBuffer=3ms	PTS=8767075312	NTP-NOW=-0.02ms
Frame 76: TimeSinceLastBuffer=200ms	PTS=8807007393	NTP-NOW=-200.11ms
Frame 77: TimeSinceLastBuffer=311ms	PTS=8847209525	NTP-NOW=-0.12ms
Frame 78: TimeSinceLastBuffer=0ms	PTS=8887142688	NTP-NOW=-0.03ms
Frame 79: TimeSinceLastBuffer=0ms	PTS=8927275827	NTP-NOW=-0.04ms
Frame 80: TimeSinceLastBuffer=1ms	PTS=8967341599	NTP-NOW=-0.03ms
Frame 81: TimeSinceLastBuffer=1ms	PTS=9007406845	NTP-NOW=-0.03ms
Frame 82: TimeSinceLastBuffer=1ms	PTS=9047471569	NTP-NOW=-0.03ms
Frame 83: TimeSinceLastBuffer=1ms	PTS=9087535775	NTP-NOW=-0.04ms
Frame 84: TimeSinceLastBuffer=1ms	PTS=9127599467	NTP-NOW=-0.03ms
Frame 85: TimeSinceLastBuffer=1ms	PTS=9167662650	NTP-NOW=-0.04ms
Frame 86: TimeSinceLastBuffer=2ms	PTS=9207725327	NTP-NOW=-0.03ms
Frame 87: TimeSinceLastBuffer=3ms	PTS=9247849182	NTP-NOW=-0.03ms
Frame 88: TimeSinceLastBuffer=0ms	PTS=9287787503	NTP-NOW=-0.03ms
Frame 89: TimeSinceLastBuffer=200ms	PTS=9327971063	NTP-NOW=-198.08ms
Frame 90: TimeSinceLastBuffer=302ms	PTS=9367910367	NTP-NOW=-0.12ms
Frame 91: TimeSinceLastBuffer=0ms	PTS=9408091001	NTP-NOW=-0.18ms
Frame 92: TimeSinceLastBuffer=0ms	PTS=9448031273	NTP-NOW=-0.03ms
Frame 93: TimeSinceLastBuffer=2ms	PTS=9488209029	NTP-NOW=-0.05ms
Frame 94: TimeSinceLastBuffer=0ms	PTS=9528150252	NTP-NOW=-0.05ms
Frame 95: TimeSinceLastBuffer=3ms	PTS=9568325175	NTP-NOW=-0.05ms
Frame 96: TimeSinceLastBuffer=0ms	PTS=9608267335	NTP-NOW=-0.04ms
Frame 97: TimeSinceLastBuffer=3ms	PTS=9648439470	NTP-NOW=-0.15ms
Frame 98: TimeSinceLastBuffer=0ms	PTS=9688382552	NTP-NOW=-0.20ms
Frame 99: TimeSinceLastBuffer=3ms	PTS=9728551944	NTP-NOW=-0.04ms
Frame 100: TimeSinceLastBuffer=0ms	PTS=9768495933	NTP-NOW=-0.04ms

Could someone explain this in more detail?
For now sync-inputs=1 on nvstreammux and sync=true on fakesink solves my issue, but I can’t understand why from the documentation.

fanzh · April 25, 2023, 2:34pm

please find sync-inputs in this link Gst-nvstreammux New — DeepStream 6.2 Release documentation

philipp.schmidt · April 25, 2023, 3:46pm

The documentation for sync-inputs does not sufficiently explain this - it is unclear why for batch-size=1 and sync-inputs=0 the buffer is delayed by almost 500ms. For batch size 1, each frame from uridecodebin should trigger a buffer push downstream, because the batch is full.

The observed behaviour though is that the buffers are held back for a significant amount of time - see my measurements.

Also it is unclear why sync-input=1 only has an effect if the pipeline sink has either sync=true or sync=false set.

fanzh · April 27, 2023, 8:48am

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

sync=true on fakesink, please find it in this link:GstBaseSink
sync-inputs is used to synchronize Inputs, it works with max-latency, When sync-inputs=1, buffers coming in after max-latency shall be dropped.

system · May 30, 2023, 4:15am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Huge delay performance between python script and deepstream-app DeepStream SDK	12	520	February 22, 2024
NTP timestamp (RTSP Sender Report) is not set to NvDsAudioFrameMeta::ntp_timestamp in my pipeline DeepStream SDK rtsp , audio , deepstream	18	1121	May 8, 2023
Nvstreammux DeepStream SDK deepstream61	11	1535	November 25, 2022
Multisession inference, segmentation DeepStream SDK jira	50	1325	July 3, 2024
Unexpected behavior of nvstreammux with multiple rtsp sources DeepStream SDK	9	808	February 22, 2023
How can I set nvstreammux's options for multiple rtsp sources sinking? DeepStream SDK	6	663	January 17, 2022
Bug Report: nvmultiurisrcbin/nvurisrcbin/nvstreammux with HLS Streaming Issues DeepStream SDK deepstream	20	144	February 4, 2025
New NvStreammux shows 「[ERROR push 317] push failed [-5]」 DeepStream SDK	9	596	June 4, 2024
Can nvv4l2decoder and nvstreammux use independent GPU memory? DeepStream SDK	17	721	June 25, 2023
NTP-Timestamps of Dahua-Type Cameras Are Not Read Correctly DeepStream SDK deepstream	6	29	May 12, 2025

New nvstreammux sync-inputs and max-latency

Related topics