New nvstreammux sync-inputs and max-latency

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Can someone explain the new nvstreammux parameters “sync-inputs” and “max-latency” in more detail?

We use a single RTSP source and ‘new’ nvstreammux with batch-size=1 and sync-inputs=1. We require nvstreammux to “instantly” push the buffer downstream and add no additional latency. Basically we only use nvstreammux to attach the metadata structures, nothing else.

uridecodebin → new nvstreammux batch-size=1 sync-inputs=1 → nvinferserver batch-size=1 → fakesink (with buffer probe)

It only works with sync-inputs=1, but it is unclear why that is the case from just reading the documentation.
Why is the buffer pushed downstream right away with “sync-inputs=1”, but delayed for “sync-inputs=0”? If batch-size=1 is set, every incoming buffer should instantly push a batch (of size 1) downstream? Why is it necessary to set sync-inputs to 1 to enable this behaviour?

1 Like
2

Just to clarify: if sync-inputs is set to 0, the buffers at the fakesink arrive in “chunks”, so multiple buffers arrive at once, then there is a “lag” with no buffers arriving. We would like the frames to arrive as close to their presentation timestamp as possible.

4

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU)

• DeepStream Version

• JetPack Version (valid for Jetson only)

• TensorRT Version

• NVIDIA GPU Driver Version (valid for GPU only)

• Issue Type( questions, new requirements, bugs)

• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

5

• Hardware Platform (Jetson / GPU): dGPU x86
• DeepStream Version: 6.2-triton docker
• NVIDIA GPU Driver Version: 525.105.17
• Issue Type: questions
• How to reproduce the issue?
uridecodebin (rtsp source) → new nvstreammux batch-size=1 (sync-inputs=0 or 1) → nvinferserver batch-size=1 → fakesink sync=true (with buffer probe on sink)
Attach to buffer probe and observe arrival times of buffers and compare against pts of buffers.
Without sync-inputs=1, multiple buffers will arrive at once, desynced from their pts. With sync-inputs the buffers will arrive in a more timely maner, although not synced to pts (even with sync=true on fakesink).
• Expected outcome:
How can we configure the pipeline so every single frame / buffer arrives at the fakesink buffer probe synced to is pts?

6

Working on an example to illustrate the issue.

7

TimeSinceLastBuffer: Elapsed time since receiving the last buffer/frame on the buffer probe on fakesink
PTS: Presentation time stamp (buf_pts) from NvDsFrameMeta or GstBuffer.pts in case before nvstreammux
NTP-NOW: NTP timestamp (ntp_timestamp) from NvDsFrameMeta minus current time (system time, so time difference from nvstreammux to fakesink?)
DURATION: GstBuffer.duration

uridecodebin (rtsp) → fakesink sync=true (sink buffer probe)

This is the signal from rtsp directly after uridecodebin

Timings 
Frame 0: TimeSinceLastBuffer=7840 ms     PTS=7112105750    DURATION=40000000
Frame 1: TimeSinceLastBuffer=1460 ms     PTS=7152646829    DURATION=40000000
Frame 2: TimeSinceLastBuffer=39 ms     PTS=7193716037    DURATION=40000000
Frame 3: TimeSinceLastBuffer=41 ms     PTS=7234244234    DURATION=40000000
Frame 4: TimeSinceLastBuffer=41 ms     PTS=7273183580    DURATION=40000000
Frame 5: TimeSinceLastBuffer=39 ms     PTS=7315287985    DURATION=40000000
Frame 6: TimeSinceLastBuffer=42 ms     PTS=7354768205    DURATION=40000000
Frame 7: TimeSinceLastBuffer=39 ms     PTS=7396315102    DURATION=40000000
Frame 8: TimeSinceLastBuffer=42 ms     PTS=7435803606    DURATION=40000000
Frame 9: TimeSinceLastBuffer=39 ms     PTS=7477325851    DURATION=40000000
Frame 10: TimeSinceLastBuffer=42 ms     PTS=7516822506    DURATION=40000000
Frame 11: TimeSinceLastBuffer=39 ms     PTS=7558320493    DURATION=40000000
Frame 12: TimeSinceLastBuffer=41 ms     PTS=7598811854    DURATION=40000000
Frame 13: TimeSinceLastBuffer=41 ms     PTS=7637825169    DURATION=40000000
Frame 14: TimeSinceLastBuffer=39 ms     PTS=7679782815    DURATION=40000000
Frame 15: TimeSinceLastBuffer=42 ms     PTS=7720262478    DURATION=40000000
Frame 16: TimeSinceLastBuffer=40 ms     PTS=7759299284    DURATION=40000000
Frame 17: TimeSinceLastBuffer=39 ms     PTS=7801210322    DURATION=40000000
Frame 18: TimeSinceLastBuffer=42 ms     PTS=7841678565    DURATION=40000000
Frame 19: TimeSinceLastBuffer=40 ms     PTS=7880738303    DURATION=40000000
Frame 20: TimeSinceLastBuffer=39 ms     PTS=7922603843    DURATION=40000000
Frame 21: TimeSinceLastBuffer=42 ms     PTS=7962143062    DURATION=40000000
Frame 22: TimeSinceLastBuffer=40 ms     PTS=8003514375    DURATION=40000000
Frame 23: TimeSinceLastBuffer=41 ms     PTS=8044018295    DURATION=40000000
Frame 24: TimeSinceLastBuffer=40 ms     PTS=8083060937    DURATION=40000000
Frame 25: TimeSinceLastBuffer=39 ms     PTS=8124604188    DURATION=40000000
Frame 26: TimeSinceLastBuffer=42 ms     PTS=8164893623    DURATION=40000000
Frame 27: TimeSinceLastBuffer=40 ms     PTS=8204312418    DURATION=40000000
Frame 28: TimeSinceLastBuffer=39 ms     PTS=8245465566    DURATION=40000000
Frame 29: TimeSinceLastBuffer=41 ms     PTS=8285748110    DURATION=40000000
Frame 30: TimeSinceLastBuffer=40 ms     PTS=8325180743    DURATION=40000000
Frame 31: TimeSinceLastBuffer=39 ms     PTS=8366306436    DURATION=40000000
Frame 32: TimeSinceLastBuffer=41 ms     PTS=8406028394    DURATION=40000000
Frame 33: TimeSinceLastBuffer=40 ms     PTS=8446855864    DURATION=40000000
Frame 34: TimeSinceLastBuffer=41 ms     PTS=8487127286    DURATION=40000000
Frame 35: TimeSinceLastBuffer=40 ms     PTS=8526582253    DURATION=40000000
Frame 36: TimeSinceLastBuffer=39 ms     PTS=8567396537    DURATION=40000000
Frame 37: TimeSinceLastBuffer=41 ms     PTS=8607928594    DURATION=40000000
Frame 38: TimeSinceLastBuffer=41 ms     PTS=8647663634    DURATION=40000000
Frame 39: TimeSinceLastBuffer=40 ms     PTS=8687868045    DURATION=40000000
Frame 40: TimeSinceLastBuffer=40 ms     PTS=8727838133    DURATION=40000000
Frame 41: TimeSinceLastBuffer=40 ms     PTS=8767898198    DURATION=40000000
Frame 42: TimeSinceLastBuffer=40 ms     PTS=8807749826    DURATION=40000000
Frame 43: TimeSinceLastBuffer=40 ms     PTS=8847779026    DURATION=40000000
Frame 44: TimeSinceLastBuffer=40 ms     PTS=8887720860    DURATION=40000000
Frame 45: TimeSinceLastBuffer=40 ms     PTS=8927808461    DURATION=40000000
Frame 46: TimeSinceLastBuffer=40 ms     PTS=8967663622    DURATION=40000000
Frame 47: TimeSinceLastBuffer=40 ms     PTS=9007692126    DURATION=40000000
Frame 48: TimeSinceLastBuffer=40 ms     PTS=9047635346    DURATION=40000000
Frame 49: TimeSinceLastBuffer=40 ms     PTS=9087607296    DURATION=40000000
Frame 50: TimeSinceLastBuffer=40 ms     PTS=9127551867    DURATION=40000000
Frame 51: TimeSinceLastBuffer=40 ms     PTS=9167579470    DURATION=40000000
Frame 52: TimeSinceLastBuffer=40 ms     PTS=9207497322    DURATION=40000000
Frame 53: TimeSinceLastBuffer=40 ms     PTS=9247524485    DURATION=40000000
Frame 54: TimeSinceLastBuffer=40 ms     PTS=9287470376    DURATION=40000000
Frame 55: TimeSinceLastBuffer=40 ms     PTS=9327417130    DURATION=40000000
Frame 56: TimeSinceLastBuffer=40 ms     PTS=9367443646    DURATION=40000000
Frame 57: TimeSinceLastBuffer=40 ms     PTS=9407364732    DURATION=40000000
Frame 58: TimeSinceLastBuffer=40 ms     PTS=9447390826    DURATION=40000000
Frame 59: TimeSinceLastBuffer=40 ms     PTS=9487313169    DURATION=40000000
Frame 60: TimeSinceLastBuffer=40 ms     PTS=9527287696    DURATION=40000000
Frame 61: TimeSinceLastBuffer=40 ms     PTS=9567338847    DURATION=40000000
Frame 62: TimeSinceLastBuffer=40 ms     PTS=9607237360    DURATION=40000000
Frame 63: TimeSinceLastBuffer=40 ms     PTS=9647262427    DURATION=40000000
Frame 64: TimeSinceLastBuffer=40 ms     PTS=9687187827    DURATION=40000000
Frame 65: TimeSinceLastBuffer=40 ms     PTS=9727212494    DURATION=40000000
Frame 66: TimeSinceLastBuffer=40 ms     PTS=9767115003    DURATION=40000000
Frame 67: TimeSinceLastBuffer=40 ms     PTS=9807139083    DURATION=40000000
Frame 68: TimeSinceLastBuffer=40 ms     PTS=9847091116    DURATION=40000000
Frame 69: TimeSinceLastBuffer=40 ms     PTS=9887163357    DURATION=40000000
Frame 70: TimeSinceLastBuffer=40 ms     PTS=9927043913    DURATION=40000000
Frame 71: TimeSinceLastBuffer=40 ms     PTS=9967067420    DURATION=40000000
Frame 72: TimeSinceLastBuffer=40 ms     PTS=10006997462    DURATION=40000000
Frame 73: TimeSinceLastBuffer=40 ms     PTS=10047020594    DURATION=40000000
Frame 74: TimeSinceLastBuffer=40 ms     PTS=10086951752    DURATION=40000000
Frame 75: TimeSinceLastBuffer=40 ms     PTS=10126974515    DURATION=40000000
Frame 76: TimeSinceLastBuffer=40 ms     PTS=10166906770    DURATION=40000000
Frame 77: TimeSinceLastBuffer=40 ms     PTS=10206929171    DURATION=40000000
Frame 78: TimeSinceLastBuffer=40 ms     PTS=10246228308    DURATION=40000000
Frame 79: TimeSinceLastBuffer=39 ms     PTS=10286452648    DURATION=40000000
Frame 80: TimeSinceLastBuffer=40 ms     PTS=10326005762    DURATION=40000000
Frame 81: TimeSinceLastBuffer=40 ms     PTS=10366678797    DURATION=40000000
Frame 82: TimeSinceLastBuffer=41 ms     PTS=10405784997    DURATION=40000000
Frame 83: TimeSinceLastBuffer=39 ms     PTS=10445565998    DURATION=40000000
Frame 84: TimeSinceLastBuffer=40 ms     PTS=10485133242    DURATION=40000000
Frame 85: TimeSinceLastBuffer=40 ms     PTS=10525348751    DURATION=40000000
Frame 86: TimeSinceLastBuffer=40 ms     PTS=10564707382    DURATION=40000000
Frame 87: TimeSinceLastBuffer=39 ms     PTS=10604919457    DURATION=40000000
Frame 88: TimeSinceLastBuffer=40 ms     PTS=10644288309    DURATION=40000000
Frame 89: TimeSinceLastBuffer=39 ms     PTS=10684497004    DURATION=40000000
Frame 90: TimeSinceLastBuffer=40 ms     PTS=10723672188    DURATION=40000000
Frame 91: TimeSinceLastBuffer=39 ms     PTS=10763875914    DURATION=40000000
Frame 92: TimeSinceLastBuffer=40 ms     PTS=10803470091    DURATION=40000000
Frame 93: TimeSinceLastBuffer=40 ms     PTS=10844081283    DURATION=40000000
Frame 94: TimeSinceLastBuffer=41 ms     PTS=10883070735    DURATION=40000000
Frame 95: TimeSinceLastBuffer=39 ms     PTS=10923269611    DURATION=40000000
Frame 96: TimeSinceLastBuffer=40 ms     PTS=10962677743    DURATION=40000000
Frame 97: TimeSinceLastBuffer=39 ms     PTS=11002873450    DURATION=40000000
Frame 98: TimeSinceLastBuffer=40 ms     PTS=11042291014    DURATION=40000000
Frame 99: TimeSinceLastBuffer=39 ms     PTS=11082483602    DURATION=40000000
Frame 100: TimeSinceLastBuffer=40 ms     PTS=11121910448    DURATION=40000000

uridecodebin (rtsp) → new nvstreammux sync-inputs=0 → fakesink sync=true (sink buffer probe)

This is with sync-inputs=0 disabled, notice multiple buffers arrive “at once”, even though their pts suggest they should arrive later. Also the NTP timestamp (system time at nvstreammux minus now) says the all arrive instantly.

Timings 
Frame 0: TimeSinceLastBuffer=6222ms 		 PTS=5472689611 		 NTP-NOW=-0.33ms
Frame 1: TimeSinceLastBuffer=1ms 		 PTS=5512670018 		 NTP-NOW=-0.04ms
Frame 2: TimeSinceLastBuffer=0ms 		 PTS=5552679775 		 NTP-NOW=-0.04ms
Frame 3: TimeSinceLastBuffer=3ms 		 PTS=5592650738 		 NTP-NOW=-0.03ms
Frame 4: TimeSinceLastBuffer=0ms 		 PTS=5632660339 		 NTP-NOW=-0.03ms
Frame 5: TimeSinceLastBuffer=3ms 		 PTS=5672631765 		 NTP-NOW=-0.04ms
Frame 6: TimeSinceLastBuffer=0ms 		 PTS=5712641213 		 NTP-NOW=-0.03ms
Frame 7: TimeSinceLastBuffer=3ms 		 PTS=5752613094 		 NTP-NOW=-0.03ms
Frame 8: TimeSinceLastBuffer=0ms 		 PTS=5792622392 		 NTP-NOW=-0.03ms
Frame 9: TimeSinceLastBuffer=3ms 		 PTS=5832894565 		 NTP-NOW=-0.04ms
Frame 10: TimeSinceLastBuffer=0ms 		 PTS=5872603871 		 NTP-NOW=-0.05ms
Frame 11: TimeSinceLastBuffer=502ms 		 PTS=5913468996 		 NTP-NOW=-0.15ms
Frame 12: TimeSinceLastBuffer=1ms 		 PTS=5953182934 		 NTP-NOW=-0.05ms
Frame 13: TimeSinceLastBuffer=0ms 		 PTS=5994034272 		 NTP-NOW=-0.06ms
Frame 14: TimeSinceLastBuffer=0ms 		 PTS=6033752769 		 NTP-NOW=-0.05ms
Frame 15: TimeSinceLastBuffer=3ms 		 PTS=6074590540 		 NTP-NOW=-0.05ms
Frame 16: TimeSinceLastBuffer=0ms 		 PTS=6114313523 		 NTP-NOW=-0.04ms
Frame 17: TimeSinceLastBuffer=1ms 		 PTS=6154865341 		 NTP-NOW=-0.03ms
Frame 18: TimeSinceLastBuffer=3ms 		 PTS=6195137943 		 NTP-NOW=-0.02ms
Frame 19: TimeSinceLastBuffer=3ms 		 PTS=6235676623 		 NTP-NOW=-0.02ms
Frame 20: TimeSinceLastBuffer=0ms 		 PTS=6275408365 		 NTP-NOW=-0.02ms
Frame 21: TimeSinceLastBuffer=3ms 		 PTS=6316365216 		 NTP-NOW=-0.02ms
Frame 22: TimeSinceLastBuffer=0ms 		 PTS=6355942735 		 NTP-NOW=-0.02ms
Frame 23: TimeSinceLastBuffer=3ms 		 PTS=6397200067 		 NTP-NOW=-0.02ms
Frame 24: TimeSinceLastBuffer=510ms 		 PTS=6436784318 		 NTP-NOW=-0.11ms
Frame 25: TimeSinceLastBuffer=0ms 		 PTS=6478021613 		 NTP-NOW=-0.17ms
Frame 26: TimeSinceLastBuffer=0ms 		 PTS=6517612490 		 NTP-NOW=-0.05ms
Frame 27: TimeSinceLastBuffer=2ms 		 PTS=6558830067 		 NTP-NOW=-0.05ms
Frame 28: TimeSinceLastBuffer=0ms 		 PTS=6598427463 		 NTP-NOW=-0.03ms
Frame 29: TimeSinceLastBuffer=3ms 		 PTS=6639625638 		 NTP-NOW=-0.05ms
Frame 30: TimeSinceLastBuffer=0ms 		 PTS=6679229450 		 NTP-NOW=-0.03ms
Frame 31: TimeSinceLastBuffer=3ms 		 PTS=6720408530 		 NTP-NOW=-0.05ms
Frame 32: TimeSinceLastBuffer=0ms 		 PTS=6760018656 		 NTP-NOW=-0.02ms
Frame 33: TimeSinceLastBuffer=3ms 		 PTS=6801178946 		 NTP-NOW=-0.05ms
Frame 34: TimeSinceLastBuffer=0ms 		 PTS=6840795285 		 NTP-NOW=-0.03ms
Frame 35: TimeSinceLastBuffer=3ms 		 PTS=6881937085 		 NTP-NOW=-0.03ms
Frame 36: TimeSinceLastBuffer=0ms 		 PTS=6921559538 		 NTP-NOW=-0.02ms
Frame 37: TimeSinceLastBuffer=4ms 		 PTS=6962683142 		 NTP-NOW=-0.07ms
Frame 38: TimeSinceLastBuffer=507ms 		 PTS=7002311612 		 NTP-NOW=-0.19ms
Frame 39: TimeSinceLastBuffer=0ms 		 PTS=7043417310 		 NTP-NOW=-0.10ms
Frame 40: TimeSinceLastBuffer=0ms 		 PTS=7083051700 		 NTP-NOW=-0.04ms
Frame 41: TimeSinceLastBuffer=2ms 		 PTS=7124139778 		 NTP-NOW=-0.09ms
Frame 42: TimeSinceLastBuffer=0ms 		 PTS=7163779995 		 NTP-NOW=-0.06ms
Frame 43: TimeSinceLastBuffer=4ms 		 PTS=7204850733 		 NTP-NOW=-0.08ms
Frame 44: TimeSinceLastBuffer=0ms 		 PTS=7244496683 		 NTP-NOW=-0.08ms
Frame 45: TimeSinceLastBuffer=2ms 		 PTS=7285550358 		 NTP-NOW=-0.08ms
Frame 46: TimeSinceLastBuffer=0ms 		 PTS=7325201950 		 NTP-NOW=-0.06ms
Frame 47: TimeSinceLastBuffer=3ms 		 PTS=7366238834 		 NTP-NOW=-0.08ms
Frame 48: TimeSinceLastBuffer=0ms 		 PTS=7405895978 		 NTP-NOW=-0.07ms
Frame 49: TimeSinceLastBuffer=3ms 		 PTS=7446916339 		 NTP-NOW=-0.09ms
Frame 50: TimeSinceLastBuffer=0ms 		 PTS=7486578947 		 NTP-NOW=-0.13ms
Frame 51: TimeSinceLastBuffer=510ms 		 PTS=7527583047 		 NTP-NOW=-0.13ms
Frame 52: TimeSinceLastBuffer=0ms 		 PTS=7567251032 		 NTP-NOW=-0.09ms
Frame 53: TimeSinceLastBuffer=1ms 		 PTS=7607699896 		 NTP-NOW=-0.11ms
Frame 54: TimeSinceLastBuffer=0ms 		 PTS=7647641706 		 NTP-NOW=-0.12ms
Frame 55: TimeSinceLastBuffer=3ms 		 PTS=7687814884 		 NTP-NOW=-0.09ms
Frame 56: TimeSinceLastBuffer=0ms 		 PTS=7727757621 		 NTP-NOW=-0.08ms
Frame 57: TimeSinceLastBuffer=3ms 		 PTS=7767928039 		 NTP-NOW=-0.09ms
Frame 58: TimeSinceLastBuffer=0ms 		 PTS=7807871689 		 NTP-NOW=-0.09ms
Frame 59: TimeSinceLastBuffer=3ms 		 PTS=7848039390 		 NTP-NOW=-0.09ms
Frame 60: TimeSinceLastBuffer=0ms 		 PTS=7887983938 		 NTP-NOW=-0.07ms
Frame 61: TimeSinceLastBuffer=4ms 		 PTS=7928148968 		 NTP-NOW=-0.11ms
Frame 62: TimeSinceLastBuffer=0ms 		 PTS=7968094399 		 NTP-NOW=-0.04ms
Frame 63: TimeSinceLastBuffer=2ms 		 PTS=8008256799 		 NTP-NOW=-0.08ms
Frame 64: TimeSinceLastBuffer=510ms 		 PTS=8048203100 		 NTP-NOW=-0.12ms
Frame 65: TimeSinceLastBuffer=0ms 		 PTS=8088362911 		 NTP-NOW=-0.17ms
Frame 66: TimeSinceLastBuffer=1ms 		 PTS=8128310068 		 NTP-NOW=-0.05ms
Frame 67: TimeSinceLastBuffer=2ms 		 PTS=8168467332 		 NTP-NOW=-0.05ms
Frame 68: TimeSinceLastBuffer=0ms 		 PTS=8208415331 		 NTP-NOW=-0.03ms
Frame 69: TimeSinceLastBuffer=3ms 		 PTS=8248570089 		 NTP-NOW=-0.05ms
Frame 70: TimeSinceLastBuffer=0ms 		 PTS=8288518917 		 NTP-NOW=-0.03ms
Frame 71: TimeSinceLastBuffer=3ms 		 PTS=8328671209 		 NTP-NOW=-0.05ms
Frame 72: TimeSinceLastBuffer=0ms 		 PTS=8368620852 		 NTP-NOW=-0.07ms
Frame 73: TimeSinceLastBuffer=4ms 		 PTS=8408770717 		 NTP-NOW=-0.05ms
Frame 74: TimeSinceLastBuffer=0ms 		 PTS=8448721163 		 NTP-NOW=-0.04ms
Frame 75: TimeSinceLastBuffer=3ms 		 PTS=8488868640 		 NTP-NOW=-0.05ms
Frame 76: TimeSinceLastBuffer=0ms 		 PTS=8528819875 		 NTP-NOW=-0.04ms
Frame 77: TimeSinceLastBuffer=512ms 		 PTS=8568965003 		 NTP-NOW=-0.12ms
Frame 78: TimeSinceLastBuffer=1ms 		 PTS=8608917015 		 NTP-NOW=-0.05ms
Frame 79: TimeSinceLastBuffer=0ms 		 PTS=8649059830 		 NTP-NOW=-0.08ms
Frame 80: TimeSinceLastBuffer=1ms 		 PTS=8689012607 		 NTP-NOW=-0.05ms
Frame 81: TimeSinceLastBuffer=2ms 		 PTS=8729153145 		 NTP-NOW=-0.03ms
Frame 82: TimeSinceLastBuffer=0ms 		 PTS=8769106675 		 NTP-NOW=-0.03ms
Frame 83: TimeSinceLastBuffer=3ms 		 PTS=8809244974 		 NTP-NOW=-0.02ms
Frame 84: TimeSinceLastBuffer=0ms 		 PTS=8849199244 		 NTP-NOW=-0.02ms
Frame 85: TimeSinceLastBuffer=3ms 		 PTS=8889335339 		 NTP-NOW=-0.03ms
Frame 86: TimeSinceLastBuffer=0ms 		 PTS=8929290338 		 NTP-NOW=-0.02ms
Frame 87: TimeSinceLastBuffer=3ms 		 PTS=8969424264 		 NTP-NOW=-0.03ms
Frame 88: TimeSinceLastBuffer=0ms 		 PTS=9009379980 		 NTP-NOW=-0.02ms
Frame 89: TimeSinceLastBuffer=3ms 		 PTS=9049511772 		 NTP-NOW=-0.07ms
Frame 90: TimeSinceLastBuffer=510ms 		 PTS=9089468194 		 NTP-NOW=-0.12ms
Frame 91: TimeSinceLastBuffer=0ms 		 PTS=9129597886 		 NTP-NOW=-0.07ms
Frame 92: TimeSinceLastBuffer=0ms 		 PTS=9169555002 		 NTP-NOW=-0.05ms
Frame 93: TimeSinceLastBuffer=3ms 		 PTS=9209682627 		 NTP-NOW=-0.06ms
Frame 94: TimeSinceLastBuffer=1ms 		 PTS=9249640427 		 NTP-NOW=-0.04ms
Frame 95: TimeSinceLastBuffer=0ms 		 PTS=9289766018 		 NTP-NOW=-0.03ms
Frame 96: TimeSinceLastBuffer=0ms 		 PTS=9329724490 		 NTP-NOW=-0.03ms
Frame 97: TimeSinceLastBuffer=3ms 		 PTS=9369848080 		 NTP-NOW=-0.05ms
Frame 98: TimeSinceLastBuffer=0ms 		 PTS=9409807214 		 NTP-NOW=-0.05ms
Frame 99: TimeSinceLastBuffer=3ms 		 PTS=9449928834 		 NTP-NOW=-0.04ms
Frame 100: TimeSinceLastBuffer=0ms 		 PTS=9489888619 		 NTP-NOW=-0.05ms

uridecodebin (rtsp) → new nvstreammux sync-inputs=1 → fakesink sync=true (sink buffer probe)

This is with sync-inputs=1 enabled, it works fine. NTP also suggests 80ms (two frames) pass before the buffer reaches the fakesink, which I’m not sure why that would be the case (there is no element between streammuxer and sink).

Timings 
Frame 0: TimeSinceLastBuffer=10926ms 		 PTS=10539917585 		 NTP-NOW=-0.30ms
Frame 1: TimeSinceLastBuffer=1802ms 		 PTS=10579848397 		 NTP-NOW=-1801.35ms
Frame 2: TimeSinceLastBuffer=38ms 		 PTS=10619779763 		 NTP-NOW=-1838.18ms
Frame 3: TimeSinceLastBuffer=40ms 		 PTS=10659711678 		 NTP-NOW=-1375.24ms
Frame 4: TimeSinceLastBuffer=40ms 		 PTS=10699644138 		 NTP-NOW=-79.78ms
Frame 5: TimeSinceLastBuffer=40ms 		 PTS=10739329947 		 NTP-NOW=-39.98ms
Frame 6: TimeSinceLastBuffer=40ms 		 PTS=10779174734 		 NTP-NOW=-79.57ms
Frame 7: TimeSinceLastBuffer=40ms 		 PTS=10819486412 		 NTP-NOW=-79.46ms
Frame 8: TimeSinceLastBuffer=40ms 		 PTS=10859020763 		 NTP-NOW=-80.03ms
Frame 9: TimeSinceLastBuffer=40ms 		 PTS=10898716506 		 NTP-NOW=-79.70ms
Frame 10: TimeSinceLastBuffer=40ms 		 PTS=10938868024 		 NTP-NOW=-79.16ms
Frame 11: TimeSinceLastBuffer=40ms 		 PTS=10978417098 		 NTP-NOW=-79.77ms
Frame 12: TimeSinceLastBuffer=40ms 		 PTS=11018566201 		 NTP-NOW=-79.60ms
Frame 13: TimeSinceLastBuffer=41ms 		 PTS=11058122461 		 NTP-NOW=-79.95ms
Frame 14: TimeSinceLastBuffer=39ms 		 PTS=11097976908 		 NTP-NOW=-79.55ms
Frame 15: TimeSinceLastBuffer=40ms 		 PTS=11138269188 		 NTP-NOW=-78.92ms
Frame 16: TimeSinceLastBuffer=40ms 		 PTS=11177832519 		 NTP-NOW=-80.28ms
Frame 17: TimeSinceLastBuffer=39ms 		 PTS=11217547198 		 NTP-NOW=-79.75ms
Frame 18: TimeSinceLastBuffer=40ms 		 PTS=11257689286 		 NTP-NOW=-78.97ms
Frame 19: TimeSinceLastBuffer=40ms 		 PTS=11297266424 		 NTP-NOW=-79.70ms
Frame 20: TimeSinceLastBuffer=40ms 		 PTS=11337127719 		 NTP-NOW=-79.61ms
Frame 21: TimeSinceLastBuffer=40ms 		 PTS=11377406247 		 NTP-NOW=-79.27ms
Frame 22: TimeSinceLastBuffer=40ms 		 PTS=11416990124 		 NTP-NOW=-80.00ms
Frame 23: TimeSinceLastBuffer=40ms 		 PTS=11456718228 		 NTP-NOW=-79.80ms
Frame 24: TimeSinceLastBuffer=40ms 		 PTS=11496853630 		 NTP-NOW=-79.17ms
Frame 25: TimeSinceLastBuffer=40ms 		 PTS=11536450664 		 NTP-NOW=-79.77ms
Frame 26: TimeSinceLastBuffer=40ms 		 PTS=11576318485 		 NTP-NOW=-78.69ms
Frame 27: TimeSinceLastBuffer=40ms 		 PTS=11616583909 		 NTP-NOW=-79.36ms
Frame 28: TimeSinceLastBuffer=40ms 		 PTS=11656057292 		 NTP-NOW=-80.06ms
Frame 29: TimeSinceLastBuffer=39ms 		 PTS=11695928260 		 NTP-NOW=-79.60ms
Frame 30: TimeSinceLastBuffer=40ms 		 PTS=11736187364 		 NTP-NOW=-79.25ms
Frame 31: TimeSinceLastBuffer=40ms 		 PTS=11775649423 		 NTP-NOW=-79.02ms
Frame 32: TimeSinceLastBuffer=39ms 		 PTS=11815511675 		 NTP-NOW=-79.57ms
Frame 33: TimeSinceLastBuffer=40ms 		 PTS=11855788282 		 NTP-NOW=-79.29ms
Frame 34: TimeSinceLastBuffer=40ms 		 PTS=11895239476 		 NTP-NOW=-80.01ms
Frame 35: TimeSinceLastBuffer=39ms 		 PTS=11935105008 		 NTP-NOW=-79.60ms
Frame 36: TimeSinceLastBuffer=40ms 		 PTS=11975375029 		 NTP-NOW=-79.17ms
Frame 37: TimeSinceLastBuffer=40ms 		 PTS=12014839291 		 NTP-NOW=-80.04ms
Frame 38: TimeSinceLastBuffer=39ms 		 PTS=12054708024 		 NTP-NOW=-79.70ms
Frame 39: TimeSinceLastBuffer=40ms 		 PTS=12094971616 		 NTP-NOW=-79.21ms
Frame 40: TimeSinceLastBuffer=40ms 		 PTS=12134448632 		 NTP-NOW=-79.99ms
Frame 41: TimeSinceLastBuffer=39ms 		 PTS=12174320491 		 NTP-NOW=-79.56ms
Frame 42: TimeSinceLastBuffer=40ms 		 PTS=12214577807 		 NTP-NOW=-79.24ms
Frame 43: TimeSinceLastBuffer=40ms 		 PTS=12254067276 		 NTP-NOW=-80.08ms
Frame 44: TimeSinceLastBuffer=39ms 		 PTS=12294193375 		 NTP-NOW=-79.68ms
Frame 45: TimeSinceLastBuffer=40ms 		 PTS=12333818095 		 NTP-NOW=-79.44ms
Frame 46: TimeSinceLastBuffer=40ms 		 PTS=12373942185 		 NTP-NOW=-79.63ms
Frame 47: TimeSinceLastBuffer=40ms 		 PTS=12413572886 		 NTP-NOW=-79.63ms
Frame 48: TimeSinceLastBuffer=40ms 		 PTS=12453694998 		 NTP-NOW=-79.60ms
Frame 49: TimeSinceLastBuffer=40ms 		 PTS=12493331584 		 NTP-NOW=-79.75ms
Frame 50: TimeSinceLastBuffer=40ms 		 PTS=12533451750 		 NTP-NOW=-79.63ms
Frame 51: TimeSinceLastBuffer=40ms 		 PTS=12573094128 		 NTP-NOW=-79.63ms
Frame 52: TimeSinceLastBuffer=40ms 		 PTS=12613212379 		 NTP-NOW=-79.74ms
Frame 53: TimeSinceLastBuffer=40ms 		 PTS=12652860456 		 NTP-NOW=-79.65ms
Frame 54: TimeSinceLastBuffer=40ms 		 PTS=12692976823 		 NTP-NOW=-79.58ms
Frame 55: TimeSinceLastBuffer=40ms 		 PTS=12732630507 		 NTP-NOW=-79.63ms
Frame 56: TimeSinceLastBuffer=40ms 		 PTS=12772745020 		 NTP-NOW=-79.68ms
Frame 57: TimeSinceLastBuffer=40ms 		 PTS=12812404223 		 NTP-NOW=-79.79ms
Frame 58: TimeSinceLastBuffer=40ms 		 PTS=12852516911 		 NTP-NOW=-79.70ms
Frame 59: TimeSinceLastBuffer=40ms 		 PTS=12892181545 		 NTP-NOW=-79.68ms
Frame 60: TimeSinceLastBuffer=40ms 		 PTS=12932292437 		 NTP-NOW=-79.66ms
Frame 61: TimeSinceLastBuffer=40ms 		 PTS=12971962415 		 NTP-NOW=-79.69ms
Frame 62: TimeSinceLastBuffer=40ms 		 PTS=13012071540 		 NTP-NOW=-79.69ms
Frame 63: TimeSinceLastBuffer=40ms 		 PTS=13051746777 		 NTP-NOW=-79.68ms
Frame 64: TimeSinceLastBuffer=40ms 		 PTS=13091854163 		 NTP-NOW=-79.77ms
Frame 65: TimeSinceLastBuffer=40ms 		 PTS=13131534576 		 NTP-NOW=-79.68ms
Frame 66: TimeSinceLastBuffer=40ms 		 PTS=13171640250 		 NTP-NOW=-79.68ms
Frame 67: TimeSinceLastBuffer=40ms 		 PTS=13211325757 		 NTP-NOW=-79.71ms
Frame 68: TimeSinceLastBuffer=40ms 		 PTS=13251429747 		 NTP-NOW=-79.69ms
Frame 69: TimeSinceLastBuffer=40ms 		 PTS=13291120266 		 NTP-NOW=-79.71ms
Frame 70: TimeSinceLastBuffer=40ms 		 PTS=13331222599 		 NTP-NOW=-79.65ms
Frame 71: TimeSinceLastBuffer=40ms 		 PTS=13370918049 		 NTP-NOW=-79.68ms
Frame 72: TimeSinceLastBuffer=40ms 		 PTS=13411018751 		 NTP-NOW=-79.16ms
Frame 73: TimeSinceLastBuffer=40ms 		 PTS=13450719054 		 NTP-NOW=-79.69ms
Frame 74: TimeSinceLastBuffer=40ms 		 PTS=13490818152 		 NTP-NOW=-79.72ms
Frame 75: TimeSinceLastBuffer=40ms 		 PTS=13530523231 		 NTP-NOW=-79.66ms
Frame 76: TimeSinceLastBuffer=40ms 		 PTS=13570620749 		 NTP-NOW=-79.74ms
Frame 77: TimeSinceLastBuffer=40ms 		 PTS=13610330529 		 NTP-NOW=-79.60ms
Frame 78: TimeSinceLastBuffer=40ms 		 PTS=13650426493 		 NTP-NOW=-79.70ms
Frame 79: TimeSinceLastBuffer=40ms 		 PTS=13690140897 		 NTP-NOW=-79.73ms
Frame 80: TimeSinceLastBuffer=40ms 		 PTS=13730235332 		 NTP-NOW=-79.69ms
Frame 81: TimeSinceLastBuffer=40ms 		 PTS=13770281403 		 NTP-NOW=-79.70ms
Frame 82: TimeSinceLastBuffer=40ms 		 PTS=13810047217 		 NTP-NOW=-80.05ms
Frame 83: TimeSinceLastBuffer=40ms 		 PTS=13850744170 		 NTP-NOW=-79.74ms
Frame 84: TimeSinceLastBuffer=41ms 		 PTS=13890513716 		 NTP-NOW=-80.45ms
Frame 85: TimeSinceLastBuffer=40ms 		 PTS=13931199562 		 NTP-NOW=-80.32ms
Frame 86: TimeSinceLastBuffer=41ms 		 PTS=13970972780 		 NTP-NOW=-80.29ms
Frame 87: TimeSinceLastBuffer=40ms 		 PTS=14011647697 		 NTP-NOW=-78.36ms
Frame 88: TimeSinceLastBuffer=41ms 		 PTS=14051424529 		 NTP-NOW=-80.35ms
Frame 89: TimeSinceLastBuffer=40ms 		 PTS=14092088690 		 NTP-NOW=-80.41ms
Frame 90: TimeSinceLastBuffer=41ms 		 PTS=14131869079 		 NTP-NOW=-80.34ms
Frame 91: TimeSinceLastBuffer=40ms 		 PTS=14172522655 		 NTP-NOW=-80.36ms
Frame 92: TimeSinceLastBuffer=41ms 		 PTS=14212306544 		 NTP-NOW=-79.88ms
Frame 93: TimeSinceLastBuffer=40ms 		 PTS=14252949705 		 NTP-NOW=-80.32ms
Frame 94: TimeSinceLastBuffer=41ms 		 PTS=14292737038 		 NTP-NOW=-80.39ms
Frame 95: TimeSinceLastBuffer=40ms 		 PTS=14333369949 		 NTP-NOW=-80.31ms
Frame 96: TimeSinceLastBuffer=41ms 		 PTS=14373160671 		 NTP-NOW=-80.30ms
Frame 97: TimeSinceLastBuffer=40ms 		 PTS=14413783496 		 NTP-NOW=-79.68ms
Frame 98: TimeSinceLastBuffer=41ms 		 PTS=14453577553 		 NTP-NOW=-80.31ms
Frame 99: TimeSinceLastBuffer=40ms 		 PTS=14494190453 		 NTP-NOW=-80.36ms
Frame 100: TimeSinceLastBuffer=41ms 		 PTS=14533987792 		 NTP-NOW=-80.30ms

Could I get an explanation of what sync-inputs=1 does exactly in this example? The documentation is rather sparse on this topic.
Can we expect this to work for RTMP, HLS, etc. as well?

EDIT: Previous results were broken because latency of rtspjitterbuffer was set too low which messed up all PTS in the pipeline, fixed now.

How to manually attach NvDsBatchMeta (like nvstreammux does)
8

Also, it seems to make a difference it sync=true or sync=false is set or whether sync is not set at all on the fakesink in combination with sync-inputs=1:

uridecodebin (rtsp) → new nvstreammux sync-inputs=1 → fakesink sync=false (sink buffer probe)

With sync=false everything is working fine.

Timings
Frame 0: TimeSinceLastBuffer=6129ms PTS=5475624382 NTP-NOW=-0.30ms
Frame 1: TimeSinceLastBuffer=1524ms PTS=5515025912 NTP-NOW=-1523.89ms
Frame 2: TimeSinceLastBuffer=38ms PTS=5553843297 NTP-NOW=-1558.73ms
Frame 3: TimeSinceLastBuffer=39ms PTS=5594432230 NTP-NOW=-1597.44ms
Frame 4: TimeSinceLastBuffer=41ms PTS=5632679528 NTP-NOW=-79.27ms
Frame 5: TimeSinceLastBuffer=38ms PTS=5673259076 NTP-NOW=-78.75ms
Frame 6: TimeSinceLastBuffer=41ms PTS=5711534305 NTP-NOW=-78.65ms
Frame 7: TimeSinceLastBuffer=38ms PTS=5752104617 NTP-NOW=-78.78ms
Frame 8: TimeSinceLastBuffer=41ms PTS=5790407333 NTP-NOW=-40.56ms
Frame 9: TimeSinceLastBuffer=38ms PTS=5830968556 NTP-NOW=-78.73ms
Frame 10: TimeSinceLastBuffer=41ms PTS=5868750458 NTP-NOW=-78.72ms
Frame 11: TimeSinceLastBuffer=38ms PTS=5909298319 NTP-NOW=-77.26ms
Frame 12: TimeSinceLastBuffer=40ms PTS=5948206979 NTP-NOW=-78.22ms
Frame 13: TimeSinceLastBuffer=39ms PTS=5989850599 NTP-NOW=-79.32ms
Frame 14: TimeSinceLastBuffer=42ms PTS=6027133030 NTP-NOW=-80.60ms
Frame 15: TimeSinceLastBuffer=37ms PTS=6067667848 NTP-NOW=-78.96ms
Frame 16: TimeSinceLastBuffer=40ms PTS=6106076196 NTP-NOW=-40.55ms
Frame 17: TimeSinceLastBuffer=38ms PTS=6146602491 NTP-NOW=-76.94ms
Frame 18: TimeSinceLastBuffer=40ms PTS=6185036204 NTP-NOW=-40.55ms
Frame 19: TimeSinceLastBuffer=38ms PTS=6225554112 NTP-NOW=-78.86ms
Frame 20: TimeSinceLastBuffer=41ms PTS=6264012785 NTP-NOW=-0.18ms
Frame 21: TimeSinceLastBuffer=38ms PTS=6304522439 NTP-NOW=-38.44ms
Frame 22: TimeSinceLastBuffer=41ms PTS=6342508155 NTP-NOW=-78.68ms
Frame 23: TimeSinceLastBuffer=38ms PTS=6383005675 NTP-NOW=-78.39ms
Frame 24: TimeSinceLastBuffer=40ms PTS=6422014615 NTP-NOW=-78.33ms
Frame 25: TimeSinceLastBuffer=39ms PTS=6463507208 NTP-NOW=-79.48ms
Frame 26: TimeSinceLastBuffer=41ms PTS=6501525023 NTP-NOW=-80.40ms
Frame 27: TimeSinceLastBuffer=38ms PTS=6541039348 NTP-NOW=-79.37ms
Frame 28: TimeSinceLastBuffer=40ms PTS=6580079623 NTP-NOW=-77.48ms
Frame 29: TimeSinceLastBuffer=39ms PTS=6620557558 NTP-NOW=-78.48ms
Frame 30: TimeSinceLastBuffer=41ms PTS=6659135192 NTP-NOW=-79.44ms
Frame 31: TimeSinceLastBuffer=39ms PTS=6699605511 NTP-NOW=-78.93ms
Frame 32: TimeSinceLastBuffer=40ms PTS=6738205812 NTP-NOW=-78.91ms
Frame 33: TimeSinceLastBuffer=39ms PTS=6778668636 NTP-NOW=-78.44ms
Frame 34: TimeSinceLastBuffer=40ms PTS=6817576499 NTP-NOW=-78.99ms
Frame 35: TimeSinceLastBuffer=39ms PTS=6857291243 NTP-NOW=-79.30ms
Frame 36: TimeSinceLastBuffer=40ms PTS=6897859473 NTP-NOW=-78.57ms
Frame 37: TimeSinceLastBuffer=41ms PTS=6937746691 NTP-NOW=-80.17ms
Frame 38: TimeSinceLastBuffer=40ms PTS=6978413569 NTP-NOW=-80.34ms
Frame 39: TimeSinceLastBuffer=41ms PTS=7018137634 NTP-NOW=-80.50ms
Frame 40: TimeSinceLastBuffer=40ms PTS=7058958835 NTP-NOW=-80.30ms
Frame 41: TimeSinceLastBuffer=41ms PTS=7098687297 NTP-NOW=-80.46ms
Frame 42: TimeSinceLastBuffer=40ms PTS=7139495412 NTP-NOW=-80.42ms
Frame 43: TimeSinceLastBuffer=41ms PTS=7179228201 NTP-NOW=-78.58ms
Frame 44: TimeSinceLastBuffer=40ms PTS=7220023438 NTP-NOW=-80.45ms
Frame 45: TimeSinceLastBuffer=41ms PTS=7259760485 NTP-NOW=-80.38ms
Frame 46: TimeSinceLastBuffer=40ms PTS=7300799741 NTP-NOW=-80.46ms
Frame 47: TimeSinceLastBuffer=41ms PTS=7340543049 NTP-NOW=-80.68ms
Frame 48: TimeSinceLastBuffer=40ms PTS=7381054380 NTP-NOW=-80.74ms
Frame 49: TimeSinceLastBuffer=40ms PTS=7420284287 NTP-NOW=-80.19ms
Frame 50: TimeSinceLastBuffer=39ms PTS=7461557562 NTP-NOW=-79.65ms
Frame 51: TimeSinceLastBuffer=41ms PTS=7501306981 NTP-NOW=-80.46ms
Frame 52: TimeSinceLastBuffer=40ms PTS=7542052725 NTP-NOW=-80.88ms
Frame 53: TimeSinceLastBuffer=41ms PTS=7581806138 NTP-NOW=-80.43ms
Frame 54: TimeSinceLastBuffer=40ms PTS=7622539998 NTP-NOW=-80.43ms
Frame 55: TimeSinceLastBuffer=41ms PTS=7662297340 NTP-NOW=-80.38ms
Frame 56: TimeSinceLastBuffer=40ms PTS=7703019506 NTP-NOW=-39.83ms
Frame 57: TimeSinceLastBuffer=41ms PTS=7742780715 NTP-NOW=-79.27ms
Frame 58: TimeSinceLastBuffer=40ms PTS=7783724477 NTP-NOW=-79.53ms
Frame 59: TimeSinceLastBuffer=41ms PTS=7823491371 NTP-NOW=-80.63ms
Frame 60: TimeSinceLastBuffer=40ms PTS=7863955718 NTP-NOW=-80.61ms
Frame 61: TimeSinceLastBuffer=40ms PTS=7903256386 NTP-NOW=-80.18ms
Frame 62: TimeSinceLastBuffer=39ms PTS=7944412665 NTP-NOW=-79.34ms
Frame 63: TimeSinceLastBuffer=41ms PTS=7984185109 NTP-NOW=-80.65ms
Frame 64: TimeSinceLastBuffer=40ms PTS=8024862329 NTP-NOW=-81.11ms
Frame 65: TimeSinceLastBuffer=40ms PTS=8064638400 NTP-NOW=-80.23ms
Frame 66: TimeSinceLastBuffer=40ms PTS=8105304828 NTP-NOW=-80.12ms
Frame 67: TimeSinceLastBuffer=41ms PTS=8145084467 NTP-NOW=-80.29ms
Frame 68: TimeSinceLastBuffer=40ms PTS=8185740275 NTP-NOW=-80.53ms
Frame 69: TimeSinceLastBuffer=40ms PTS=8225523426 NTP-NOW=-80.36ms
Frame 70: TimeSinceLastBuffer=40ms PTS=8266380468 NTP-NOW=-80.21ms
Frame 71: TimeSinceLastBuffer=41ms PTS=8306168782 NTP-NOW=-80.59ms
Frame 72: TimeSinceLastBuffer=40ms PTS=8346590461 NTP-NOW=-80.52ms
Frame 73: TimeSinceLastBuffer=40ms PTS=8385955389 NTP-NOW=-80.16ms
Frame 74: TimeSinceLastBuffer=39ms PTS=8427005420 NTP-NOW=-79.71ms
Frame 75: TimeSinceLastBuffer=41ms PTS=8466798774 NTP-NOW=-80.37ms
Frame 76: TimeSinceLastBuffer=40ms PTS=8507413766 NTP-NOW=-80.80ms
Frame 77: TimeSinceLastBuffer=41ms PTS=8547210413 NTP-NOW=-80.20ms
Frame 78: TimeSinceLastBuffer=40ms PTS=8587460090 NTP-NOW=-80.38ms
Frame 79: TimeSinceLastBuffer=40ms PTS=8627437021 NTP-NOW=-79.94ms
Frame 80: TimeSinceLastBuffer=40ms PTS=8667505677 NTP-NOW=-80.11ms
Frame 81: TimeSinceLastBuffer=40ms PTS=8707482975 NTP-NOW=-79.97ms
Frame 82: TimeSinceLastBuffer=40ms PTS=8747572698 NTP-NOW=-79.87ms
Frame 83: TimeSinceLastBuffer=40ms PTS=8787550537 NTP-NOW=-80.13ms
Frame 84: TimeSinceLastBuffer=40ms PTS=8827594682 NTP-NOW=-79.99ms
Frame 85: TimeSinceLastBuffer=40ms PTS=8867528197 NTP-NOW=-79.84ms
Frame 86: TimeSinceLastBuffer=40ms PTS=8907638124 NTP-NOW=-79.96ms
Frame 87: TimeSinceLastBuffer=40ms PTS=8947616490 NTP-NOW=-79.90ms
Frame 88: TimeSinceLastBuffer=40ms PTS=8987680874 NTP-NOW=-80.21ms
Frame 89: TimeSinceLastBuffer=40ms PTS=9027659585 NTP-NOW=-79.92ms
Frame 90: TimeSinceLastBuffer=40ms PTS=9067722943 NTP-NOW=-79.82ms
Frame 91: TimeSinceLastBuffer=40ms PTS=9107701993 NTP-NOW=-80.00ms
Frame 92: TimeSinceLastBuffer=40ms PTS=9147764341 NTP-NOW=-79.90ms
Frame 93: TimeSinceLastBuffer=40ms PTS=9187743725 NTP-NOW=-80.19ms
Frame 94: TimeSinceLastBuffer=40ms PTS=9227825204 NTP-NOW=-79.94ms
Frame 95: TimeSinceLastBuffer=40ms PTS=9267805079 NTP-NOW=-79.81ms
Frame 96: TimeSinceLastBuffer=40ms PTS=9307845168 NTP-NOW=-80.01ms
Frame 97: TimeSinceLastBuffer=40ms PTS=9347784792 NTP-NOW=-79.92ms
Frame 98: TimeSinceLastBuffer=40ms PTS=9387884618 NTP-NOW=-79.92ms
Frame 99: TimeSinceLastBuffer=40ms PTS=9427864972 NTP-NOW=-79.94ms
Frame 100: TimeSinceLastBuffer=40ms PTS=9467923440 NTP-NOW=-79.94ms
Frame 101: TimeSinceLastBuffer=40ms PTS=9507904107 NTP-NOW=-79.99ms
Frame 102: TimeSinceLastBuffer=40ms PTS=9547942618 NTP-NOW=-79.92ms
Frame 103: TimeSinceLastBuffer=40ms PTS=9587961643 NTP-NOW=-79.94ms
Frame 104: TimeSinceLastBuffer=40ms PTS=9627999236 NTP-NOW=-79.97ms
Frame 105: TimeSinceLastBuffer=40ms PTS=9667980515 NTP-NOW=-79.91ms
Frame 106: TimeSinceLastBuffer=40ms PTS=9708054507 NTP-NOW=-79.97ms
Frame 107: TimeSinceLastBuffer=40ms PTS=9748036231 NTP-NOW=-79.94ms
Frame 108: TimeSinceLastBuffer=40ms PTS=9788072636 NTP-NOW=-80.00ms
Frame 109: TimeSinceLastBuffer=40ms PTS=9828017808 NTP-NOW=-79.95ms
Frame 110: TimeSinceLastBuffer=40ms PTS=9868108461 NTP-NOW=-79.86ms
Frame 111: TimeSinceLastBuffer=40ms PTS=9908090620 NTP-NOW=-80.01ms
Frame 112: TimeSinceLastBuffer=40ms PTS=9948143715 NTP-NOW=-79.96ms

uridecodebin (rtsp) → new nvstreammux sync-inputs=1 → fakesink sync=true (sink buffer probe)

With sync=true it works as well.

Timings
Frame 0: TimeSinceLastBuffer=7176ms PTS=6571973299 NTP-NOW=-0.30ms
Frame 1: TimeSinceLastBuffer=1614ms PTS=6612253616 NTP-NOW=-1613.45ms
Frame 2: TimeSinceLastBuffer=40ms PTS=6652807540 NTP-NOW=-1650.39ms
Frame 3: TimeSinceLastBuffer=41ms PTS=6692531690 NTP-NOW=-1690.85ms
Frame 4: TimeSinceLastBuffer=40ms PTS=6733352637 NTP-NOW=-80.14ms
Frame 5: TimeSinceLastBuffer=41ms PTS=6773081183 NTP-NOW=-80.45ms
Frame 6: TimeSinceLastBuffer=40ms PTS=6813889047 NTP-NOW=-80.40ms
Frame 7: TimeSinceLastBuffer=41ms PTS=6853621919 NTP-NOW=-80.38ms
Frame 8: TimeSinceLastBuffer=40ms PTS=6894416909 NTP-NOW=-80.39ms
Frame 9: TimeSinceLastBuffer=41ms PTS=6934154038 NTP-NOW=-80.48ms
Frame 10: TimeSinceLastBuffer=40ms PTS=6975192971 NTP-NOW=-80.45ms
Frame 11: TimeSinceLastBuffer=41ms PTS=7014936359 NTP-NOW=-80.64ms
Frame 12: TimeSinceLastBuffer=40ms PTS=7055447531 NTP-NOW=-80.67ms
Frame 13: TimeSinceLastBuffer=40ms PTS=7094677677 NTP-NOW=-80.14ms
Frame 14: TimeSinceLastBuffer=39ms PTS=7135950557 NTP-NOW=-79.63ms
Frame 15: TimeSinceLastBuffer=41ms PTS=7175700054 NTP-NOW=-78.79ms
Frame 16: TimeSinceLastBuffer=40ms PTS=7216445567 NTP-NOW=-0.15ms
Frame 17: TimeSinceLastBuffer=41ms PTS=7256199056 NTP-NOW=-40.74ms
Frame 18: TimeSinceLastBuffer=40ms PTS=7296932688 NTP-NOW=-80.10ms
Frame 19: TimeSinceLastBuffer=41ms PTS=7336690106 NTP-NOW=-80.42ms
Frame 20: TimeSinceLastBuffer=40ms PTS=7377412047 NTP-NOW=-78.68ms
Frame 21: TimeSinceLastBuffer=41ms PTS=7417173330 NTP-NOW=-80.50ms
Frame 22: TimeSinceLastBuffer=40ms PTS=7456586757 NTP-NOW=-80.38ms
Frame 23: TimeSinceLastBuffer=39ms PTS=7496859647 NTP-NOW=-79.02ms
Frame 24: TimeSinceLastBuffer=40ms PTS=7536316050 NTP-NOW=-79.63ms
Frame 25: TimeSinceLastBuffer=39ms PTS=7577134738 NTP-NOW=-78.32ms
Frame 26: TimeSinceLastBuffer=41ms PTS=7615781116 NTP-NOW=-80.20ms
Frame 27: TimeSinceLastBuffer=39ms PTS=7656047509 NTP-NOW=-79.34ms
Frame 28: TimeSinceLastBuffer=40ms PTS=7695254706 NTP-NOW=-78.68ms
Frame 29: TimeSinceLastBuffer=39ms PTS=7735516854 NTP-NOW=-79.31ms
Frame 30: TimeSinceLastBuffer=40ms PTS=7774736686 NTP-NOW=-79.35ms
Frame 31: TimeSinceLastBuffer=39ms PTS=7814994656 NTP-NOW=-79.38ms
Frame 32: TimeSinceLastBuffer=40ms PTS=7854226921 NTP-NOW=-40.28ms
Frame 33: TimeSinceLastBuffer=39ms PTS=7894480780 NTP-NOW=-79.40ms
Frame 34: TimeSinceLastBuffer=40ms PTS=7933477464 NTP-NOW=-79.38ms
Frame 35: TimeSinceLastBuffer=39ms PTS=7973725279 NTP-NOW=-79.11ms
Frame 36: TimeSinceLastBuffer=40ms PTS=8013231632 NTP-NOW=-79.13ms
Frame 37: TimeSinceLastBuffer=40ms PTS=8053975093 NTP-NOW=-79.67ms
Frame 38: TimeSinceLastBuffer=41ms PTS=8092745851 NTP-NOW=-80.17ms
Frame 39: TimeSinceLastBuffer=39ms PTS=8132987766 NTP-NOW=-79.39ms
Frame 40: TimeSinceLastBuffer=40ms PTS=8172267811 NTP-NOW=-78.88ms
Frame 41: TimeSinceLastBuffer=39ms PTS=8212505871 NTP-NOW=-79.35ms
Frame 42: TimeSinceLastBuffer=40ms PTS=8251797390 NTP-NOW=-79.45ms
Frame 43: TimeSinceLastBuffer=39ms PTS=8292031656 NTP-NOW=-79.47ms
Frame 44: TimeSinceLastBuffer=40ms PTS=8331334465 NTP-NOW=-79.39ms
Frame 45: TimeSinceLastBuffer=39ms PTS=8371564998 NTP-NOW=-79.43ms
Frame 46: TimeSinceLastBuffer=40ms PTS=8410653873 NTP-NOW=-78.19ms
Frame 47: TimeSinceLastBuffer=39ms PTS=8450878917 NTP-NOW=-79.24ms
Frame 48: TimeSinceLastBuffer=40ms PTS=8490430629 NTP-NOW=-79.23ms
Frame 49: TimeSinceLastBuffer=40ms PTS=8531105776 NTP-NOW=-79.69ms
Frame 50: TimeSinceLastBuffer=41ms PTS=8569989485 NTP-NOW=-80.11ms
Frame 51: TimeSinceLastBuffer=39ms PTS=8610209171 NTP-NOW=-79.46ms
Frame 52: TimeSinceLastBuffer=40ms PTS=8649555371 NTP-NOW=-79.01ms
Frame 53: TimeSinceLastBuffer=39ms PTS=8689771556 NTP-NOW=-79.50ms
Frame 54: TimeSinceLastBuffer=40ms PTS=8729128175 NTP-NOW=-79.47ms
Frame 55: TimeSinceLastBuffer=39ms PTS=8769340915 NTP-NOW=-79.46ms
Frame 56: TimeSinceLastBuffer=40ms PTS=8808707787 NTP-NOW=-79.48ms
Frame 57: TimeSinceLastBuffer=39ms PTS=8848917137 NTP-NOW=-79.23ms
Frame 58: TimeSinceLastBuffer=40ms PTS=8888089732 NTP-NOW=-79.47ms
Frame 59: TimeSinceLastBuffer=39ms PTS=8928294098 NTP-NOW=-79.30ms
Frame 60: TimeSinceLastBuffer=40ms PTS=8967887001 NTP-NOW=-79.30ms
Frame 61: TimeSinceLastBuffer=40ms PTS=9008500112 NTP-NOW=-79.71ms
Frame 62: TimeSinceLastBuffer=41ms PTS=9047486392 NTP-NOW=-40.62ms
Frame 63: TimeSinceLastBuffer=39ms PTS=9087685892 NTP-NOW=-79.53ms
Frame 64: TimeSinceLastBuffer=40ms PTS=9127092167 NTP-NOW=-79.40ms
Frame 65: TimeSinceLastBuffer=39ms PTS=9167288488 NTP-NOW=-79.46ms
Frame 66: TimeSinceLastBuffer=40ms PTS=9206704225 NTP-NOW=-79.18ms
Frame 67: TimeSinceLastBuffer=39ms PTS=9246897417 NTP-NOW=-77.44ms
Frame 68: TimeSinceLastBuffer=40ms PTS=9286322465 NTP-NOW=-40.22ms
Frame 69: TimeSinceLastBuffer=39ms PTS=9326512578 NTP-NOW=-79.51ms
Frame 70: TimeSinceLastBuffer=40ms PTS=9366060439 NTP-NOW=-79.48ms
Frame 71: TimeSinceLastBuffer=40ms PTS=9405946788 NTP-NOW=-79.63ms
Frame 72: TimeSinceLastBuffer=40ms PTS=9446173181 NTP-NOW=-79.35ms
Frame 73: TimeSinceLastBuffer=40ms PTS=9486133872 NTP-NOW=-80.01ms
Frame 74: TimeSinceLastBuffer=40ms PTS=9526395966 NTP-NOW=-80.07ms
Frame 75: TimeSinceLastBuffer=40ms PTS=9566285021 NTP-NOW=-80.12ms
Frame 76: TimeSinceLastBuffer=40ms PTS=9606615201 NTP-NOW=-80.03ms
Frame 77: TimeSinceLastBuffer=40ms PTS=9646506024 NTP-NOW=-80.09ms
Frame 78: TimeSinceLastBuffer=40ms PTS=9686830943 NTP-NOW=-80.14ms
Frame 79: TimeSinceLastBuffer=40ms PTS=9726723505 NTP-NOW=-80.13ms
Frame 80: TimeSinceLastBuffer=40ms PTS=9767043246 NTP-NOW=-80.14ms
Frame 81: TimeSinceLastBuffer=40ms PTS=9806937521 NTP-NOW=-80.11ms
Frame 82: TimeSinceLastBuffer=40ms PTS=9847710336 NTP-NOW=-80.13ms
Frame 83: TimeSinceLastBuffer=41ms PTS=9887252167 NTP-NOW=-80.54ms
Frame 84: TimeSinceLastBuffer=40ms PTS=9928164840 NTP-NOW=-80.22ms
Frame 85: TimeSinceLastBuffer=41ms PTS=9967148126 NTP-NOW=-80.37ms
Frame 86: TimeSinceLastBuffer=39ms PTS=10009062969 NTP-NOW=-79.80ms
Frame 87: TimeSinceLastBuffer=42ms PTS=10048615708 NTP-NOW=-80.81ms
Frame 88: TimeSinceLastBuffer=40ms PTS=10089946785 NTP-NOW=-81.38ms
Frame 89: TimeSinceLastBuffer=41ms PTS=10129506652 NTP-NOW=-80.73ms
Frame 90: TimeSinceLastBuffer=40ms PTS=10170816516 NTP-NOW=-80.82ms
Frame 91: TimeSinceLastBuffer=41ms PTS=10210383397 NTP-NOW=-80.80ms
Frame 92: TimeSinceLastBuffer=40ms PTS=10251672387 NTP-NOW=-80.76ms
Frame 93: TimeSinceLastBuffer=41ms PTS=10291246170 NTP-NOW=-80.82ms
Frame 94: TimeSinceLastBuffer=40ms PTS=10333021007 NTP-NOW=-80.84ms
Frame 95: TimeSinceLastBuffer=42ms PTS=10372514619 NTP-NOW=-81.30ms
Frame 96: TimeSinceLastBuffer=39ms PTS=10413523343 NTP-NOW=-81.13ms
Frame 97: TimeSinceLastBuffer=41ms PTS=10452095194 NTP-NOW=-80.32ms
Frame 98: TimeSinceLastBuffer=39ms PTS=10494515992 NTP-NOW=-79.54ms
Frame 99: TimeSinceLastBuffer=42ms PTS=10534021661 NTP-NOW=-80.94ms
Frame 100: TimeSinceLastBuffer=39ms PTS=10575492823 NTP-NOW=-81.87ms

uridecodebin (rtsp) → new nvstreammux sync-inputs=1 → fakesink (sink buffer probe)

Not setting any sync option on the fakesink gives similar results to sync-inputs=0, even though it is set to sync-inputs=1! The buffers are delayed again.

Timings
Frame 0: TimeSinceLastBuffer=6483ms PTS=5749551306 NTP-NOW=-0.51ms
Frame 1: TimeSinceLastBuffer=1ms PTS=5790172889 NTP-NOW=-0.07ms
Frame 2: TimeSinceLastBuffer=0ms PTS=5829863346 NTP-NOW=-0.05ms
Frame 3: TimeSinceLastBuffer=3ms PTS=5870784566 NTP-NOW=-0.05ms
Frame 4: TimeSinceLastBuffer=0ms PTS=5910479956 NTP-NOW=-0.04ms
Frame 5: TimeSinceLastBuffer=3ms PTS=5951386495 NTP-NOW=-0.04ms
Frame 6: TimeSinceLastBuffer=0ms PTS=5991086739 NTP-NOW=-0.04ms
Frame 7: TimeSinceLastBuffer=3ms PTS=6031978832 NTP-NOW=-0.06ms
Frame 8: TimeSinceLastBuffer=0ms PTS=6071683853 NTP-NOW=-0.06ms
Frame 9: TimeSinceLastBuffer=3ms PTS=6112561729 NTP-NOW=-0.05ms
Frame 10: TimeSinceLastBuffer=0ms PTS=6152271451 NTP-NOW=-0.05ms
Frame 11: TimeSinceLastBuffer=509ms PTS=6193135338 NTP-NOW=-0.12ms
Frame 12: TimeSinceLastBuffer=3ms PTS=6232849685 NTP-NOW=-0.12ms
Frame 13: TimeSinceLastBuffer=1ms PTS=6273699805 NTP-NOW=-0.07ms
Frame 14: TimeSinceLastBuffer=0ms PTS=6313418705 NTP-NOW=-0.07ms
Frame 15: TimeSinceLastBuffer=0ms PTS=6354255278 NTP-NOW=-0.05ms
Frame 16: TimeSinceLastBuffer=0ms PTS=6393978657 NTP-NOW=-0.06ms
Frame 17: TimeSinceLastBuffer=3ms PTS=6434801899 NTP-NOW=-0.07ms
Frame 18: TimeSinceLastBuffer=0ms PTS=6474529686 NTP-NOW=-0.08ms
Frame 19: TimeSinceLastBuffer=3ms PTS=6515339809 NTP-NOW=-0.07ms
Frame 20: TimeSinceLastBuffer=0ms PTS=6555071934 NTP-NOW=-0.09ms
Frame 21: TimeSinceLastBuffer=3ms PTS=6595869147 NTP-NOW=-0.06ms
Frame 22: TimeSinceLastBuffer=0ms PTS=6635605541 NTP-NOW=-0.05ms
Frame 23: TimeSinceLastBuffer=3ms PTS=6676507886 NTP-NOW=-0.04ms
Frame 24: TimeSinceLastBuffer=510ms PTS=6716189799 NTP-NOW=-0.09ms
Frame 25: TimeSinceLastBuffer=0ms PTS=6757136446 NTP-NOW=-0.14ms
Frame 26: TimeSinceLastBuffer=1ms PTS=6796823428 NTP-NOW=-0.06ms
Frame 27: TimeSinceLastBuffer=2ms PTS=6837754989 NTP-NOW=-0.05ms
Frame 28: TimeSinceLastBuffer=0ms PTS=6877446960 NTP-NOW=-0.05ms
Frame 29: TimeSinceLastBuffer=3ms PTS=6918363675 NTP-NOW=-0.04ms
Frame 30: TimeSinceLastBuffer=0ms PTS=6958060554 NTP-NOW=-0.04ms
Frame 31: TimeSinceLastBuffer=3ms PTS=6998962661 NTP-NOW=-0.04ms
Frame 32: TimeSinceLastBuffer=0ms PTS=7038664371 NTP-NOW=-0.05ms
Frame 33: TimeSinceLastBuffer=3ms PTS=7079258565 NTP-NOW=-0.04ms
Frame 34: TimeSinceLastBuffer=1ms PTS=7119552102 NTP-NOW=-0.03ms
Frame 35: TimeSinceLastBuffer=2ms PTS=7160184354 NTP-NOW=-0.04ms
Frame 36: TimeSinceLastBuffer=0ms PTS=7199843290 NTP-NOW=-0.04ms
Frame 37: TimeSinceLastBuffer=510ms PTS=7240858319 NTP-NOW=-0.13ms
Frame 38: TimeSinceLastBuffer=1ms PTS=7280522690 NTP-NOW=-0.08ms
Frame 39: TimeSinceLastBuffer=1ms PTS=7321521543 NTP-NOW=-0.08ms
Frame 40: TimeSinceLastBuffer=0ms PTS=7361191263 NTP-NOW=-0.04ms
Frame 41: TimeSinceLastBuffer=3ms PTS=7402174198 NTP-NOW=-0.04ms
Frame 42: TimeSinceLastBuffer=0ms PTS=7441849181 NTP-NOW=-0.03ms
Frame 43: TimeSinceLastBuffer=3ms PTS=7482816452 NTP-NOW=-0.04ms
Frame 44: TimeSinceLastBuffer=0ms PTS=7522496615 NTP-NOW=-0.05ms
Frame 45: TimeSinceLastBuffer=3ms PTS=7563448472 NTP-NOW=-0.04ms
Frame 46: TimeSinceLastBuffer=0ms PTS=7603133731 NTP-NOW=-0.03ms
Frame 47: TimeSinceLastBuffer=4ms PTS=7644070420 NTP-NOW=-0.04ms
Frame 48: TimeSinceLastBuffer=0ms PTS=7683760695 NTP-NOW=-0.04ms
Frame 49: TimeSinceLastBuffer=3ms PTS=7724682456 NTP-NOW=-0.04ms
Frame 50: TimeSinceLastBuffer=200ms PTS=7764377667 NTP-NOW=-200.05ms
Frame 51: TimeSinceLastBuffer=311ms PTS=7805284739 NTP-NOW=-0.12ms
Frame 52: TimeSinceLastBuffer=0ms PTS=7844984807 NTP-NOW=-0.05ms
Frame 53: TimeSinceLastBuffer=1ms PTS=7885447487 NTP-NOW=-0.05ms
Frame 54: TimeSinceLastBuffer=0ms PTS=7925366440 NTP-NOW=-0.03ms
Frame 55: TimeSinceLastBuffer=3ms PTS=7965607641 NTP-NOW=-0.03ms
Frame 56: TimeSinceLastBuffer=0ms PTS=8005527886 NTP-NOW=-0.03ms
Frame 57: TimeSinceLastBuffer=3ms PTS=8045765242 NTP-NOW=-0.03ms
Frame 58: TimeSinceLastBuffer=0ms PTS=8085686758 NTP-NOW=-0.03ms
Frame 59: TimeSinceLastBuffer=3ms PTS=8125920333 NTP-NOW=-0.03ms
Frame 60: TimeSinceLastBuffer=0ms PTS=8165843099 NTP-NOW=-0.03ms
Frame 61: TimeSinceLastBuffer=3ms PTS=8206072952 NTP-NOW=-0.03ms
Frame 62: TimeSinceLastBuffer=0ms PTS=8245996949 NTP-NOW=-0.03ms
Frame 63: TimeSinceLastBuffer=200ms PTS=8286223139 NTP-NOW=-197.63ms
Frame 64: TimeSinceLastBuffer=314ms PTS=8326148347 NTP-NOW=-0.18ms
Frame 65: TimeSinceLastBuffer=0ms PTS=8366370932 NTP-NOW=-0.24ms
Frame 66: TimeSinceLastBuffer=2ms PTS=8406297332 NTP-NOW=-0.04ms
Frame 67: TimeSinceLastBuffer=1ms PTS=8446516370 NTP-NOW=-0.05ms
Frame 68: TimeSinceLastBuffer=0ms PTS=8486443943 NTP-NOW=-0.06ms
Frame 69: TimeSinceLastBuffer=2ms PTS=8526659491 NTP-NOW=-0.04ms
Frame 70: TimeSinceLastBuffer=0ms PTS=8566588218 NTP-NOW=-0.04ms
Frame 71: TimeSinceLastBuffer=3ms PTS=8606800331 NTP-NOW=-0.03ms
Frame 72: TimeSinceLastBuffer=0ms PTS=8646730194 NTP-NOW=-0.02ms
Frame 73: TimeSinceLastBuffer=3ms PTS=8686938926 NTP-NOW=-0.03ms
Frame 74: TimeSinceLastBuffer=0ms PTS=8726869907 NTP-NOW=-0.03ms
Frame 75: TimeSinceLastBuffer=3ms PTS=8767075312 NTP-NOW=-0.02ms
Frame 76: TimeSinceLastBuffer=200ms PTS=8807007393 NTP-NOW=-200.11ms
Frame 77: TimeSinceLastBuffer=311ms PTS=8847209525 NTP-NOW=-0.12ms
Frame 78: TimeSinceLastBuffer=0ms PTS=8887142688 NTP-NOW=-0.03ms
Frame 79: TimeSinceLastBuffer=0ms PTS=8927275827 NTP-NOW=-0.04ms
Frame 80: TimeSinceLastBuffer=1ms PTS=8967341599 NTP-NOW=-0.03ms
Frame 81: TimeSinceLastBuffer=1ms PTS=9007406845 NTP-NOW=-0.03ms
Frame 82: TimeSinceLastBuffer=1ms PTS=9047471569 NTP-NOW=-0.03ms
Frame 83: TimeSinceLastBuffer=1ms PTS=9087535775 NTP-NOW=-0.04ms
Frame 84: TimeSinceLastBuffer=1ms PTS=9127599467 NTP-NOW=-0.03ms
Frame 85: TimeSinceLastBuffer=1ms PTS=9167662650 NTP-NOW=-0.04ms
Frame 86: TimeSinceLastBuffer=2ms PTS=9207725327 NTP-NOW=-0.03ms
Frame 87: TimeSinceLastBuffer=3ms PTS=9247849182 NTP-NOW=-0.03ms
Frame 88: TimeSinceLastBuffer=0ms PTS=9287787503 NTP-NOW=-0.03ms
Frame 89: TimeSinceLastBuffer=200ms PTS=9327971063 NTP-NOW=-198.08ms
Frame 90: TimeSinceLastBuffer=302ms PTS=9367910367 NTP-NOW=-0.12ms
Frame 91: TimeSinceLastBuffer=0ms PTS=9408091001 NTP-NOW=-0.18ms
Frame 92: TimeSinceLastBuffer=0ms PTS=9448031273 NTP-NOW=-0.03ms
Frame 93: TimeSinceLastBuffer=2ms PTS=9488209029 NTP-NOW=-0.05ms
Frame 94: TimeSinceLastBuffer=0ms PTS=9528150252 NTP-NOW=-0.05ms
Frame 95: TimeSinceLastBuffer=3ms PTS=9568325175 NTP-NOW=-0.05ms
Frame 96: TimeSinceLastBuffer=0ms PTS=9608267335 NTP-NOW=-0.04ms
Frame 97: TimeSinceLastBuffer=3ms PTS=9648439470 NTP-NOW=-0.15ms
Frame 98: TimeSinceLastBuffer=0ms PTS=9688382552 NTP-NOW=-0.20ms
Frame 99: TimeSinceLastBuffer=3ms PTS=9728551944 NTP-NOW=-0.04ms
Frame 100: TimeSinceLastBuffer=0ms PTS=9768495933 NTP-NOW=-0.04ms

Could someone explain this in more detail?
For now sync-inputs=1 on nvstreammux and sync=true on fakesink solves my issue, but I can’t understand why from the documentation.

9

please find sync-inputs in this link Gst-nvstreammux New — DeepStream 6.2 Release documentation

10

The documentation for sync-inputs does not sufficiently explain this - it is unclear why for batch-size=1 and sync-inputs=0 the buffer is delayed by almost 500ms. For batch size 1, each frame from uridecodebin should trigger a buffer push downstream, because the batch is full.

The observed behaviour though is that the buffers are held back for a significant amount of time - see my measurements.

Also it is unclear why sync-input=1 only has an effect if the pipeline sink has either sync=true or sync=false set.

11

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

sync=true on fakesink, please find it in this link:GstBaseSink
sync-inputs is used to synchronize Inputs, it works with max-latency, When sync-inputs=1, buffers coming in after max-latency shall be dropped.

13

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.