Latency issue: nvv4l2h265enc accumulates four images before releasing the first

Hi,
Running the test app we see encoder will have buffer accumulation at beginning and then catch up with frame rate:

nvidia@nvidia-desktop:~$ ./test
Using launch string: appsrc name=mysource ! video/x-raw,width=7200,height=6000,framerate=30/1,format=NV12 ! nvvidconv ! video/x-raw(memory:NVMM),format=NV12 ! nvv4l2h265enc maxperf-enable=1 ! appsink name=mysink
Opening in BLOCKING MODE
fed one buffer
NvMMLiteOpen : Block : BlockType = 8
===== NVMEDIA: NVENC =====
NvMMLiteBlockCreate : Block : BlockType = 8
fed one buffer
fed one buffer
NVMEDIA: H265 : Profile : 1
fed one buffer
fed one buffer
map.size = 120946
map.size = 81944
fed one buffer
map.size = 52171
fed one buffer
map.size = 46475
fed one buffer
map.size = 20833
fed one buffer
map.size = 13637
fed one buffer
map.size = 11633
fed one buffer
map.size = 10926    // feed one buffer and
map.size = 1219     // receive two encoded frames 
fed one buffer
map.size = 1815
fed one buffer
map.size = 1210
fed one buffer
map.size = 6003
fed one buffer
map.size = 42782
going to exit

So the buffer accumulation is at beginning due to large resolution and then encoder is up and running to catch up with source frame rate. The verified cases are listed in module data sheet:
https://developer.nvidia.com/jetson-xavier-nx-data-sheet

The verified use-case is 4Kp60. 8K is not tested but it should be good to achieve 30fps. 60ms look to be average encoding speed for 7200x6000(take 60ms to encode one 7200x6000 frame).

For single input source this should not trigger the latency. If you have concern please try to run hardware converter fixed at max clock:
Nvvideoconvert issue, nvvideoconvert in DS4 is better than Ds5? - #3 by DaneLLL