Hi,
It is possible and the bottleneck can be in memory IO. You can run $ sudo tegrastats to check if EMC is close to 100% loading.
To have maximum performance, please execute $ sudo jetson_clocks and enable VIC at maximum frequency:
Nvvideoconvert issue, nvvideoconvert in DS4 is better than Ds5? - #3 by DaneLLL