Inconsistent and very long H.264 encoding latency

After read through the all posts.

  • NV profiler shows the pure time cost on encoding, that's why the number is amazing.
  • Back to reality, the camera connects to the pipeline, means the data usually should be synchronized, the latency from the radiance enters the camera, to the signal generated for that frame, it should be larger than 1/FPS time.

Is there anybody tried a 60FPS camera ? Maybe it would be better. With 30fps camera, I think just the time for the camera would be definitely later than 33.333ms + encoding time in BLOCK mode, since everything must be synchronized from end to end.

With CameraLink this should be easy, usually the CameraLink camera could work at 3K@100FPS or higher, so latency of camera is not a problem at all, then just feed the frames to encoder that’s it.

Actually the most important thing is that if the low-level Kernel+API of TX2 around camera works at 60FPS, this would be the electronically issue not about software at all.

But still, the NVIDIA TX2 is not a perfect solution for real realtime application, for better platform I prefer Xilinx or Altera.

It is worth comparing all developer platforms and pick one which matches your usecase.