Compression-aware AI training for AV pipelines us

Interesting to see CABR acceleration support added directly into the NVENC SDK workflow.

What caught my attention recently is the shift from:
“compression without hurting AI”
toward:
“compression-aware AI training.”

Beamr’s latest research around compressed AV datasets and depth estimation robustness raises an interesting question for large-scale Physical AI systems:

Could compression eventually become part of model optimization instead of only storage optimization?

Especially in AV / robotics pipelines dealing with:

  • petabyte-scale video datasets

  • GPU bottlenecks

  • distributed training

  • simulation/replay workflows

The dSPACE RTMaps validation and CABR support inside NVENC workflows make this direction even more interesting from an infrastructure perspective.

Curious how engineers here view the future of:

  • ML-safe compression

  • compression-aware training

  • and hardware-accelerated AI video pipelines.

Hi @gemenleonardo, thanks for the thoughtful post!

This belongs in the Video Codec, PyNv & OFA category - the team that owns CABR and the encoder workflow you’re describing is much better positioned to engage on compression-aware training, ML-safe codec parameters, and how that ties into AV data pipelines than the TensorRT category, which is focused on engine build, optimization, and inference runtime questions.

I’m moving the topic over to:

Thanks, Atharva