Decoding byte streams

Hello everyone,

Very new to the community and the topic, so please forgive any silly question.

I have multiple byte streams of mp4 videos (downloaded from the cloud) and would like to do efficient gpu decoding for deep learning applications. In the doc, I’ve only seen examples where the decoder is fed packets from an nvc demuxer.
Is there any option to decode the stream directly (a la pyav)?

Cheers

Decoding in python?! Come on. Why not use ffmpeg??