CUDA Video Decoding with Audio

Accelerated Computing CUDA CUDA Programming and Performance
1

Greetings. I’ve adapted the cudaDecodeGL example for my needs, and the video seems to work quite well. Now, however, I need to move on to decoding the audio, which the cudaDecodeGL example project doesn’t address at all. I imagine I’d have to decode each packet with something like fmod, save it to a queue, stream the decoded packets with something like RTAudio, and find a way to keep everything in sync. It’s a fair amount of work, so in the hopes of not reinventing the wheel, my questions are these:

  1. Is there an easier way to do it, perhaps one that takes advantage of the GPU?

  2. Does any sample code exist that addresses how to deal with the audio packets returned by the audio data handler?

Thanks to anyone who might be able to help,

Danny Rosenberg
META/DMA

2

Greetings. I’ve adapted the cudaDecodeGL example for my needs, and the video seems to work quite well. Now, however, I need to move on to decoding the audio, which the cudaDecodeGL example project doesn’t address at all. I imagine I’d have to decode each packet with something like fmod, save it to a queue, stream the decoded packets with something like RTAudio, and find a way to keep everything in sync. It’s a fair amount of work, so in the hopes of not reinventing the wheel, my questions are these:

  1. Is there an easier way to do it, perhaps one that takes advantage of the GPU?

  2. Does any sample code exist that addresses how to deal with the audio packets returned by the audio data handler?

Thanks to anyone who might be able to help,

Danny Rosenberg
META/DMA

3

I would also be interested…

Audio decoding and re-encoding is not probbaly that time consuming… Video encoding takes a lot of time and hence requires GPU power.
May be, you should encode video in GPU and audio on CPU and merge them together to keep them all in sync…

In any case, I am gonna track this topic… Thanks,

4

I would also be interested…

Audio decoding and re-encoding is not probbaly that time consuming… Video encoding takes a lot of time and hence requires GPU power.
May be, you should encode video in GPU and audio on CPU and merge them together to keep them all in sync…

In any case, I am gonna track this topic… Thanks,