Faster-whisper with CUDA 11.4

Robotics & Edge Computing Robotics - Isaac Isaac Gym
,
1

Hi All

I was wondering if anybody had experience of building faster-whisper (allowing CUDA) on Ubuntu 20.04.

I have a Jetson Orin Nano. Have installed CUDA 11.4.315 , using the Jetson Hacks method. And have confirmed it to be working.

Unfortunately when I install faster-whisper using PIP, it only allows ‘device=“cpu”’ to be used for defining the model. If i use “device=‘cuda’” the error explains to me that faster-whisper and CTranslate2 have not been compiled for CUDA.

I have tried numerous times to compile both CTranslate2 (v3.24.0) and faster-whisper with the compiled CTranslate2 version, using both official documentation as well as any blogs or web-sites which may help. But I am having no luck and am feeling well out of my depth.

Hence the apologetic message on this forum:

I was wondering if anyone had experience in compiling both CTranslate2 and faster-whisper, compliant for use with CUDA 11.4 om Ubuntu 20.04?

I appreciate any assistance you can give me on this, many thanks.

Dave B