Hardware - GPU (NVIDIA GeForce RTX 2080 Ti)
Hardware - CPU
Operating System - Ubuntu 20.04.6 LTS
Riva Version - riva_quickstart_v2.10.0
I am working on this Speech to text problem in which I am receiving audio buffers continuously from flask_socketio. I can get any reference or example file or tutorial on nvidia plateform, where I can make this done.
I have done all steps for riva,
bash riva_init.sh - DONE successfully
bash riva_start.sh - DONE successfully
My riva server is running on auth = riva.client.Auth(uri=‘localhost:50051’)
I checked this by running example notebooks, those are working fine for transcription.
For reference, which I have tried, I am linking my code.
from riva.client.argparse_utils import add_asr_config_argparse_parameters, add_connection_argparse_parameters
import riva.client.audio_io
import riva.client
auth = riva.client.Auth(uri='localhost:50051')
riva_asr = riva.client.ASRService(auth)
app = Flask(__name__)
cors = CORS(app, resources={r"/*": {"origins": "*"}})
app.config['SECRET_KEY'] = 'secret!'
Payload.max_decode_packets = 5000
socket_ = SocketIO(app, async_mode=None, cors_allowed_origins="*")
config = riva.client.StreamingRecognitionConfig(
config=riva.client.RecognitionConfig(
encoding=riva.client.AudioEncoding.LINEAR_PCM,
language_code="en-US",
max_alternatives=1,
profanity_filter=True,#args.profanity_filter,
enable_automatic_punctuation=True,#args.automatic_punctuation,
# verbatim_transcripts=not args.no_verbatim_transcripts,
sample_rate_hertz=16000,#args.sample_rate_hz,
audio_channel_count=1,
),
interim_results=True,
)
@socket_.on('file_data', namespace='/')
def file_data(message):
global number
global silence_threshold
global asr_best_transcript
try:
session['receive_count'] = session.get('receive_count', 0) + 1
emit('file_data', message)
## HERE "message" is variable where I am getting audio buffers.
riva.client.print_streaming(
responses=riva_asr.streaming_response_generator(
audio_chunks=message,
streaming_config=config,
),
show_intermediate=True,
)
except Exception as e:
print("file Data exception: ", str(e))
if __name__ == '__main__':
socket_.run(app, host='0.0.0.0', port=4000, debug=False)
This code currently giving me this error,
file Data exception: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNKNOWN
details = "Exception iterating requests!"
debug_error_string = "None"
>
Looking forward for any help from community, experts. Thanks