Jetson-Voice acceptable Microphone have 3 none work with the docker "OSError: [Errno -9997] Invalid sample rate"

Nick_H · August 10, 2021, 2:44pm

Using dusty_nv github repo on Jetpack 4.5.1 L4T 32.5.1 passes all tests asr.py will read wav file test but accpets nonw of the 3 usb microphones and one bluetooth headset I have attempted to use. All will successfully connect to ubuntu and record to system loopback ect. What am I missing here?

@jetson:/jetson-voice# scripts/list_audio_devices.py 
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.front.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM front
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.rear
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.center_lfe
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.side
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround21
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround21
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround40.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround40
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround41
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround50
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround51
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround71.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround71
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.iec958.0:CARD=0,AES0=4,AES1=130,AES2=0,AES3=2'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM iec958
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.iec958.0:CARD=0,AES0=4,AES1=130,AES2=0,AES3=2'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM spdif
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.iec958.0:CARD=0,AES0=4,AES1=130,AES2=0,AES3=2'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM spdif
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm_dmix.c:1052:(snd_pcm_dmix_open) unable to open slave

----------------------------------------------------
 Audio Input Devices
----------------------------------------------------
Input Device ID 5 - 'jetson-xaviernx-ape: - (hw:1,1)' (inputs=16) (sample_rate=44100)
Input Device ID 6 - 'jetson-xaviernx-ape: - (hw:1,2)' (inputs=16) (sample_rate=44100)
Input Device ID 7 - 'jetson-xaviernx-ape: - (hw:1,3)' (inputs=16) (sample_rate=44100)
Input Device ID 8 - 'jetson-xaviernx-ape: - (hw:1,4)' (inputs=16) (sample_rate=44100)
Input Device ID 9 - 'jetson-xaviernx-ape: - (hw:1,5)' (inputs=16) (sample_rate=44100)
Input Device ID 10 - 'jetson-xaviernx-ape: - (hw:1,6)' (inputs=16) (sample_rate=44100)
Input Device ID 11 - 'jetson-xaviernx-ape: - (hw:1,7)' (inputs=16) (sample_rate=44100)
Input Device ID 12 - 'jetson-xaviernx-ape: - (hw:1,8)' (inputs=16) (sample_rate=44100)
Input Device ID 13 - 'jetson-xaviernx-ape: - (hw:1,9)' (inputs=16) (sample_rate=44100)
Input Device ID 14 - 'jetson-xaviernx-ape: - (hw:1,10)' (inputs=16) (sample_rate=44100)
Input Device ID 15 - 'jetson-xaviernx-ape: - (hw:1,11)' (inputs=16) (sample_rate=44100)
Input Device ID 16 - 'jetson-xaviernx-ape: - (hw:1,12)' (inputs=16) (sample_rate=44100)
Input Device ID 17 - 'jetson-xaviernx-ape: - (hw:1,13)' (inputs=16) (sample_rate=44100)
Input Device ID 18 - 'jetson-xaviernx-ape: - (hw:1,14)' (inputs=16) (sample_rate=44100)
Input Device ID 19 - 'jetson-xaviernx-ape: - (hw:1,15)' (inputs=16) (sample_rate=44100)
Input Device ID 20 - 'jetson-xaviernx-ape: - (hw:1,16)' (inputs=16) (sample_rate=44100)
Input Device ID 21 - 'jetson-xaviernx-ape: - (hw:1,17)' (inputs=16) (sample_rate=44100)
Input Device ID 22 - 'jetson-xaviernx-ape: - (hw:1,18)' (inputs=16) (sample_rate=44100)
Input Device ID 23 - 'jetson-xaviernx-ape: - (hw:1,19)' (inputs=16) (sample_rate=44100)
Input Device ID 24 - 'C-Media USB Audio Device: - (hw:2,0)' (inputs=1) (sample_rate=44100)


----------------------------------------------------
 Audio Output Devices
----------------------------------------------------
Output Device ID 0 - 'tegra-hda-xnx: HDMI 0 (hw:0,3)' (outputs=8) (sample_rate=44100)
Output Device ID 1 - 'tegra-hda-xnx: HDMI 0 (hw:0,7)' (outputs=6) (sample_rate=44100)
Output Device ID 2 - 'tegra-hda-xnx: HDMI 0 (hw:0,8)' (outputs=8) (sample_rate=44100)
Output Device ID 3 - 'tegra-hda-xnx: HDMI 0 (hw:0,9)' (outputs=8) (sample_rate=44100)
Output Device ID 4 - 'jetson-xaviernx-ape: - (hw:1,0)' (outputs=16) (sample_rate=44100)
Output Device ID 5 - 'jetson-xaviernx-ape: - (hw:1,1)' (outputs=16) (sample_rate=44100)
Output Device ID 6 - 'jetson-xaviernx-ape: - (hw:1,2)' (outputs=16) (sample_rate=44100)
Output Device ID 7 - 'jetson-xaviernx-ape: - (hw:1,3)' (outputs=16) (sample_rate=44100)
Output Device ID 8 - 'jetson-xaviernx-ape: - (hw:1,4)' (outputs=16) (sample_rate=44100)
Output Device ID 9 - 'jetson-xaviernx-ape: - (hw:1,5)' (outputs=16) (sample_rate=44100)
Output Device ID 10 - 'jetson-xaviernx-ape: - (hw:1,6)' (outputs=16) (sample_rate=44100)
Output Device ID 11 - 'jetson-xaviernx-ape: - (hw:1,7)' (outputs=16) (sample_rate=44100)
Output Device ID 12 - 'jetson-xaviernx-ape: - (hw:1,8)' (outputs=16) (sample_rate=44100)
Output Device ID 13 - 'jetson-xaviernx-ape: - (hw:1,9)' (outputs=16) (sample_rate=44100)
Output Device ID 14 - 'jetson-xaviernx-ape: - (hw:1,10)' (outputs=16) (sample_rate=44100)
Output Device ID 15 - 'jetson-xaviernx-ape: - (hw:1,11)' (outputs=16) (sample_rate=44100)
Output Device ID 16 - 'jetson-xaviernx-ape: - (hw:1,12)' (outputs=16) (sample_rate=44100)
Output Device ID 17 - 'jetson-xaviernx-ape: - (hw:1,13)' (outputs=16) (sample_rate=44100)
Output Device ID 18 - 'jetson-xaviernx-ape: - (hw:1,14)' (outputs=16) (sample_rate=44100)
Output Device ID 19 - 'jetson-xaviernx-ape: - (hw:1,15)' (outputs=16) (sample_rate=44100)
Output Device ID 20 - 'jetson-xaviernx-ape: - (hw:1,16)' (outputs=16) (sample_rate=44100)
Output Device ID 21 - 'jetson-xaviernx-ape: - (hw:1,17)' (outputs=16) (sample_rate=44100)
Output Device ID 22 - 'jetson-xaviernx-ape: - (hw:1,18)' (outputs=16) (sample_rate=44100)
Output Device ID 23 - 'jetson-xaviernx-ape: - (hw:1,19)' (outputs=16) (sample_rate=44100)
Output Device ID 24 - 'C-Media USB Audio Device: - (hw:2,0)' (outputs=2) (sample_rate=44100)

root@jetson:/jetson-voice# examples/asr.py --mic 24
Namespace(debug=False, default_backend='tensorrt', global_config=None, list_devices=False, list_models=False, log_level='info', mic='24', model='quartznet', model_dir='data/networks', model_manifest='data/networks/manifest.json', profile=False, verbose=False, wav=None)
[NeMo W 2021-08-10 10:34:05 nemo_logging:349] /usr/local/lib/python3.6/dist-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
      warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
    
[2021-08-10 10:34:07] font_manager.py:1423 - Generating new fontManager, this may take some time...
[nltk_data] Downloading package averaged_perceptron_tagger to
[nltk_data]     /root/nltk_data...
[nltk_data]   Unzipping taggers/averaged_perceptron_tagger.zip.
[nltk_data] Downloading package cmudict to /root/nltk_data...
[nltk_data]   Unzipping corpora/cmudict.zip.
[NeMo W 2021-08-10 10:34:10 experimental:28] Module <class 'nemo.collections.asr.data.audio_to_text_dali.AudioToCharDALIDataset'> is experimental, not ready for production and is not fully supported. Use at your own risk.
################################################################################
### WARNING, path does not exist: KALDI_ROOT=/mnt/matylda5/iveselyk/Tools/kaldi-trunk
###          (please add 'export KALDI_ROOT=<your_path>' in your $HOME/.profile)
###          (or run as: KALDI_ROOT=<your_path> python <your_script>.py)
################################################################################

[NeMo W 2021-08-10 10:34:10 nemo_logging:349] /usr/local/lib/python3.6/dist-packages/torchaudio-0.7.0a0+ac17b64-py3.6-linux-aarch64.egg/torchaudio/backend/utils.py:54: UserWarning: "sox" backend is being deprecated. The default backend will be changed to "sox_io" backend in 0.8.0 and "sox" backend will be removed in 0.9.0. Please migrate to "sox_io" backend. Please refer to https://github.com/pytorch/audio/issues/903 for the detail.
      '"sox" backend is being deprecated. '
    
[NeMo I 2021-08-10 10:34:10 features:240] PADDING: 0
[NeMo I 2021-08-10 10:34:10 features:256] STFT using torch
[2021-08-10 10:34:11] resource.py:114 - loading model 'data/networks/asr/quartznet-15x5_en/quartznet.onnx' with jetson_voice.backends.tensorrt.TRTModel
[2021-08-10 10:34:11] trt_model.py:41 - loading cached TensorRT engine from data/networks/asr/quartznet-15x5_en/quartznet.engine
[TensorRT] VERBOSE: Deserialize required 2400033 microseconds.
[2021-08-10 10:34:19] trt_model.py:59 - loaded TensorRT engine from data/networks/asr/quartznet-15x5_en/quartznet.engine

binding 0 - 'audio_signal'
   input:    True
   shape:    (1, 64, -1)
   dtype:    DataType.FLOAT
   size:     -256
   dynamic:  True
   profiles: [{'min': (1, 64, 10), 'opt': (1, 64, 150), 'max': (1, 64, 300)}]


binding 1 - 'logprobs'
   input:    False
   shape:    (1, -1, 29)
   dtype:    DataType.FLOAT
   size:     -116
   dynamic:  True
   profiles: []

[2021-08-10 10:34:19] ctc_beamsearch.py:51 - creating CTCBeamSearchDecoder
[2021-08-10 10:34:19] ctc_beamsearch.py:52 - {'add_punctuation': True,
 'alpha': 0.7,
 'beam_width': 32,
 'beta': 0.0,
 'cutoff_prob': 1.0,
 'cutoff_top_n': 40,
 'language_model': 'data/networks/asr/quartznet-15x5_en/lm.bin',
 'timestep_offset': 5,
 'top_k': 3,
 'type': 'beamsearch',
 'vad_eos_duration': 0.65,
 'word_threshold': -1000.0}
[2021-08-10 10:34:23] asr_engine.py:128 - CTC decoder type: 'beamsearch'
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.front.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM front
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.rear
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.center_lfe
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.side
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround21
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround21
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround40.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround40
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround41
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround50
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround51
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround71.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround71
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.iec958.0:CARD=0,AES0=4,AES1=130,AES2=0,AES3=2'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM iec958
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.iec958.0:CARD=0,AES0=4,AES1=130,AES2=0,AES3=2'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM spdif
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.iec958.0:CARD=0,AES0=4,AES1=130,AES2=0,AES3=2'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM spdif
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm_dmix.c:1052:(snd_pcm_dmix_open) unable to open slave
Audio Input Device:
{'defaultHighInputLatency': 0.034829931972789115,
 'defaultHighOutputLatency': 0.034829931972789115,
 'defaultLowInputLatency': 0.008684807256235827,
 'defaultLowOutputLatency': 0.008684807256235827,
 'defaultSampleRate': 44100.0,
 'hostApi': 0,
 'index': 24,
 'maxInputChannels': 1,
 'maxOutputChannels': 2,
 'name': 'C-Media USB Audio Device: - (hw:2,0)',
 'structVersion': 2}
Expression 'paInvalidSampleRate' failed in 'src/hostapi/alsa/pa_linux_alsa.c', line: 2048
Expression 'PaAlsaStreamComponent_InitialConfigure( &self->capture, inParams, self->primeBuffers, hwParamsCapture, &realSr )' failed in 'src/hostapi/alsa/pa_linux_alsa.c', line: 2719
Expression 'PaAlsaStream_Configure( stream, inputParameters, outputParameters, sampleRate, framesPerBuffer, &inputLatency, &outputLatency, &hostBufferSizeMode )' failed in 'src/hostapi/alsa/pa_linux_alsa.c', line: 2843
Traceback (most recent call last):
  File "examples/asr.py", line 33, in <module>
    for samples in stream:
  File "/jetson-voice/jetson_voice/utils/audio.py", line 174, in __iter__
    self.open()
  File "/jetson-voice/jetson_voice/utils/audio.py", line 146, in open
    frames_per_buffer=self.chunk_size)
  File "/usr/local/lib/python3.6/dist-packages/pyaudio.py", line 750, in open
    stream = Stream(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/pyaudio.py", line 441, in __init__
    self._stream = pa.open(**arguments)
OSError: [Errno -9997] Invalid sample rate

dusty_nv · August 10, 2021, 7:07pm

Hi @Nick_H, it wasn’t able to open the mic with a sampling rate of 16,000Hz (which is what the ASR uses)

Today I implemented microphone resampling, so it will try to open the mic at other supported sampling rates and then downsample as necessary - see commit 9eb5e

To try it, run the following to update your repo:

$ cd /path/to/your/jetson-voice
$ git pull origin master
$ sudo docker pull dustynv/jetson-voice:r32.5.0

Let me know if this works for you with your microphones.

Nick_H · August 10, 2021, 8:03pm

root@jetson:/jetson-voice# examples/asr.py --mic 24
Namespace(debug=False, default_backend='tensorrt', global_config=None, list_devices=False, list_models=False, log_level='info', mic='24', model='quartznet', model_dir='/jetson-voice/data/networks', model_manifest='/jetson-voice/data/networks/manifest.json', profile=False, verbose=False, wav=None)
[NeMo W 2021-08-10 16:00:29 nemo_logging:349] /usr/local/lib/python3.6/dist-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
      warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
    
[NeMo W 2021-08-10 16:00:32 experimental:28] Module <class 'nemo.collections.asr.data.audio_to_text_dali.AudioToCharDALIDataset'> is experimental, not ready for production and is not fully supported. Use at your own risk.
################################################################################
### WARNING, path does not exist: KALDI_ROOT=/mnt/matylda5/iveselyk/Tools/kaldi-trunk
###          (please add 'export KALDI_ROOT=<your_path>' in your $HOME/.profile)
###          (or run as: KALDI_ROOT=<your_path> python <your_script>.py)
################################################################################

[NeMo W 2021-08-10 16:00:32 nemo_logging:349] /usr/local/lib/python3.6/dist-packages/torchaudio-0.7.0a0+ac17b64-py3.6-linux-aarch64.egg/torchaudio/backend/utils.py:54: UserWarning: "sox" backend is being deprecated. The default backend will be changed to "sox_io" backend in 0.8.0 and "sox" backend will be removed in 0.9.0. Please migrate to "sox_io" backend. Please refer to https://github.com/pytorch/audio/issues/903 for the detail.
      '"sox" backend is being deprecated. '
    
[NeMo I 2021-08-10 16:00:32 features:240] PADDING: 0
[NeMo I 2021-08-10 16:00:32 features:256] STFT using torch
[2021-08-10 16:00:32] resource.py:114 - loading model '/jetson-voice/data/networks/asr/quartznet-15x5_en/quartznet.onnx' with jetson_voice.backends.tensorrt.TRTModel
[2021-08-10 16:00:32] trt_model.py:41 - loading cached TensorRT engine from /jetson-voice/data/networks/asr/quartznet-15x5_en/quartznet.engine
[TensorRT] VERBOSE: Deserialize required 2419501 microseconds.
[2021-08-10 16:00:41] trt_model.py:59 - loaded TensorRT engine from /jetson-voice/data/networks/asr/quartznet-15x5_en/quartznet.engine

binding 0 - 'audio_signal'
   input:    True
   shape:    (1, 64, -1)
   dtype:    DataType.FLOAT
   size:     -256
   dynamic:  True
   profiles: [{'min': (1, 64, 10), 'opt': (1, 64, 150), 'max': (1, 64, 300)}]


binding 1 - 'logprobs'
   input:    False
   shape:    (1, -1, 29)
   dtype:    DataType.FLOAT
   size:     -116
   dynamic:  True
   profiles: []

[2021-08-10 16:00:41] ctc_beamsearch.py:51 - creating CTCBeamSearchDecoder
[2021-08-10 16:00:41] ctc_beamsearch.py:52 - {'add_punctuation': True,
 'alpha': 0.7,
 'beam_width': 32,
 'beta': 0.0,
 'cutoff_prob': 1.0,
 'cutoff_top_n': 40,
 'language_model': '/jetson-voice/data/networks/asr/quartznet-15x5_en/lm.bin',
 'timestep_offset': 5,
 'top_k': 3,
 'type': 'beamsearch',
 'vad_eos_duration': 0.65,
 'word_threshold': -1000.0}
[2021-08-10 16:00:45] asr_engine.py:128 - CTC decoder type: 'beamsearch'
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.front.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM front
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.rear
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.center_lfe
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.side
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround21
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround21
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround40.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround40
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround41
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround50
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround51.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround51
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.surround71.0:CARD=0'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM surround71
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.iec958.0:CARD=0,AES0=4,AES1=130,AES2=0,AES3=2'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM iec958
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.iec958.0:CARD=0,AES0=4,AES1=130,AES2=0,AES3=2'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM spdif
ALSA lib confmisc.c:1281:(snd_func_refer) Unable to find definition 'cards.tegra-hda-xnx.pcm.iec958.0:CARD=0,AES0=4,AES1=130,AES2=0,AES3=2'
ALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM spdif
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.hdmi
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline
ALSA lib pcm_dmix.c:1052:(snd_pcm_dmix_open) unable to open slave
Audio Input Device:
{'defaultHighInputLatency': 0.034829931972789115,
 'defaultHighOutputLatency': 0.034829931972789115,
 'defaultLowInputLatency': 0.008684807256235827,
 'defaultLowOutputLatency': 0.008684807256235827,
 'defaultSampleRate': 44100.0,
 'hostApi': 0,
 'index': 24,
 'maxInputChannels': 2,
 'maxOutputChannels': 2,
 'name': 'TASCAM DR Series: USB Audio (hw:2,0)',
 'structVersion': 2}
[2021-08-10 16:00:45] audio.py:156 - trying to open audio input 24 with sample_rate=16000 chunk_size=16000
Expression 'paInvalidSampleRate' failed in 'src/hostapi/alsa/pa_linux_alsa.c', line: 2048
Expression 'PaAlsaStreamComponent_InitialConfigure( &self->capture, inParams, self->primeBuffers, hwParamsCapture, &realSr )' failed in 'src/hostapi/alsa/pa_linux_alsa.c', line: 2719
Expression 'PaAlsaStream_Configure( stream, inputParameters, outputParameters, sampleRate, framesPerBuffer, &inputLatency, &outputLatency, &hostBufferSizeMode )' failed in 'src/hostapi/alsa/pa_linux_alsa.c', line: 2843
[Errno -9997] Invalid sample rate
[2021-08-10 16:00:45] audio.py:172 - failed to open audio input 24 with sample_rate=16000
[2021-08-10 16:00:45] audio.py:156 - trying to open audio input 24 with sample_rate=44100 chunk_size=44100

audio stream opened on device 24 (TASCAM DR Series: USB Audio (hw:2,0))
you can begin speaking now... (press Ctrl+C to exit)

[NeMo W 2021-08-10 16:00:48 patch_utils:50] torch.stft() signature has been updated for PyTorch 1.7+
    Please update PyTorch to remain compatible with later versions of NeMo.
that did
that did the trick
that did the trick.

great job
great joust
great joust.

great
great job
great job dusty
great job dusty.

dusty_nv · August 10, 2021, 8:41pm

Nice - glad you got it working!

Nick_H · August 10, 2021, 11:27pm

Thanks for the assistance in getting to a starting point.

system · October 9, 2021, 11:27pm

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Voice Demo Container for Jetson Xavier NX not working Jetson Xavier NX audio	11	1910	October 18, 2021
Jetson-voice on nx whats the trick Jetson Xavier NX jetson-inference	4	677	October 17, 2021
Jetson_voice container USB mic [Errno -9997] Invalid sample rate Jetson Xavier NX jetson-inference	4	694	October 3, 2021
Jetson HDMI no sound Jetson TK1	5	3751	April 24, 2017
USB Mic overload/wrong rate when updated from JetPack 3.3 to JetPack 4.2 Jetson TX2	12	1654	October 18, 2021
How to access USB speaker from within a docker container? Jetson AGX Orin audio , docker	4	837	April 21, 2024
Audio input to Xavier Jetson AGX Xavier	2	905	October 18, 2021
I2s mic with tx2 Jetson TX2	37	8058	October 18, 2021
ARECORD fails to work even after NVIDIA-recommended configuration updates Jetson TK1	3	879	November 16, 2016
Mic Problem in JETSON TK1 Jetson TK1	7	877	October 18, 2021

Jetson-Voice acceptable Microphone have 3 none work with the docker "OSError: [Errno -9997] Invalid sample rate"

Related topics