Xavier NX: SW support for Noise cancellation with Single I2S mic

[prasanth.gunaseelan]

Hi Team,

We are working on a Xavier NX based solution where we require to run ML models to check for abnormal sounds(crashes,gunshots).For that we are planning to use a single i2s mic and use native tegra xbar codec to achieve the noise reduction.Can you please let us know if APE in Xavier NX capable of the same and if so please let us know if there is any specifc guide for the same.

We already checked the Audio Setup and Development — NVIDIA Jetson Linux Developer Guide 1 documentation for any inputs.But there is no inputs on the same.So please let us know your inputs on the same.

[mkumard]

Hi Prasanth,
APE doesn’t support noise reduction logic or algorithm. You may need to perform it externally after receiving data from I2S Mic.

[jaivishnu.m]

Hi mkumard,

Greetings of the day

we have gone through the Xavier TRM and have got some inputs like ADSP can use Algorithm-based Audio Processing.

we would like to know whether if we use I2S mic in I2S5, can it utilize the DSP mentioned above in the APE with algorithm loaded externally.

(or)

we will be needing a dedicated DSP to perform the NC.

Regards,
Jai

[mkumard]

Hi Jaivishnu,
ADSP is not fully productized as part of current Jetpack releases, though the nodes are enabled by default in DT. This would limit the technical support for ADSP for current releases.

Yes, I agree either ADSP or Main CPU with external NC algorithm shall be ported to realize your usecase.

How about porting the NC on Main CPU?.

[mkumard]

Hi Jaivishnu,
Please check if the below ALSA Plugin would help your case.

alsa_rnnoise: RNNoise based noise removal plugin for ALSA

Please note. This plugin is not part JP SDK release. You might need to port it manually if it worth to try.