Abstract:Voice assistant has been widely used for human-computer interaction and automatic meeting minutes. However, for multiple sound sources, the performance of speech recognition in voice assistant decreases dramatically. Therefore, it is crucial to separate multiple voices efficiently for an effective voice assistant application in multi-user scenarios. In this paper, we present a novel voice separation system using a 2D microphone array in multiple sound source scenarios. Specifically, we propose a spatial filtering-based method to iteratively estimate the Angle of Arrival (AoA) of each sound source and separate the voice signals with adaptive beamforming. We use BeamForming-based cross-Correlation (BF-Correlation) to accurately assess the performance of beamforming and automatically optimize the voice separation in the iterative framework. Different from cross-correlation, BF-Correlation further performs cross-correlation among the after-beamforming voice signals processed with each linear microphone array. In this way, the mutual interference from voice signals out of the specified direction can be effectively suppressed or mitigated via the spatial filtering technique. We implement a prototype system and evaluate its performance in real environments. Experimental results show that the average AoA error is 1.4 degree and the average ratio of automatic speech recognition accuracy is 90.2% in the presence of three sound sources.

Far-field Speech Recognition System Based on Circular Microphone-array

Microphone array processing via joint wideband angle-of-arrival estimation and speech feature enhancement

Design and implementation of a speaker recognition system

A unified multichannel far-field speech recognition system: combining neural beamforming with attention based end-to-end model

Service Robot Speech Enhancement Method Using Acoustic Micro-Sensor Array

Far-Field Automatic Speech Recognition

Remote Control System of Spherical Robot Based on Silent Speech Recognition

Using A Steered-Response Power-Phase Transform to Optimize Speech Pickup in Reverberabt Environments

AmbiEar: mmWave Based Voice Recognition in NLoS Scenarios

An Investigation into Using Parallel Data for Far-Field Speech Recognition.

A Dual-Microphone Speech Enhancement Algorithm for Close-Talk System

Design and implementation of smart vehicle auditory perception system

Parallel processing of distributed beamforming and multichannel linear prediction for speech denoising and deverberation in wireless acoustic sensor networks

A Microphone-array De-reverberation Method Using Sidelobe Enhancement

Directional Sound-Capture System with Acoustic Array Based on FPGA

An Efficient and Robust Speech Dereverberation Method Using Spherical Microphone Array

Separating Voices from Multiple Sound Sources Using 2D Microphone Array

Speech Selection and Environmental Adaptation for Asynchronous Speech Recognition

Multi-channel Speech Enhancement in Driving Environment

Vision-aided Speech Recognition System for a Small Four-Legged Robot

Speech Enhancement Using an Equivalent Source Inverse Filtering-Based Microphone Array