Abstract:Speech enhancement and automatic speech recognition (ASR) are most often evaluated in matched (or multi-condition) settings where the acoustic conditions of the training data match (or cover) those of the test data. Few studies have systematically assessed the impact of acoustic mismatches between training and test data, especially concerning recent speech enhancement and state-of-the-art ASR techniques. In this article, we study this issue in the context of the CHiME-3 dataset, which consists of sentences spoken by talkers situated in challenging noisy environments recorded using a 6-channel tablet based microphone array. We provide a critical analysis of the results published on this dataset for various signal enhancement, feature extraction, and ASR backend techniques and perform a number of new experiments in order to separately assess the impact of different noise environments, different numbers and positions of microphones, or simulated vs. real data on speech enhancement and ASR performance. We show that, with the exception of minimum variance distortionless response (MVDR) beamforming, most algorithms perform consistently on real and simulated data and can benefit from training on simulated data. We also find that training on different noise environments and different microphones barely affects the ASR performance, especially when several environments are present in the training data: only the number of microphones has a significant impact. Based on these results, we introduce the CHiME-4 Speech Separation and Recognition Challenge, which revisits the CHiME-3 dataset and makes it more challenging by reducing the number of microphones available for testing.

Comparison of Reference Microphone Selection Algorithms for Distributed Microphone Array Based Speech Enhancement in Meeting Recognition Scenarios

Microphone array processing via joint wideband angle-of-arrival estimation and speech feature enhancement

Channel selection using neural network posterior probability for speech recognition with distributed microphone arrays in everyday environments

Meeting Transcription Using Virtual Microphone Arrays

Reference Channel Selection by Multi-Channel Masking for End-to-End Multi-Channel Speech Enhancement

An analysis of environment, microphone and data simulation mismatches in robust speech recognition

Distributed speech separation in spatially unconstrained microphone arrays

Conferencingspeech Challenge: Towards Far-Field Multi-Channel Speech Enhancement for Video Conferencing

Attention-based distributed speech enhancement for unconstrained microphone arrays with varying number of nodes

Speech Enhancement Using an Equivalent Source Inverse Filtering-Based Microphone Array

Joint model-based recognition and localization of overlapped acoustic events using a set of distributed small microphone arrays

Joint Beamforming and Speaker-Attributed ASR for Real Distant-Microphone Meeting Transcription

Speech Selection and Environmental Adaptation for Asynchronous Speech Recognition

A two-stage speaker extraction algorithm under adverse acoustic conditions using a single-microphone

PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays

Realistic multi-microphone data simulation for distant speech recognition

Flexible Multichannel Speech Enhancement for Noise-Robust Frontend

A Comparative Study on Multichannel Speaker-Attributed Automatic Speech Recognition in Multi-party Meetings

Microphone Clustering and BP Network based Acoustic Source Localization in Distributed Microphone Arrays

Distributed-microphones based in-vehicle speech enhancement via sparse and low-rank spectrogram decomposition

Dereverberation for Speaker Identification in Meeting