Abstract:Voice activity detection (VAD) is an important topic in audio signal processing. Contextual information is important for improving the performance of VAD at low signal-to-noise ratios. Here we explore contextual information by machine learning methods at three levels. At the top level, we employ an ensemble learning framework, named multi-resolution stacking (MRS), which is a stack of ensemble classifiers. Each classifier in a building block inputs the concatenation of the predictions of its lower building blocks and the expansion of the raw acoustic feature by a given window (called a resolution). At the middle level, we describe a base classifier in MRS, named boosted deep neural network (bDNN). bDNN first generates multiple base predictions from different contexts of a single frame by only one DNN and then aggregates the base predictions for a better prediction of the frame, and it is different from computationally-expensive boosting methods that train ensembles of classifiers for multiple base predictions. At the bottom level, we employ the multi-resolution cochleagram feature, which incorporates the contextual information by concatenating the cochleagram features at multiple spectrotemporal resolutions. Experimental results show that the MRS-based VAD outperforms other VADs by a considerable margin. Moreover, when trained on a large amount of noise types and a wide range of signal-to-noise ratios, the MRS-based VAD demonstrates surprisingly good generalization performance on unseen test scenarios, approaching the performance with noise-dependent training.

Voice Activity Detection Based on Time-Delay Neural Networks

A Novel and Efficient Voice Activity Detector Using Shape Features of Speech Wave.

DNN-based Voice Activity Detection for Speaker Recognition

Applying Support Vector Machines to Voice Activity Detection

Bimodal Recurrent Neural Network for Audiovisual Voice Activity Detection

Multi-task Joint-Learning for Robust Voice Activity Detection

Deep Learning Approaches for Voice Activity Detection

A Universal VAD Based on Jointly Trained Deep Neural Networks.

A Real-Time Voice Activity Detection Based On Lightweight Neural

Phase Aware Deep Neural Network For Noise Robust Voice Activity Detection

Boosting Contextual Information for Deep Neural Network Based Voice Activity Detection

End-to-End Speaker-Dependent Voice Activity Detection

A Voice Activity Detection Method Based on DWT-MVNPDF

Real-Life Voice Activity Detection Based on Audio-Visual Alignment.

Multimodal Voice Activity Detection

Efficient voice activity detection algorithm based on sub-band temporal envelope and sub-band long-term signal variability

Denoising Deep Neural Networks Based Voice Activity Detection

Real-Time Causal Spectro-Temporal Voice Activity Detection Based on Convolutional Encoding and Residual Decoding

Temporal Modeling Using Dilated Convolution and Gating for Voice-Activity-Detection

An improved noise-robust voice activity detector based on hidden semi-Markov models

Voice Activity Detection Algorithm Based on Improved Radial Basis Function Neural Network