Abstract:Voice activity detection (VAD) is an important topic in audio signal processing. Contextual information is important for improving the performance of VAD at low signal-to-noise ratios. Here we explore contextual information by machine learning methods at three levels. At the top level, we employ an ensemble learning framework, named multi-resolution stacking (MRS), which is a stack of ensemble classifiers. Each classifier in a building block inputs the concatenation of the predictions of its lower building blocks and the expansion of the raw acoustic feature by a given window (called a resolution). At the middle level, we describe a base classifier in MRS, named boosted deep neural network (bDNN). bDNN first generates multiple base predictions from different contexts of a single frame by only one DNN and then aggregates the base predictions for a better prediction of the frame, and it is different from computationally-expensive boosting methods that train ensembles of classifiers for multiple base predictions. At the bottom level, we employ the multi-resolution cochleagram feature, which incorporates the contextual information by concatenating the cochleagram features at multiple spectrotemporal resolutions. Experimental results show that the MRS-based VAD outperforms other VADs by a considerable margin. Moreover, when trained on a large amount of noise types and a wide range of signal-to-noise ratios, the MRS-based VAD demonstrates surprisingly good generalization performance on unseen test scenarios, approaching the performance with noise-dependent training.

DNN-based Voice Activity Detection for Speaker Recognition

A Novel and Efficient Voice Activity Detector Using Shape Features of Speech Wave.

Deep Learning Approaches for Voice Activity Detection

Phase Aware Deep Neural Network For Noise Robust Voice Activity Detection

Applying Support Vector Machines to Voice Activity Detection

Voice Activity Detection Based on Time-Delay Neural Networks

End-to-End Speaker-Dependent Voice Activity Detection

Denoising Deep Neural Networks Based Voice Activity Detection

A Universal VAD Based on Jointly Trained Deep Neural Networks.

Speech recognition method based on DNN-LSTM combined with Wiener filtering algorithm

Boosted deep neural networks and multi-resolution cochleagram features for voice activity detection.

Multi-task Joint-Learning for Robust Voice Activity Detection

Bimodal Recurrent Neural Network for Audiovisual Voice Activity Detection

Voice Activity Detection Algorithm Based on Improved Radial Basis Function Neural Network

Robust Voice Activity Detection Using a Masked Auditory Encoder Based Convolutional Neural Network.

Voice activity detection based on speech enhancement method

Boosting Contextual Information for Deep Neural Network Based Voice Activity Detection

Deep Belief Networks Based Voice Activity Detection

Joint Training ResCNN-based Voice Activity Detection with Speech Enhancement.

A Comparative Study of Robustness of Deep Learning Approaches for VAD

An energy-efficient voice activity detector using reconfigurable Gaussian base normalization deep neural network