Abstract:Fusing the advantages of multiple acoustic features is important for the robustness of voice activity detection (VAD). Recently, the machine-learning-based VADs have shown a superiority to traditional VADs on multiple feature fusion tasks. However, existing machine-learning-based VADs only utilize shallow models, which cannot explore the underlying manifold of the features. In this paper, we propose to fuse multiple features via a deep model, called deep belief network (DBN). DBN is a powerful hierarchical generative model for feature extraction. It can describe highly variant functions and discover the manifold of the features. We take the multiple serially-concatenated features as the input layer of DBN, and then extract a new feature by transferring these features through multiple nonlinear hidden layers. Finally, we predict the class of the new feature by a linear classifier. We further analyze that even a single-hidden-layer-based belief network is as powerful as the state-of-the-art models in the machine-learning-based VADs. In our empirical comparison, ten common features are used for performance analysis. Extensive experimental results on the AURORA2 corpus show that the DBN-based VAD not only outperforms eleven referenced VADs, but also can meet the real-time detection demand of VAD. The results also show that the DBN-based VAD can fuse the advantages of multiple features effectively.

Efficient Multiple Kernel Support Vector Machine Based Voice Activity Detection

Applying Support Vector Machines to Voice Activity Detection

A Novel and Efficient Voice Activity Detector Using Shape Features of Speech Wave.

Maximum Margin Clustering Based Statistical VAD with Multiple Observation Compound Feature.

Accelerate Training By Dwt In Speaker Identification Using Svms

Support Vector Machine Based VAD Using the Multiple Observation Compound Feature

A Multi-Class Large Margin Classifier

A Novel Data Description Kernel Based on One-Class SVM for Speaker Verification

An Ensemble SVM-based Approach for Voice Activity Detection

Multimodal Voice Activity Detection

Deep Belief Networks Based Voice Activity Detection

An efficient voice activity detection algorithm by combining statistical model and energy detection

Speech enhancement aided end-to-end multi-task learning for voice activity detection

MK-MSMCR: An efficient multiple kernel approach to multi-class classification

Voice Activity Detection Using Wavelets Multiresolution Spectrum and Short-time Adaptive Audio Mixing Algorithm

Voice Activity Detection Based on Wavelet Multiresolution Spectrum

Advancing VAD Systems Based on Multi-Task Learning with Improved Model Structures

A New Vad Framework Using Statistical Model And Human Knowledge Based Empirical Rule

Online Kernel-Based Structured Output SVM for Early Expression Detection

SVVAD: Personal Voice Activity Detection for Speaker Verification