Abstract:The performance of traditional voice activity detectors significantly deteriorates in the presence of highly nonstationary noise and transient interferences. One solution is to incorporate a video signal which is invariant to the acoustic environment. Although several voice activity detectors based on the video signal were recently presented, merely few detectors which are based on both the audio and the video signals exist in the literature to date. In this paper, we present an audio-visual voice activity detector and show that the incorporation of both audio and video signals is highly beneficial for voice activity detection. The algorithm is based on a supervised learning procedure, and a labeled training data set is considered. The algorithm comprises a feature extraction procedure, where the features are designed to separate speech from nonspeech frames. Diffusion maps is applied separately and similarly to the features of each modality and builds a low dimensional representation. Using the new representation, we propose a measure for voice activity which is based on a supervised learning procedure and the variability between adjacent frames in time. The measures of the two modalities are merged to provide voice activity detection based on both the audio and the video signals. Experimental results demonstrate the improved performance of the proposed algorithm compared to state-of-the-art detectors.

Voice Activity Detection Algorithm Based on Likelihood Ratio Test

A Novel and Efficient Voice Activity Detector Using Shape Features of Speech Wave.

Voice Activity Detection Algorithm with Low Signal-to-noise Ratios Based on the Spectrum Entropy

An Algorithm of Voice Activity Detection Based on Noise Estimation

Voice Activity Detection Based on LPCC and Spectrum Entropy

Applying Support Vector Machines to Voice Activity Detection

An efficient voice activity detection algorithm by combining statistical model and energy detection

Improved Voice Activity Detection Based on Long-term Spectral Divergence and Pitch Ratio Features

An Impulse Noise Robust Voice Activity Detection Algorithm Applied For Low Signal-To-Noise Ratio Digital Communication

Efficient voice activity detection algorithm based on sub-band temporal envelope and sub-band long-term signal variability

An Effective Voice Activity Detection Algorithm in Mobile Communication Corrupted by Impulse Noise

Voice Activity Detection Algorithm Based on Energy and Discrimination Entropy

Enhancement Algorithm for Low Signal to Noise Ratio Speech

Robust Voice Activity Detection based on Pitch and Sub-band Energy

Voice Activity Detection Based on Wavelet Multiresolution Spectrum

VAD Based on Speech Presence Probability

Fuzzy Clustering and Bayesian Information Criterion Based Threshold Estimation for Robust Voice Activity Detection.

Voice Activity Detection Using Wavelets Multiresolution Spectrum and Short-time Adaptive Audio Mixing Algorithm

Improved Recovery Algorithm for Unvoiced/voiced Parameters Based on GMM

Improved voice activity detection algorithm based on cross-entropy

Audio-visual voice activity detection using diffusion maps