Abstract:Automatic speaker verification systems (ASVs) verify a person’s identity by his/her voice and have been widely deployed for user authentication. However, existing ASVs are based on traditional audio spectral features and hence, perform poorly in verifying pitch-changed utterances from speakers with cold or sore throat. In this article, we propose soundfield tracker (SOFTER) , a soundfield-based speaker verification system that can verify speakers regardless of the pitch changes. SOFTER is based on the observation that soundfield features reflect the speaker’s vocal tract, mouth, head, torso, etc., which are less affected by the pitch changes in speech signals. SOFTER can be integrated into off-the-shelf smartphones without any hardware modifications. One major challenge is that the soundfield is sensitive to the distance between the speaker and the phone. To solve this problem, we propose a two-stage mechanism combining distance sensing and soundfield reconstruction, which enables to reconstruct the soundfield to a setting similar to the one in the enrollment phase, thus, the speaker can be verified from any distance to the phone. We compare SOFTER with six state-of-the-art academic and commercial ASVs on two data sets of 134 speakers and 31000 speech samples. Results show that SOFTER has an equal error rate (EER) of 2.18% and 1.61% on the two data sets, respectively. Moreover, SOFTER outperforms other ASVs by at least 24.67% on average in verifying pitch-varying or pathological speech samples, denoting an evidence of SOFTER ’s effectiveness in both normal and unhealthy user conditions.

Robust Pitch Estimation Using a Wavelet Variance Analysis Model

A Robust and Low Computational Cost Pitch Estimation Method

Toward Pitch-Insensitive Speaker Verification Via Soundfield

Pitch Extraction Based on Wavelet Transformation and Linear Prediction

VarASV: Enabling Pitch-variable Automatic Speaker Verification Via Multi-task Learning

A New Robust Pitch Determination Algorithm for Telephone Speech

Robust Voice Activity Detection based on Pitch and Sub-band Energy

A Novel and Efficient Voice Activity Detector Using Shape Features of Speech Wave.

Investigation of the Spectral Envelope Estimation Vocoder and Improved Pitch Estimation Based on the Sinusoidal Speech Model

Regulation of H Excretion : EFFECTS OF OSMOTIC SHOCK.

RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Music

Research on real-time detection technology of Chinese voiced speech pitch

Speech Enhancement Based On Analysis Synthesis Framework With Improved Pitch Estimation And Spectral Envelope Enhancement

Robust Multipitch Estimation Of Piano Sounds Using Deep Spiking Neural Networks

High performance mandarin pitch estimation

A Robust Speech Feature - Perceptive Scalogram Based on Wavelet Analysis

Noise-Robust DSP-Assisted Neural Pitch Estimation with Very Low Complexity

Endpoint detection and pitch determination method based on a probability model

Noise Estimation Using Mean Square Cross Prediction Error for Speech Enhancement

Pitch-scaled Analysis Based Residual Reconstruction for Speech Analysis and Synthesis

Wavoice: A mmWave-assisted Noise-resistant Speech Recognition SystemJust Accepted