Abstract:Automatic speaker verification systems (ASVs) verify a person’s identity by his/her voice and have been widely deployed for user authentication. However, existing ASVs are based on traditional audio spectral features and hence, perform poorly in verifying pitch-changed utterances from speakers with cold or sore throat. In this article, we propose soundfield tracker (SOFTER) , a soundfield-based speaker verification system that can verify speakers regardless of the pitch changes. SOFTER is based on the observation that soundfield features reflect the speaker’s vocal tract, mouth, head, torso, etc., which are less affected by the pitch changes in speech signals. SOFTER can be integrated into off-the-shelf smartphones without any hardware modifications. One major challenge is that the soundfield is sensitive to the distance between the speaker and the phone. To solve this problem, we propose a two-stage mechanism combining distance sensing and soundfield reconstruction, which enables to reconstruct the soundfield to a setting similar to the one in the enrollment phase, thus, the speaker can be verified from any distance to the phone. We compare SOFTER with six state-of-the-art academic and commercial ASVs on two data sets of 134 speakers and 31000 speech samples. Results show that SOFTER has an equal error rate (EER) of 2.18% and 1.61% on the two data sets, respectively. Moreover, SOFTER outperforms other ASVs by at least 24.67% on average in verifying pitch-varying or pathological speech samples, denoting an evidence of SOFTER ’s effectiveness in both normal and unhealthy user conditions.

An Improved SIFT Method for Pitch Estimation of Speech

A Robust and Low Computational Cost Pitch Estimation Method

Simplified Deformation Compensation for Emotional Speaker Recognition

Pitch envelope based frame level score reweighed algorithm for emotion robust speaker recognition.

Toward Pitch-Insensitive Speaker Verification Via Soundfield

Optimization of Pitch Preprocessing in TETRA Speech Encoder

Pitch Detection Method Based on Hilbert-Huang Transform for Speech Signals

Research on real-time detection technology of Chinese voiced speech pitch

A New Robust Pitch Determination Algorithm for Telephone Speech

Pitch Extraction Based on Wavelet Transformation and Linear Prediction

High performance mandarin pitch estimation

Speech Enhancement Based On Analysis Synthesis Framework With Improved Pitch Estimation And Spectral Envelope Enhancement

A corroborative study on improving pitch determination by time-frequency cepstrum decomposition using wavelets

Analysis and improvement of auto-correlation pitch extraction algorithm based on candidate set

An initial research: Towards accurate pitch extraction for speech synthesis based on BLSTM

Speech pitch determination based on Hilbert-Huang transform

A Power Spectrum Reprocessing Algorithm for Pitch Detection of Speech

Mandarin Isolated Words Recognition Method Based on Pitch Contour

Real-time Pitch Tracking Based on C

Investigation of the Spectral Envelope Estimation Vocoder and Improved Pitch Estimation Based on the Sinusoidal Speech Model

Improved Algorithm for Pitch Detection and Harmonic Separation