Abstract:Automatic speaker verification systems (ASVs) verify a person’s identity by his/her voice and have been widely deployed for user authentication. However, existing ASVs are based on traditional audio spectral features and hence, perform poorly in verifying pitch-changed utterances from speakers with cold or sore throat. In this article, we propose soundfield tracker (SOFTER) , a soundfield-based speaker verification system that can verify speakers regardless of the pitch changes. SOFTER is based on the observation that soundfield features reflect the speaker’s vocal tract, mouth, head, torso, etc., which are less affected by the pitch changes in speech signals. SOFTER can be integrated into off-the-shelf smartphones without any hardware modifications. One major challenge is that the soundfield is sensitive to the distance between the speaker and the phone. To solve this problem, we propose a two-stage mechanism combining distance sensing and soundfield reconstruction, which enables to reconstruct the soundfield to a setting similar to the one in the enrollment phase, thus, the speaker can be verified from any distance to the phone. We compare SOFTER with six state-of-the-art academic and commercial ASVs on two data sets of 134 speakers and 31000 speech samples. Results show that SOFTER has an equal error rate (EER) of 2.18% and 1.61% on the two data sets, respectively. Moreover, SOFTER outperforms other ASVs by at least 24.67% on average in verifying pitch-varying or pathological speech samples, denoting an evidence of SOFTER ’s effectiveness in both normal and unhealthy user conditions.

A Study on the Robustness of Pitch Range Estimation from Brief Speech Segments

Estimation of the Underlying F0 Range of a Speaker from the Spectral Features of a Brief Speech Input

VarASV: Enabling Pitch-variable Automatic Speaker Verification Via Multi-task Learning

Toward Pitch-Insensitive Speaker Verification Via Soundfield

Pitch envelope based frame level score reweighed algorithm for emotion robust speaker recognition.

Physiological Pitch Range Estimation from a Brief Speech Input: A Study on a Bilingual Parallel Speech Corpus

A Robust and Low Computational Cost Pitch Estimation Method

An initial research: Towards accurate pitch extraction for speech synthesis based on BLSTM

Robust Pitch Estimation Using a Wavelet Variance Analysis Model

Robust Multipitch Estimation Of Piano Sounds Using Deep Spiking Neural Networks

Robustness of Speech Separation Models for Similar-pitch Speakers

RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Music

A New Robust Pitch Determination Algorithm for Telephone Speech

Pseudo-pitch-synchronized Phase Information Extraction and Its Application for Robust Speaker Recognition

RNN-BLSTM Based Multi-Pitch Estimation

A Novel Pitch Extraction Based on Jointly Trained Deep BLSTM Recurrent Neural Networks with Bottleneck Features

Using Duration and Pitch for Mandarin Digit String Recognition.

Speech Enhancement Based On Analysis Synthesis Framework With Improved Pitch Estimation And Spectral Envelope Enhancement

A pitch-based rapid speech segmentation for speaker indexing

Semi-supervised Learning For Robust Speech Evaluation

Pitch Synchronized Relative Phase with Peak Error Detection For Noise-robust Speaker Recognition