Abstract:In this paper, we propose a new method for the accurate estimation and tracking of formants in speech signals using time-varying quasi-closed-phase (TVQCP) analysis. Conventional formant tracking methods typically adopt a two-stage estimate-and-track strategy wherein an initial set of formant candidates are estimated using short-time analysis (e.g., 10--50 ms), followed by a tracking stage based on dynamic programming or a linear state-space model. One of the main disadvantages of these approaches is that the tracking stage, however good it may be, cannot improve upon the formant estimation accuracy of the first stage. The proposed TVQCP method provides a single-stage formant tracking that combines the estimation and tracking stages into one. TVQCP analysis combines three approaches to improve formant estimation and tracking: (1) it uses temporally weighted quasi-closed-phase analysis to derive closed-phase estimates of the vocal tract with reduced interference from the excitation source, (2) it increases the residual sparsity by using the $L_1$ optimization and (3) it uses time-varying linear prediction analysis over long time windows (e.g., 100--200 ms) to impose a continuity constraint on the vocal tract model and hence on the formant trajectories. Formant tracking experiments with a wide variety of synthetic and natural speech signals show that the proposed TVQCP method performs better than conventional and popular formant tracking tools, such as Wavesurfer and Praat (based on dynamic programming), the KARMA algorithm (based on Kalman filtering), and DeepFormants (based on deep neural networks trained in a supervised manner). Matlab scripts for the proposed method can be found at: <a class="link-external link-https" href="https://github.com/njaygowda/ftrack" rel="external noopener nofollow">this https URL</a>

Tracking Formant Trajectory of Continuous Chinese Whispered Speech with Hidden Dynamic Model Based on Dynamic Target Orientation

Statistical Parametric Speech Synthesis Using a Hidden Trajectory Model

Formant Speech Synthesis Based on Trainable Model

An Improved Algorithm of LPC for Formant Extraction of Whisper Speech

Parameterization of Dominant Spectral Peak Trajectory for Whisper Speech Recognition

A hidden trajectory model with bi-directional target filtering: cascaded vs. integrated implementation for phonetic recognition

Recovering implicit pitch contours from formants in whispered speech

Formant Tracking Using Quasi-Closed Phase Forward-Backward Linear Prediction Analysis and Deep Neural Networks

Target-filtering model based articulatory movement prediction for articulatory control of HMM-based speech synthesis

Formant-Controlled HMM-Based Speech Synthesis.

Detection of Dynamic Structures of Speech Fundamental Frequency in Tonal Languages

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

Refining a Deep Learning-based Formant Tracker using Linear Prediction Methods

Research on Polynomial-Fitting Speech-Trajectory Model in Chinese Continuous Speech Recognition

A Dynamic Glottal Model Through High-Speed Imaging

Time-Varying Quasi-Closed-Phase Analysis for Accurate Formant Tracking in Speech Signals

Perceiver-Prompt: Flexible Speaker Adaptation in Whisper for Chinese Disordered Speech Recognition

Modeling DCT Parameterized F0 Trajectory at Intonation Phrase Level with DNN or Decision Tree

Modeling F0 Trajectories in Hierarchically Structured Deep Neural Networks.

Enhancement of Chinese Speech Based on Nonlinear Dynamics

Vocal tract characteristic on long-term formant distribution