Abstract:Modeling and estimation of the vocal tract and glottal source parameters of vowels from raw speech can be typically done by using the Auto-Regressive with eXogenous input (ARX) model and Liljencrants-Fant (LF) model with an iteration-based estimation approach. However, the all-pole autoregressive model in the modeling of vocal tract filters cannot provide the locations of anti-formants (zeros), which increases the estimation errors in certain classes of speech sounds, such as nasal, fricative, and stop consonants. In this paper, we propose the Auto-Regressive Moving Average eXogenous with LF (ARMAX-LF) model to extend the ARX-LF model to a wider variety of speech sounds, including vowels and nasalized consonants. The LF model represents the glottal source derivative as a parametrized time-domain model, and the ARMAX model represents the vocal tract as a pole-zero filter with an additional exogenous LF excitation as input. To estimate multiple parameters with fewer errors, we first utilize the powerful nonlinear fitting ability of deep neural networks (DNNs) to build a mapping from extracted glottal source derivatives or speech waveforms to corresponding LF parameters. Then, glottal source and vocal tract parameters can be estimated with fewer estimation errors and without any iterations as in the analysis-by-synthesis strategy. Experimental results with synthesized speech using the linear source-filter model, synthesized speech using the physical model, and real speech signals showed that the proposed ARMAX-LF model with a DNN-based estimation method can estimate the parameters of both vowels and nasalized sounds with fewer errors and estimation time.

A novel source analysis method by matching spectral characters of LF model with STRAIGHT spectrum

A Chinese Voice Morphing Method Based on STRAIGHT

Emotional speaker recognition based on similar neighbor phenomenon

An Improved Spectral And Prosodic Transformation Method In Straight-Based Voice Conversion

Modeling Glottal Effect On The Spectral Envelop Of Straight Using Mixture Of Gaussians

$F_0$-Noise-robust Glottal Source and Vocal Tract Analysis Based on ARX-LF Model

Study of Long-Term Formant Distributions in Forensic Phonetics

Chinese Speech Feature Analysis and Recognition Based on Sinusoidal Model

Listen and Look: Audio–Visual Matching Assisted Speech Source Separation

Multi-source Based Acoustic Model for Speech Synthesis.

Modeling and Estimation of Vocal Tract and Glottal Source Parameters Using ARMAX-LF Model

Factor analysis method for text-independent speaker identification.

Low SNR Robust Chinese Tone Extraction Based Human Auditory Model

Unsupervised Single-Channel Music Source Separation by Average Harmonic Structure Modeling

Experiment on pitch target approximation model for generating Mandarin F0 contour

Automated Assessment of Glottal Dysfunction Through Unified Acoustic Voice Analysis

Vocal tract characteristic on long-term formant distribution

An initial research: Towards accurate pitch extraction for speech synthesis based on BLSTM

Spectro-Temporal Modelling with Time-Frequency Lstm and Structured Output Layer for Voice Conversion

Singer identification based on computational auditory scene analysis and missing feature methods

A New Kind of FRFT Analysis Method for Multi-Component LFM Signals