Abstract:Tone plays an important role in recognizing spoken tonal languages like Chinese. However, the F0 contour discontinuity between voiced and unvoiced segments has traditionally been a bottleneck in modeling tone contour for automatic speech recognition and synthesis and various heuristic approaches were proposed to get around the problem. The Multi-Space Distribution (MSD) was proposed by Tokuda et.al. and applied to HMM-based speech synthesis, which models the two probability spaces, discrete for unvoiced region and continuous for voiced F0 contour, in a linearly weighted mixture. We extend the MSD to tone modeling for speech recognition applications. Specifically, modeling tones in speaker-independent, spoken Chinese is formulated and tested in a Mandarin speech database. The tone features and spectral features are further separated into two streams and stream-dependent models are built to cluster the two features into separated decision trees. The recognition results show that the ultimate performance of tonal syllable error rate can be improved from toneless baseline system to the MSD based stream-dependent system, 50.5% to 36.1% and 46.3% to 35.1%, for the two systems resulted from using two different phone sets. The absolute tonal syllable error rate improvement of the new approach is 5.5% and 6.1%, comparing with the conventional tone modeling.

Real-time Speech/music Classification Arithmetic Based on Tonality

Feature Analysis for Speech/Music Automatic Classification

Feature Analysis and Extraction for Audio Automatic Classification.

Audio Tonality Mode Classification Without Tonic Annotations.

Audio classification algorithm based on nonlinear characteristics analysis

Classification Algorithm of Speech and Music Signal Based on Decision Tree

Speech Music Classification Based on MLER and GMM

A Novel Speech/Music Segmentation and Discrimination Algorithm

The Musical Instrument Classification Algorithm Based on Nonlinear Dynamics

Research of Music Classification Based on MFCC Feature and HMM Model

Automatic audio classification based on PCA and CHMM

Musical Instrument Classification via Low-Dimensional Feature Vectors

Fast classification method of narrow-band audio signals under noisy environment

Recognition of Pure Music from Speech Sound-Music Mixed Part of Audio Signal

A Multi-Space Distribution (MSD) Approach to Speech Recognition of Tonal Languages

A Simplified Early Auditory Model with Application in Speech/Music Classification

Typical Methods for Audio Classification

Integration of Speech/ Music Discrimination and Mood Classification with Audio Feature Extraction

A real-time algorithm for music recognition based on wavelet transform

Integrated Tone Evaluation in Mandarin CALL Systems Using Competing Model Based Approach

Research on Tone Recognition of Chinese Speech