Abstract:This paper presents a maximum-likelihood approach to multiple fundamental frequency (F0) estimation for a mixture of harmonic sound sources, where the power spectrum of a time frame is the observation and the F0s are the parameters to be estimated. When defining the likelihood model, the proposed method models both spectral peaks and non-peak regions (frequencies further than a musical quarter tone from all observed peaks). It is shown that the peak likelihood and the non-peak region likelihood act as a complementary pair. The former helps find F0s that have harmonics that explain peaks, while the latter helps avoid F0s that have harmonics in non-peak regions. Parameters of these models are learned from monophonic and polyphonic training data. This paper proposes an iterative greedy search strategy to estimate F0s one by one, to avoid the combinatorial problem of concurrent F0 estimation. It also proposes a polyphony estimation method to terminate the iterative process. Finally, this paper proposes a postprocessing method to refine polyphony and F0 estimates using neighboring frames. This paper also analyzes the relative contributions of different components of the proposed method. It is shown that the refinement component eliminates many inconsistent estimation errors. Evaluations are done on ten recorded four-part J. S. Bach chorales. Results show that the proposed method shows superior F0 estimation and polyphony estimation compared to two state-of-the-art algorithms.

Detection of Dynamic Structures of Speech Fundamental Frequency in Tonal Languages

Detection of Time Varying Pitch in Tonal Languages: an Approach Based on Ensemble Empirical Mode Decomposition

Detectionoftimevaryingpitchintonallanguages: Anapproachbasedonensembleempirical Modedecomposition ∗

An Approach of Fundamental Frequencies Smoothing for Chinese Tone Recognition

An Approach to Smooth Fundamental Frequencies in Tone Recognition

Auditive Learning Based Chinese F0 Prediction

The effect of F0 contour on the intelligibility of Mandarin Chinese for hearing-impaired listeners.

Effects of fundamental frequency contour on understanding Mandarin sentences in bimodal hearing simulations

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

The effect of F0 contour on the intelligibility of speech in the presence of interfering sounds for Mandarin Chinese.

Modeling the cross-linguistic variations of tonal systems

Data mining Mandarin tone contour shapes

Research on real-time detection technology of Chinese voiced speech pitch

Speech endpoint detection based on frequency domain and time domain analyses

Multiple Fundamental Frequency Estimation by Modeling Spectral Peaks and Non-Peak Regions

Research on Tone Recognition in Chinese Spontaneous Speech

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

The Effect of F0 Contours on the Intelligibility of Speech Against Interfering Sounds for Mandarin Chinese

Clustering and Feature Learning Based F0 Prediction for Chinese Speech Synthesis

Generating Mandarin and Cantonese F0 Contours with Decision Trees and BLSTMs

Real Context Model for Tone Recognition in Mandarin Conversational Telephone Speech