Abstract:A crucial step in processing speech audio data for information extraction, topic detection, or browsing/playback is to segment the input into sentence and topic units. Speech segmentation is challenging, since the cues typically present for segmenting text (headers, paragraphs, punctuation) are absent in spoken language. We investigate the use of prosody (information gleaned from the timing and melody of speech) for these tasks. Using decision tree and hidden Markov modeling techniques, we combine prosodic cues with word-based approaches, and evaluate performance on two speech corpora, Broadcast News and Switchboard. Results show that the prosodic model alone performs on par with, or better than, word-based statistical language models -- for both true and automatically recognized words in news speech. The prosodic model achieves comparable performance with significantly less training data, and requires no hand-labeling of prosodic events. Across tasks and corpora, we obtain a significant improvement over word-only models using a probabilistic combination of prosodic and lexical information. Inspection reveals that the prosodic models capture language-independent boundary indicators described in the literature. Finally, cue usage is task and corpus dependent. For example, pause and pitch features are highly informative for segmenting news speech, whereas pause, duration and word-based cues dominate for natural conversation.

Prosodic Phrase Analysis based on Probability and Statistics

Statistical Model Based on Probability Frequency for Mandarin Prosodic Structure Prediction

Chinese Prosodic Phrasing with Extended Features.

Prosodic phrasing with in †

Learning rules for Chinese prosodic phrase prediction

Predicting Chinese Prosodic Phrase with Height of Syntax Tree

Rule Learning Based Chinese Prosodic Phrase Prediction

Training Prosodic Phrasing Rules for Chinese TTS Systems

A Tree-Based Model of Prosodic Phrasing for Chinese Text-to-Speech Systems

Prosodic Phrasing with Inductive Learning.

Syntactic Information and Analysis and Prediction of Prosody Structure

Automatic Phrase Breaks Prediction in Chinese Sentences

Prosodic Word Prediction Using the Lexical Information

Improved Decision Tree Based Method for English Prosodic Phrase Boundary Prediction

Chinese Prosodic Phrasing Based on Extension Matrix Theory

Learning Prosodic Patterns for Mandarin Speech Synthesis

Study of Prosody Model on Chinese Speech Synthesis Based on the Classification of Syllabic Prosody Features

A Study on Chinese Prosodic Hierarchy Prediction Based on Dependency Grammar Analysis

Prosody-Based Automatic Segmentation of Speech into Sentences and Topics

Rule-learning Based Prosodic Structure Prediction

Investigating Effect of Rich Syntactic Features on Mandarin Prosodic Boundaries Prediction