Abstract:A classic problem in spoken language comprehension is how listeners perceive speech as being composed of discrete words, given the variable time-course of information in continuous signals. We propose a syllable inference account of spoken word recognition and segmentation, according to which alternative hierarchical models of syllables, words, and phonemes are dynamically posited, which are expected to maximally predict incoming sensory input. Generative models are combined with current estimates of context speech rate drawn from neural oscillatory dynamics, which are sensitive to amplitude rises. Over time, models which result in local minima in error between predicted and recently experienced signals give rise to perceptions of hearing words. Three experiments using the visual world eye-tracking paradigm with a picture-selection task tested hypotheses motivated by this framework. Materials were sentences that were acoustically ambiguous in numbers of syllables, words, and phonemes they contained (cf. English plural constructions, such as "saw (a) raccoon(s) swimming," which have two loci of grammatical information). Time-compressing, or expanding, speech materials permitted determination of how temporal information at, or in the context of, each locus affected looks to, and selection of, pictures with a singular or plural referent (e.g., one or more than one raccoon). Supporting our account, listeners probabilistically interpreted identical chunks of speech as consistent with a singular or plural referent to a degree that was based on the chunk's gradient rate in relation to its context. We interpret these results as evidence that arriving temporal information, judged in relation to language model predictions generated from context speech rate evaluated on a continuous scale, informs inferences about syllables, thereby giving rise to perceptual experiences of understanding spoken language as words separated in time.

A Systematic Approach To Compute Perceptual Distribution Of Monosyllables

A Syllable Identification Algorithm Using Acoustic Properties

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Syllable Level Speech Emotion Recognition Based on Formant Attention

Towards a perceptual distance metric for auditory stimuli

Decomposition and integration of monosyllabic information for auditory perceptual process

Perceptual Evaluation of Pronunciation Quality for Computer Assisted Language Learning

Real-time Speech Emotion Recognition Based on Syllable-Level Feature Extraction

A Multi-Space Distribution (MSD) Approach to Speech Recognition of Tonal Languages

A perceptual similarity space for speech based on self-supervised speech representations

A Data-Driven Speech Intelligibility Assessment Method Using Sum-Sorted Spectrogram Feature

Auditory Feature-based Perceptual Distance

THE SIMILARITY MEASURE AMONG ACOUSTIC MODELS AND ITS TWO APPLICATIONS

Score Fusion For Perceptual Evaluation Of Pronunciation Quality

Metric Learning for Phoneme Perception

The similaritymeasureamongacoustic models and its twoapplications

An Optimized Signal Processing Pipeline for Syllable Detection and Speech Rate Estimation

Improving Monaural Speech Enhancement with Dynamic Scene Perception Module

Hierarchical Perception Of Monosyllabic Sounds

Syllable Inference as a Mechanism for Spoken Language Understanding

Tone Enhancing Model for Disyllable Words in Chinese Mandarin Speech