Abstract:Purpose: In the context of a cocktail party listening environment, the processing of different linguistic hierarchy levels in unattended speech and their influence on target speech recognition remain controversial. This study aims to investigate how different levels of linguistic structures (such as syllable, word, and sentence) in competing speech influence the recognition of target speech in a speech-to-speech masking situation. Method: Thirty-six participants were instructed to recognize target speech when it was masked by competing speech varied in masking types across syllables, words, and sentence. The perceived spatial location was altered to examine the interaction between linguistic unmasking effects and spatial unmasking effects. Recognition performance (i.e., intelligibility threshold) was determined by fitting psychometric functions to the recognition accuracies across four signal-to-noise ratios (−14, −10, −6, and − 2 dB) to evaluate each subject's ability to cope with challenging listening conditions. Results: We revealed a significant decline in target speech recognition when the masking speech was linguistically structured and intelligible. Specifically, masking speech with higher linguistic complexity, such as coherent sentences, resulted in more significant interference compared to those with lower complexity, like sequences of syllables. The linguistic release from masking, resulting from a decrease in linguistic complexity of maskers shifting from sentences to syllables, was found to be correlated with, and also linearly additive to, the spatial release from masking due to the spatial separation of the masker and target. Conclusions: These findings illustrate the influence of linguistic complexity in masking speech on the recognition of target speech, suggesting the involvement of higher-level linguistic processing of irrelevant speech in noisy environment.

Experiments and Analysis for Speaker Dependent Mandarin Syllable Recognition.

How Noise and Language Proficiency Influence Speech Recognition by Individual Non-Native Listeners.

Design and implementation of a speaker recognition system

Research on Speaker-Depended Isolated-Word Speech Recognition System

Recognition of Mandarin Chinese in Noisy, Reverberant Environments

Mandarin Isolated Words Recognition Method Based on Pitch Contour

Research on Inter-Syllable Context-Dependent Acoustic Unit for Mandarin Continuous Speech Recognition.

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

Research on Intersession Variability Compensation for MLLR-SVM Speaker Recognition.

A Spatial Long-Term Iterative Mask Estimation Approach for Multi-Channel Speaker Diarization and Speech Recognition.

Investigating Various Diarization Algorithms for Speaker in the Wild (SITW) Speaker Recognition Challenge

Speaker Normalization Training and Adaptation for Speech Recognition

Algorithm for Mandarin Continuous Speech Recognition Based on Context-Dependent Unit Between Syllables

Token-level Speaker Change Detection Using Speaker Difference and Speech Content via Continuous Integrate-and-fire

Mandarin Pronunciation Modeling Based on CASS Corpus.

MANDARIN PRONUNCIATION VARIATION MODELING 1

Linguistic Processing of Unattended Speech Under a Cocktail Party Listening Scenario

A Method for Syllable Segmentation in Mandarin Speech Recognition

Investigating model performance in language identification: beyond simple error statistics

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

A comparable study of modeling units for end-to-end Mandarin speech recognition