Abstract:Automatic syllable stress detection is a crucial component in Computer-Assisted Language Learning (CALL) systems for language learners. Current stress detection models are typically trained on clean speech, which may not be robust in real-world scenarios where background noise is prevalent. To address this, speech enhancement (SE) models, designed to enhance speech by removing noise, might be employed, but their impact on preserving syllable stress patterns is not well studied. This study examines how different SE models, representing discriminative and generative modeling approaches, affect syllable stress detection under noisy conditions. We assess these models by applying them to speech data with varying signal-to-noise ratios (SNRs) from 0 to 20 dB, and evaluating their effectiveness in maintaining stress patterns. Additionally, we explore different feature sets to determine which ones are most effective for capturing stress patterns amidst noise. To further understand the impact of SE models, a human-based perceptual study is conducted to compare the perceived stress patterns in SE-enhanced speech with those in clean speech, providing insights into how well these models preserve syllable stress as perceived by listeners. Experiments are performed on English speech data from non-native speakers of German and Italian. And the results reveal that the stress detection performance is robust with the generative SE models when heuristic features are used. Also, the observations from the perceptual study are consistent with the stress detection outcomes under all SE models.

Stress Accent Detection in an English Learning System

English Sentence Stress Detection System Based on HMM Framework

Automatic Lexical Stress Detection for English Learning

Automatic lexical stress and pitch accent detection for L2 English speech using multi-distribution deep neural networks

Detecting Syllable-Level Pronunciation Stress with A Self-Attention Model

English Sentence Accent Detection Based on Auditory Features

Detection of Lexical Stress Errors in Non-Native (L2) English with Data Augmentation and Attention

Automatic lexical stress detection using acoustic features for computer-assisted language learning

AUTOMATIC STRESS PREDICTION OF CHINESE SPEECH SYNTHESIS

A Stressed Syllable Labeling Approach Using Fractal Dimensions

Reliable Accent-Specific Unit Generation With Discriminative Dynamic Gaussian Mixture Selection for Multi-Accent Chinese Speech Recognition

Reliable accent specific unit generation with dynamic Gaussian mixture selection for multi-accent speech recognition

Study on Automatic Prediction of Sentential Stress for Chinese Putonghua Text-to-Speech System with Natural Style

Improved Accent Classification Combining Phonetic Vowels with Acoustic Features

Automatic Accent Classification Using Ensemble Methods

Evaluating the Impact of Discriminative and Generative E2E Speech Enhancement Models on Syllable Stress Preservation

Study on Stress Perception in Chinese Speech

Spoken English Assessment System for Non-Native Speakers Using Acoustic and Prosodic Features.

Mandarin Stress Analysis And Prediction For Speech Synthesis

Towards Robust Mispronunciation Detection and Diagnosis for L2 English Learners with Accent-Modulating Methods

Ranknet based English stressed syllable detection