Abstract:With the recent development of speech-enabled interactive systems using artificial agents, there has been substantial interest in the analysis and classification of voice disorders to provide more inclusive systems for people living with specific speech and language impairments. In this paper, a two-stage framework is proposed to perform an accurate classification of diverse voice pathologies. The first stage consists of speech enhancement processing based on the original premise, which considers impaired voice as a noisy signal. To put this hypothesis into practice, the noise lestral harmonic-to-noise ratio (CHNR). The second stage consists of a convolutional neural network with long short-term memory (CNN-LSTM) architecture designed to learn complex features from spectrograms of the first-stage enhanced signals. A new sinusoidal rectified unit (SinRU) is proposed to be used as an activation function by the CNN-LSTM network. The experiments are carried out by using two subsets of the Saarbruecken voice database (SVD) with different etiologies covering eight pathologies. The first subset contains voice recordings of patients with vocal cordectomy, psychogenic dysphonia, pachydermia laryngis and frontolateral partial laryngectomy, and the second subset contains voice recordings of patients with vocal fold polyp, chronic laryngitis, functional dysphonia, and vocal cord paresis. Dysarthria severity levels identification in Nemours and Torgo databases is also carried out. The experimental results showed that using the minimum mean square error (MMSE)-based signal enhancer prior to the CNN-LSTM network using SinRU, led to a significant improvement in the automatic classification of the investigated voice disorders and dysarhtria severity levels. These findings support the hypothesis that using an appropriate speech enhancement preprocessing has positive effects on the accuracy of the automatic classification of voice pathologies thanks to the reduction of the intrinsic noise induced by the voice impairment.

Non-Audible Speech Classification Using Deep Learning Approaches

Silent Speech Decoding Using Spectrogram Features Based on Neuromuscular Activities

Speech neuromuscular decoding based on spectrogram images using conformal predictors with Bi-LSTM.

Attention Bidirectional LSTM Networks Based Mime Speech Recognition Using Semg Data

Convolutional Neural Network applied in mime speech recognition using sEMG data

Multimodal Speech Recognition Using EEG and Audio Signals: A Novel Approach for Enhancing ASR Systems

An Interpretable and Generalizable Speech Detector Based on a CNN-LSTM Framework

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Deep Neural Network for Electromyography Signal Classification Via Wearable Sensors.

A deep learning approach to dysarthric utterance classification with BiLSTM-GRU, speech cue filtering, and log mel spectrograms

A novel silent speech recognition approach based on parallel inception convolutional neural network and Mel frequency spectral coefficient

Performance Improvement of Speech Emotion Recognition Systems by Combining 1D CNN and LSTM with Data Augmentation

Voice disorder classification using speech enhancement and deep learning models

Brain Signals to Rescue Aphasia, Apraxia and Dysarthria Speech Recognition

A CNN-Assisted Enhanced Audio Signal Processing for Speech Emotion Recognition

Deep neural network architectures for dysarthric speech analysis and recognition

Research on Deep Learning-based Speech Emotion Recognition System

EMG Signal Classification for Neuromuscular Disorders with Attention-Enhanced CNN

Automatic dysarthria detection and severity level assessment using CWT-layered CNN model

Multimodal Classification with Deep Convolutional-Recurrent Neural Networks for Electroencephalography

Imagined Speech State Classification for Robust Brain-Computer Interface