Abstract:Automatic detection and severity level classification of dysarthria from speech enables non-invasive and effective diagnosis that helps clinical decisions about medication and therapy of patients. In this work, three pre-trained models (wav2vec2-BASE, wav2vec2-LARGE, and HuBERT) are studied to extract features to build automatic detection and severity level classification systems for dysarthric speech. The experiments were conducted using two publicly available databases (UA-Speech and TORGO). One machine learning-based model (support vector machine, SVM) and one deep learning-based model (convolutional neural network, CNN) was used as the classifier. In order to compare the performance of the wav2vec2-BASE, wav2vec2-LARGE, and HuBERT features, three popular acoustic feature sets, namely, mel-frequency cepstral coefficients (MFCCs), openSMILE and extended Geneva minimalistic acoustic parameter set (eGeMAPS) were considered. Experimental results revealed that the features derived from the pre-trained models outperformed the three baseline features. It was also found that the HuBERT features performed better than the wav2vec2-BASE and wav2vec2-LARGE features. In particular, when compared to the best-performing baseline feature (openSMILE), the HuBERT features showed in the detection problem absolute accuracy improvements that varied between 1.33% (the SVM classifier, the TORGO database) and 2.86% (the SVM classifier, the UA-Speech database). In the severity level classification problem, the HuBERT features showed absolute accuracy improvements that varied between 6.54% (the SVM classifier, the TORGO database) and 10.46% (the SVM classifier, the UA-Speech database) compared to the best-performing baseline feature (eGeMAPS).

Towards Dog Bark Decoding: Leveraging Human Speech Processing for Automated Bark Classification

Phonetic and Lexical Discovery of a Canine Language using HuBERT

Silent Speech Decoding Using Spectrogram Features Based on Neuromuscular Activities

Towards Lexical Analysis of Dog Vocalizations via Online Videos

Animal speech and singing synthesis model based on So-VITS-SVC

Speak Like a Dog: Human to Non-human creature Voice Conversion

On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysis

Deep Learning Models for Automated Classification of Dog Emotional States from Facial Expressions

Feature Representations for Automatic Meerkat Vocalization Classification

Advancing Audio Emotion and Intent Recognition with Large Pre-Trained Models and Bayesian Inference

Advanced Framework for Animal Sound Classification With Features Optimization

Perception of vocoded speech in domestic dogs

Can Self-Supervised Neural Representations Pre-Trained on Human Speech distinguish Animal Callers?

Does My Dog ''Speak'' Like Me? The Acoustic Correlation between Pet Dogs and Their Human Owners

Improve Dog Recognition by Mining More Information from Both Click-Through Logs and Pre-Trained Models

Pre-trained models for detection and severity level classification of dysarthria from speech

Custom Data Augmentation for low resource ASR using Bark and Retrieval-Based Voice Conversion

Enhancing Human-Machine Interaction: Real-Time Emotion Recognition through Speech Analysis

How do soundboard-trained dogs respond to human button presses? An investigation into word comprehension

An Exploration into the Performance of Unsupervised Cross-Task Speech Representations for "In the Wild'' Edge Applications

Utilizing synthetic training data for the supervised classification of rat ultrasonic vocalizations