Abstract:Advancements in deep learning speech representations have facilitated the effective use of extensive datasets comprised of unlabeled speech signals, and have achieved success in modeling tasks associated with Parkinson’s disease (PD) with minimal annotated data. This study focuses on PD non-fine-tuned wav2vec 1.0 architecture. Utilizing features derived from wav2vec embedding, we develop machine learning models tailored for clinically relevant PD speech diagnosis tasks, such as cross-database classification and regression to predict demographic and articulation characteristics, for instance, modeling the subjects’ age and number of characters per second. The primary aim is to conduct feature importance analysis on both classification and regression tasks, investigating whether latent discrete speech representations in PD are shared across models, particularly for related tasks. The proposed wav2vec-based models were evaluated on PD versus healthy controls using three multi-language-task PD datasets. Results indicated that wav2vec accurately detected PD based on speech, outperforming feature extraction using mel-frequency cepstral coefficients in the proposed cross-database scenarios. Furthermore, wav2vec proved effective in regression, modeling various quantitative speech characteristics related to intelligibility and aging. Subsequent analysis of important features, obtained using scikit-learn feature importance built-in tools and the Shapley additive explanations method, examined the presence of significant overlaps between classification and regression models. The feature importance experiments discovered shared features across trained models, with increased sharing for related tasks, further suggesting that wav2vec contributes to improved generalizability. In conclusion, the study proposes wav2vec embedding as a promising step toward a speech-based universal model to assist in the evaluation of PD.

WavRx: a Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model

PDAssess: A Privacy-preserving Free-speech Based Parkinson's Disease Daily Assessment System

Speech as a Biomarker for Disease Detection

On the Impact of Voice Anonymization on Speech Diagnostic Applications: a Case Study on COVID-19 Detection

Prosody-Driven Privacy-Preserving Dementia Detection

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System.

Sound as a bell: a deep learning approach for health status classification through speech acoustic biomarkers

Respiratory Disease Classification and Biometric Analysis Using Biosignals from Digital Stethoscopes

A Step Towards Preserving Speakers' Identity While Detecting Depression Via Speaker Disentanglement

Analyzing wav2vec embedding in Parkinson’s disease speech: A study on cross-database classification and regression tasks

Analyzing wav2vec embedding in Parkinson's disease speech: A study on cross-database classification and regression tasks

The smarty4covid dataset and knowledge base as a framework for interpretable physiological audio data analysis

DigiVoice: Voice Biomarker Featurization and Analysis Pipeline

Exploring ASR-Based Wav2Vec2 for Automated Speech Disorder Assessment: Insights and Analysis

The Impact of Speech Anonymization on Pathology and Its Limits

Probing mental health information in speech foundation models

Towards objective and interpretable speech disorder assessment: a comparative analysis of CNN and transformer-based models

The smarty4covid dataset and knowledge base: a framework enabling interpretable analysis of audio signals

RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction

Fused Audio Instance and Representation for Respiratory Disease Detection