Abstract:Prior studies in the automatic classification of voice quality have mainly studied the use of the acoustic speech signal as input. Recently, a few studies have been carried out by jointly using both speech and neck surface accelerometer (NSA) signals as inputs, and by extracting MFCCs and glottal source features. This study examines simultaneously-recorded speech and NSA signals in the classification of voice quality (breathy, modal, and pressed) using features derived from three self-supervised pre-trained models (wav2vec2-BASE, wav2vec2-LARGE, and HuBERT) and using a SVM as well as CNNs as classifiers. Furthermore, the effectiveness of the pre-trained models is compared in feature extraction between glottal source waveforms and raw signal waveforms for both speech and NSA inputs. Using two signal processing methods (quasi-closed phase (QCP) glottal inverse filtering and zero frequency filtering (ZFF)), glottal source waveforms are estimated from both speech and NSA signals. The study has three main goals: (1) to study whether features derived from pre-trained models improve classification accuracy compared to conventional features (spectrogram, mel-spectrogram, MFCCs, i-vector, and x-vector), (2) to investigate which of the two modalities (speech vs. NSA) is more effective in the classification task with pre-trained model-based features, and (3) to evaluate whether the deep learning-based CNN classifier can enhance the classification accuracy in comparison to the SVM classifier. The results revealed that the use of the NSA input showed better classification performance compared to the speech signal. Between the features, the pre-trained model-based features showed better classification accuracies, both for speech and NSA inputs compared to the conventional features. It was also found that the HuBERT features performed better than the wav2vec2-BASE and wav2vec2-LARGE features.

Analysis and Detection of Phonation Modes in Singing Voice using Excitation Source Features and Single Frequency Filtering Cepstral Coefficients (SFFCC)

Classification of phonation types in singing voice using wavelet scattering network-based features

Analysis and Detection of Pathological Voice using Glottal Source Features

Residual Attention Based Network for Automatic Classification of Phonation Modes

Mechanical classification of voice quality

Detection of fricative and vowels in speech signals

Investigation of Self-supervised Pre-trained Models for Classification of Voice Quality from Speech and Neck Surface Accelerometer Signals

Improved harmonic spectral envelope extraction for singer classification with hybridised model

SiFiSinger: A High-Fidelity End-to-End Singing Voice Synthesizer based on Source-filter Model

Research On Singing Voice Detection Based On A Long-Term Recurrent Convolutional Network With Vocal Separation And Temporal Smoothing

Singing Voice Separation and Vocal F0 Estimation based on Mutual Combination of Robust Principal Component Analysis and Subharmonic Summation

Extraction and Utilization of Excitation Information of Speech: A Review

A Voice Disease Detection Method Based on MFCCs and Shallow CNN

Objective Identification of Prepubertal Female Singers and Non-singers by Singing Power Ratio Using Matlab

Investigation of Singing Voice Separation for Singing Voice Detection in Polyphonic Music

Analysis of influencing features with spectral feature extraction and multi-class classification using deep neural network for speech recognition system

Effects of stimulation techniques on vocal responses: implications for assessment and treatment

Single-Channel Blind Source Separation for Singing Voice Detection: A Comparative Study

Employing Energy and Statistical Features for Automatic Diagnosis of Voice Disorders

Comparison for Improvements of Singing Voice Detection System Based on Vocal Separation

Ensemble Model-Based Singer Classification with Proposed Vocal Segmentation