Abstract:Background: Auditory-perceptual assessment of voice is a subjective procedure. Artificial intelligence with deep learning (DL) may improve the consistency and accessibility of this task. It is unclear how a DL model performs on different acoustic features. Aims: To develop a generalizable DL framework for identifying dysphonia using a multidimensional acoustic feature. Methods & procedures: Recordings of sustained phonations of /a/ and /i/ were retrospectively collected from a clinical database. Subjects contained 238 dysphonic and 223 vocally healthy speakers of Chinese Mandarin. All audio clips were split into multiple 1.5-s segments and normalized to the same loudness level. Mel frequency cepstral coefficients and mel-spectrogram were extracted from these standardized segments. Each set of features was used in a convolutional neural network (CNN) to perform a binary classification task. The best feature was obtained through a five-fold cross-validation on a random selection of 80% data. The resultant DL framework was tested on the remaining 20% data and a public German voice database. The performance of the DL framework was compared with those of two baseline machine-learning models. Outcomes & results: The mel-spectrogram yielded the best model performance, with a mean area under the receiver operating characteristic curve of 0.972 and an accuracy of 92% in classifying audio segments. The resultant DL framework significantly outperformed both baseline models in detecting dysphonic subjects on both test sets. The best outcomes were achieved when classifications were made based on all segments of both vowels, with 95% accuracy, 92% recall, 98% precision and 98% specificity on the Chinese test set, and 92%, 95%, 90% and 89%, respectively, on the German set. Conclusions & implications: This study demonstrates the feasibility of DL for automatic detection of dysphonia. The mel-spectrogram is a preferred acoustic feature for the task. This framework may be used for vocal health screening and facilitate automatic perceptual evaluation of voice in the era of big data. What this paper adds: What is already known on this subject Auditory-perceptual assessment is the current gold standard in clinical evaluation of voice quality, but its value may be limited by the rater's reliability and accessibility. DL is a new method of artificial intelligence that can overcome these disadvantages and promote automatic voice assessment. This study explored the feasibility of a DL approach for automatic detection of dysphonia, along with a quantitative comparison of two common sets of acoustic features. What this study adds to existing knowledge A CNN model is excellent at decoding multidimensional acoustic features, outperforming the baseline parameter-based models in identifying dysphonic voices. The first 13 mel-frequency cepstral coefficients (MFCCs) are sufficient for this task. The mel-spectrogram results in greater performance, indicating the acoustic features are presented in a more favourable way than the MFCCs to the CNN model. What are the potential or actual clinical implications of this work? DL is a feasible method for the detection of dysphonia. The current DL framework may be used for remote vocal health screening or documenting voice recovery after treatment. In future, DL models may potentially be used to perform auditory-perceptual tasks in an automatic, efficient, reliable and low-cost manner.

Applying Deep Learning with Convolutional Neural Networks to Laryngoscopic Imaging for Automated Segmentation and Classification of Vocal Cord Leukoplakia

Vocal cord leukoplakia classification using deep learning models in white light and narrow band imaging endoscopy images

I-scan Combined with Laryngovideostroboscopy for Predicting Malignancy in Vocal Fold Leukoplakia

Application of Deep Learning Assisted Electronic Laryngoscope in Diagnosis of Laryngeal Leukoplakia

Vocal Cord Leukoplakia Classification Using Siamese Network under Small Samples of White Light Endoscopy Images.

Multi‐Instance Learning for Vocal Fold Leukoplakia Diagnosis Using White Light and Narrow‐Band Imaging: A Multicenter Study

Vocal cord lesions classification based on deep convolutional neural network and transfer learning

[Application of Electronic Laryngoscope Combined with Narrow Band Imaging Endoscope and Its Classification in the Diagnosis of Vocal Cord Leukoplakia].

Laryngeal Leukoplakia Classification Via Dense Multiscale Feature Extraction in White Light Endoscopy Images

New Model and Public Online Prediction Platform for Risk Stratification of Vocal Cord Leukoplakia

Automatic Recognition of Laryngoscopic Images Using a Deep‐Learning Technique

Deep Learning Application for Vocal Fold Disease Prediction Through Voice Recognition: A Preliminary Development Study (Preprint)

Convolutional neural network-based vocal cord tumor classification technique for home-based self-prescreening purpose

Multi-instance learning based artificial intelligence model to assist vocal fold leukoplakia diagnosis: A multicentre diagnostic study

Evaluating the Diagnostic Potential of Connected Speech for Benign Laryngeal Disease Using Deep Learning Analysis

[Application of Deep Convolutional Neural Networks in the Diagnosis of Laryngeal Squamous Cell Carcinoma Based on Narrow Band Imaging Endoscopy].

Diagnostic accuracy of deep learning-based algorithms in laryngoscopy: a systematic review and meta-analysis

Deep learning in automatic detection of dysphonia: Comparing acoustic features and developing a generalizable framework

A deep convolutional neural network-based method for laryngeal squamous cell carcinoma diagnosis

The Use of Deep Learning Software in the Detection of Voice Disorders: A Systematic Review

Deep Learning for nasopharyngeal Carcinoma Identification Using Both White Light and Narrow-Band Imaging Endoscopy