Abstract:Background: Middle ear diseases such as otitis media and middle ear effusion, for which diagnoses are often delayed or misdiagnosed, are among the most common issues faced by clinicians providing primary care for children and adolescents. Artificial intelligence (AI) has the potential to assist clinicians in the detection and diagnosis of middle ear diseases through imaging. Methods: Otoendoscopic images obtained by otolaryngologists from Taipei Veterans General Hospital in Taiwan between Jany 1, 2011 to Dec 31, 2019 were collected retrospectively and de-identified. The images were entered into convolutional neural network (CNN) training models after data pre-processing, augmentation and splitting. To differentiate sophisticated middle ear diseases, nine CNN-based models were constructed to recognize middle ear diseases. The best-performing models were chosen and ensembled in a small CNN for mobile device use. The pretrained model was converted into the smartphone-based program, and the utility was evaluated in terms of detecting and classifying ten middle ear diseases based on otoendoscopic images. A class activation map (CAM) was also used to identify key features for CNN classification. The performance of each classifier was determined by its accuracy, precision, recall, and F1-score. Findings: A total of 2820 clinical eardrum images were collected for model training. The programme achieved a high detection accuracy for binary outcomes (pass/refer) of otoendoscopic images and ten different disease categories, with an accuracy reaching 98.0% after model optimisation. Furthermore, the application presented a smooth recognition process and a user-friendly interface and demonstrated excellent performance, with an accuracy of 97.6%. A fifty-question questionnaire related to middle ear diseases was designed for practitioners with different levels of clinical experience. The AI-empowered mobile algorithm's detection accuracy was generally superior to that of general physicians, resident doctors, and otolaryngology specialists (36.0%, 80.0% and 90.0%, respectively). Our results show that the proposed method provides sufficient treatment recommendations that are comparable to those of specialists. Interpretation: We developed a deep learning model that can detect and classify middle ear diseases. The use of smartphone-based point-of-care diagnostic devices with AI-empowered automated classification can provide real-world smart medical solutions for the diagnosis of middle ear diseases and telemedicine. Funding: This study was supported by grants from the Ministry of Science and Technology (MOST110-2622-8-075-001, MOST110-2320-B-075-004-MY3, MOST-110-2634-F-A49 -005, MOST110-2745-B-075A-001A and MOST110-2221-E-075-005), Veterans General Hospitals and University System of Taiwan Joint Research Program (VGHUST111-G6-11-2, VGHUST111c-140), and Taipei Veterans General Hospital (V111E-002-3).

Analysing Wideband Absorbance Immittance in Normal and Ears with Otitis Media with Effusion Using Machine Learning

Exploring the Influence of Age on 3D Wideband Absorbance Immittance and the Automated Diagnosis of Otitis Media with Effusion Using Machine Learning

An Advanced Machine Learning Approach for High Accuracy Automated Diagnosis of Otitis Media with Effusion in Different Age Groups Using 3D Wideband Acoustic Immittance.

Toward Automating Diagnosis of Middle- and Inner-ear Mechanical Pathologies With a Wideband Absorbance Regression Model

Preliminary results of classifying otosclerosis and disarticulation using a convolutional neural network trained with simulated wideband acoustic immittance data

Survey of Wideband Acoustic Immittance Use by Clinical Audiologists

Clinical value of wideband acoustic immittance in the diagnosis of otitis media with effusion under negative intratympanic pressure in adults

Diagnosis, Treatment, and Management of Otitis Media with Artificial Intelligence

Wideband Absorbance Pattern and its Diagnostic Value in Adults with Middle Ear Effusions and Tympanic Membrane Perforation

Smartphone-based artificial intelligence using a transfer learning algorithm for the detection and diagnosis of middle ear diseases: A retrospective deep learning study

Classification of Wideband Tympanometry by Deep Transfer Learning With Data Augmentation for Automatic Diagnosis of Otosclerosis

EarSonar: an Acoustic Signal-Based Middle-Ear Effusion Detection Using Earphones

Applications of Machine Learning in Meniere's Disease Assessment Based on Pure-Tone Audiometry

Automatic Recognition of Auditory Brainstem Response Waveforms Using a Deep Learning-Based Framework

Structure-aware deep learning for chronic middle ear disease

Artificial Intelligence With Deep Learning Based Automated Ear Infection Detection

Deep Learning in Automated Region Proposal and Diagnosis of Chronic Otitis Media Based on Computed Tomography

Research and Application Progress of Wideband Tympanometry

Modeling and wavelet analysis of otoacoustic emission signals

Material characterization of human middle ear using machine-learning-based surrogate models

Towards an optical diagnostic system for otitis media using a combination of otoscopy and spectroscopy.