Abstract:Background: Middle ear diseases such as otitis media and middle ear effusion, for which diagnoses are often delayed or misdiagnosed, are among the most common issues faced by clinicians providing primary care for children and adolescents. Artificial intelligence (AI) has the potential to assist clinicians in the detection and diagnosis of middle ear diseases through imaging. Methods: Otoendoscopic images obtained by otolaryngologists from Taipei Veterans General Hospital in Taiwan between Jany 1, 2011 to Dec 31, 2019 were collected retrospectively and de-identified. The images were entered into convolutional neural network (CNN) training models after data pre-processing, augmentation and splitting. To differentiate sophisticated middle ear diseases, nine CNN-based models were constructed to recognize middle ear diseases. The best-performing models were chosen and ensembled in a small CNN for mobile device use. The pretrained model was converted into the smartphone-based program, and the utility was evaluated in terms of detecting and classifying ten middle ear diseases based on otoendoscopic images. A class activation map (CAM) was also used to identify key features for CNN classification. The performance of each classifier was determined by its accuracy, precision, recall, and F1-score. Findings: A total of 2820 clinical eardrum images were collected for model training. The programme achieved a high detection accuracy for binary outcomes (pass/refer) of otoendoscopic images and ten different disease categories, with an accuracy reaching 98.0% after model optimisation. Furthermore, the application presented a smooth recognition process and a user-friendly interface and demonstrated excellent performance, with an accuracy of 97.6%. A fifty-question questionnaire related to middle ear diseases was designed for practitioners with different levels of clinical experience. The AI-empowered mobile algorithm's detection accuracy was generally superior to that of general physicians, resident doctors, and otolaryngology specialists (36.0%, 80.0% and 90.0%, respectively). Our results show that the proposed method provides sufficient treatment recommendations that are comparable to those of specialists. Interpretation: We developed a deep learning model that can detect and classify middle ear diseases. The use of smartphone-based point-of-care diagnostic devices with AI-empowered automated classification can provide real-world smart medical solutions for the diagnosis of middle ear diseases and telemedicine. Funding: This study was supported by grants from the Ministry of Science and Technology (MOST110-2622-8-075-001, MOST110-2320-B-075-004-MY3, MOST-110-2634-F-A49 -005, MOST110-2745-B-075A-001A and MOST110-2221-E-075-005), Veterans General Hospitals and University System of Taiwan Joint Research Program (VGHUST111-G6-11-2, VGHUST111c-140), and Taipei Veterans General Hospital (V111E-002-3).

Artificial Intelligence With Deep Learning Based Automated Ear Infection Detection

OtoMatch: Content-based eardrum image retrieval using deep learning

Comprehensive comparison of modified deep convolutional neural networks for automated detection of external and middle ear conditions

Artificial Intelligence to Diagnose Ear Disease Using Otoscopic Image Analysis: a Review

Smartphone-based artificial intelligence using a transfer learning algorithm for the detection and diagnosis of middle ear diseases: A retrospective deep learning study

Development and validation of a smartphone-based deep-learning-enabled system to detect middle-ear conditions in otoscopic images

An Advanced Machine Learning Approach for High Accuracy Automated Diagnosis of Otitis Media with Effusion in Different Age Groups Using 3D Wideband Acoustic Immittance.

Ear-Keeper: Real-time Diagnosis of Ear Lesions Utilizing Ultralight-Ultrafast ConvNet and Large-scale Ear Endoscopic Dataset

Classification of Ear Imagery Database using Bayesian Optimization based on CNN-LSTM Architecture

Efficient and accurate identification of ear diseases using an ensemble deep learning model

Artificial intelligence to classify ear disease from otoscopy: A systematic review and meta-analysis

Diagnosis, Treatment, and Management of Otitis Media with Artificial Intelligence

Hearing Loss Detection in Medical Multimedia Data by Discrete Wavelet Packet Entropy and Single-Hidden Layer Neural Network Trained by Adaptive Learning-Rate Back Propagation.

A novel radiological software prototype for automatically detecting the inner ear and classifying normal from malformed anatomy

A Hybrid Deep Learning Approach to Identify Preventable Childhood Hearing Loss

Deep Learning Based Entropy Controlled Optimization for the Detection of Covid-19

Deep Learning for Classification of Pediatric Otitis Media

Artificial intelligence framework for heart disease classification from audio signals

Deep learning solutions for inverse problems in advanced biomedical image analysis on disease detection

Analysing Wideband Absorbance Immittance in Normal and Ears with Otitis Media with Effusion Using Machine Learning

Artificial intelligence approaches for tinnitus diagnosis: leveraging high-frequency audiometry data for enhanced clinical predictions