Abstract:Deep learning-based ear disease diagnosis technology has proven effective and affordable. However, due to the lack of ear endoscope datasets with diversity, the practical potential of the deep learning model has not been thoroughly studied. Moreover, existing research failed to achieve a good trade-off between model inference speed and parameter size, rendering models inapplicable in real-world settings. To address these challenges, we constructed the first large-scale ear endoscopic dataset comprising eight types of ear diseases and disease-free samples from two institutions. Inspired by ShuffleNetV2, we proposed Best-EarNet, an ultrafast and ultralight network enabling real-time ear disease diagnosis. Best-EarNet incorporates a novel Local-Global Spatial Feature Fusion Module and multi-scale supervision strategy, which facilitates the model focusing on global-local information within feature maps at various levels. Utilizing transfer learning, the accuracy of Best-EarNet with only 0.77M parameters achieves 95.23% (internal 22,581 images) and 92.14% (external 1,652 images), respectively. In particular, it achieves an average frame per second of 80 on the CPU. From the perspective of model practicality, the proposed Best-EarNet is superior to state-of-the-art backbone models in ear lesion detection tasks. Most importantly, Ear-keeper, an intelligent diagnosis system based Best-EarNet, was developed successfully and deployed on common electronic devices (smartphone, tablet computer and personal computer). In the future, Ear-Keeper has the potential to assist the public and healthcare providers in performing comprehensive scanning and diagnosis of the ear canal in real-time video, thereby promptly detecting ear lesions.

The Chongqing University ChineSe Ear Video Database and Its Application

CHEAVD: a Chinese natural emotional audio–visual database

Three Applications and the Challenge of the Big Data in Otology

Building a Chinese Natural Emotional Audio-Visual Database

Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

CHAD: a chinese affective database

The Thu Multi-View Face Database for Videoconferences and Baseline Evaluations

CNAMD Corpus: A Chinese Natural Audiovisual Multimodal Database of Conversations for Social Interactive Agents

HEU Emotion: A Large-scale Database for Multi-modal Emotion Recognition in the Wild

CFEW: A Large-Scale Database for Understanding Child Facial Expression in Real World

Esaa: An Eeg-Speech Auditory Attention Detection Database

Audio-Visual Quality Assessment for User Generated Content: Database and Method

An Efficient Approach of 3D Ear Recognition

Audiovisual Database with 360 Video and Higher-Order Ambisonics Audio for Perception, Cognition, Behavior, and QoE Evaluation Research

A standardized database of Chinese emotional short videos based on age and gender differences

THU Face Database for Real-Time Automatic Video Scoring Model

The CAS-PEAL Large-Scale Chinese Face Database and Baseline Evaluations

Ear-Keeper: Real-time Diagnosis of Ear Lesions Utilizing Ultralight-Ultrafast ConvNet and Large-scale Ear Endoscopic Dataset

Research on the Application of Speech Database based on Emotional Feature Extraction in International Chinese Education and Teaching

Deep Complex U-Net with Conformer for Audio-Visual Speech Enhancement

AudioEar: Single-View Ear Reconstruction for Personalized Spatial Audio