Abstract:Objective: Keratitis is the primary cause of corneal blindness worldwide. Prompt identification and referral of patients with keratitis are fundamental measures to improve patient prognosis. Although deep learning can assist ophthalmologists in automatically detecting keratitis through a slit lamp camera, remote and underserved areas often lack this professional equipment. Smartphones, a widely available device, have recently been found to have potential in keratitis screening. However, given the limited data available from smartphones, employing traditional deep learning algorithms to construct a robust intelligent system presents a significant challenge. This study aimed to propose a meta-learning framework, cosine nearest centroid-based metric learning (CNCML), for developing a smartphone-based keratitis screening model in the case of insufficient smartphone data by leveraging the prior knowledge acquired from slit-lamp photographs. Methods: We developed and assessed CNCML based on 13,009 slit-lamp photographs and 4,075 smartphone photographs that were obtained from 3 independent clinical centers. To mimic real-world scenarios with various degrees of sample scarcity, we used training sets of different sizes (0 to 20 photographs per class) from the HUAWEI smartphone to train CNCML. We evaluated the performance of CNCML not only on an internal test dataset but also on two external datasets that were collected by two different brands of smartphones (VIVO and XIAOMI) in another clinical center. Furthermore, we compared the performance of CNCML with that of traditional deep learning models on these smartphone datasets. The accuracy and macro-average area under the curve (macro-AUC) were utilized to evaluate the performance of models. Results: With merely 15 smartphone photographs per class used for training, CNCML reached accuracies of 84.59%, 83.15%, and 89.99% on three smartphone datasets, with corresponding macro-AUCs of 0.96, 0.95, and 0.98, respectively. The accuracies of CNCML on these datasets were 0.56% to 9.65% higher than those of the most competitive traditional deep learning models. Conclusions: CNCML exhibited fast learning capabilities, attaining remarkable performance with a small number of training samples. This approach presents a potential solution for transitioning intelligent keratitis detection from professional devices (e.g., slit-lamp cameras) to more ubiquitous devices (e.g., smartphones), making keratitis screening more convenient and effective.

Deep learning enhanced mobile-phone microscopy

Smart-phone Phase Contrast Microscope with a Singlet Lens and Deep Learning

Deep Learning Virtual Colorization Overcoming Chromatic Aberrations in Singlet Lens Microscopy

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Image Enhancement For Fluorescence Microscopy Based On Deep Learning With Prior Knowledge Of Aberration

Deep Learning Microscopy

Low-cost mobile phone microscopy with a reversed mobile phone camera lens

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Deep Learning-assisted Smartphone-based Quantitative Microscopy for Label-free Peripheral Blood Smear Analysis

Large depth-of-field ultra-compact microscope by progressive optimization and deep learning

High-resolution mobile bio-microscope with smartphone telephoto camera lens

Towards ultra-low-cost smartphone microscopy

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Deep Learning-Based Single-Shot Autofocus Method for Digital Microscopy

Deep learning-based image processing in optical microscopy

Smart mobile microscopy: towards fully-automated digitization

Promoting smartphone-based keratitis screening using meta-learning: A multicenter study

A Survey on Applications of Deep Learning in Microscopy Image Analysis

Deep Learning-Enabled Resolution-Enhancement in Mini- and Regular Microscopy for Biomedical Imaging

Deep learning pipeline for image classification on mobile phones

Portable Deep Learning Singlet Multi-Spectral Microscope