Abstract:Early detection and treatment of visual impairment diseases are critical and integral to combating avoidable blindness. To enable this, artificial intelligence–based disease identification approaches are vital for visual impairment diseases, especially for people living in areas with a few ophthalmologists. In this study, we demonstrated the identification of a large variety of visual impairment diseases using a coarse-to-fine approach. We designed a hierarchical deep learning network, which is composed of a family of multi-task & multi-label learning classifiers representing different levels of eye diseases derived from a predefined hierarchical eye disease taxonomy. A multi-level disease–guided loss function was proposed to learn the fine-grained variability of eye disease features. The proposed framework was trained for both ocular surface and retinal images, independently. The training dataset comprised 7,100 clinical images from 1,600 patients with 100 diseases. To show the feasibility of the proposed framework, we demonstrated eye disease identification on the first two levels of the eye disease taxonomy, namely 7 ocular diseases with 4 ocular surface diseases and 3 retinal fundus diseases in level 1 and 17 subclasses with 9 ocular surface diseases and 8 retinal fundus diseases in level 2. The proposed framework is flexible and extensible, which can be inherently trained on more levels with sufficient training data for each subtype diseases (e.g., the 17 classes of level 2 include 100 subtype diseases defined as level 3 diseases). The performance of the proposed framework was evaluated against 40 board-certified ophthalmologists on clinical cases with various visual impairment diseases and showed that the proposed framework had high sensitivity and specificity with the area under the receiver operating characteristic curve ranging from 0.743 to 0.989 in identifying all identified major causes of blindness. Further assessment of 4,670 cases in a tertiary eye center also demonstrated that the proposed framework achieved a high identification accuracy rate for different visual impairment diseases compared with that of human graders in a clinical setting. The proposed hierarchical deep learning framework would improve clinical practice in ophthalmology and broaden the scope of service available, especially for people living in areas with a few ophthalmologists.

Deep Neural Network Based Disease Discrimination Learning from Small Medical Image Training Set and User Feedback

Building Disease Detection Algorithms with Very Small Numbers of Positive Samples

Large Data of Medical Images Driven Repeatable Diseases Intelligent Diagnosis Model using Deep Learning Technology

Hierarchical deep learning models using transfer learning for disease detection and classification based on small number of medical images

Disease Inference from Health-Related Questions via Sparse Deep Learning

Small Sample-Based Disease Diagnosis Model Acquisition in Medical Human-Centered Computing

Deep Learning Based Data Augmentation and Classification for Limited Medical Data Learning

Deep kNN for Medical Image Classification

Single Model Deep Learning on Imbalanced Small Datasets for Skin Lesion Classification

CheXseen: Unseen Disease Detection for Deep Learning Interpretation of Chest X-rays

Image-based Dementia Disease Diagnosis Via Deep Low-Resource Pair-Wise Learning

A Survey on Deep Learning of Small Sample in Biomedical Image Analysis

DBTN: An adaptive neural network for multiple-disease detection via imbalanced medical images distribution

An investigation of CNN models for differentiating malignant from benign lesions using small pathologically proven datasets

An Adaptive Query Approach for Extracting Medical Images for Disease Detection Applications

Deep Learning for Medical Image-Based Cancer Diagnosis

Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning

Exploring Web Images to Enhance Skin Disease Analysis under A Computer Vision Framework

Self-paced Convolutional Neural Network for Computer Aided Detection in Medical Imaging Analysis

A Novel Hierarchical Deep Learning Framework for Diagnosing Multiple Visual Impairment Diseases in the Clinical Environment

Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets