Abstract:Background: Thyroid-associated ophthalmopathy (TAO) is the most prevalent autoimmune orbital condition, significantly impacting patients' appearance and quality of life. Early and accurate identification of active TAO along with timely treatment can enhance prognosis and reduce the occurrence of severe cases. Although the Clinical Activity Score (CAS) serves as an effective assessment system for TAO, it is susceptible to assessor experience bias. This study aimed to develop an ensemble deep learning system that combines anterior segment slit-lamp photographs of patients with facial images to simulate expert assessment of TAO. Method: The study included 156 patients with TAO who underwent detailed diagnosis and treatment at Shanxi Eye Hospital Affiliated to Shanxi Medical University from May 2020 to September 2023. Anterior segment slit-lamp photographs and facial images were used as different modalities and analyzed from multiple perspectives. Two ophthalmologists with more than 10 years of clinical experience independently determined the reference CAS for each image. An ensemble deep learning model based on the residual network was constructed under supervised learning to predict five key inflammatory signs (redness of the eyelids and conjunctiva, and swelling of the eyelids, conjunctiva, and caruncle or plica) associated with TAO, and to integrate these objective signs with two subjective symptoms (spontaneous retrobulbar pain and pain on attempted upward or downward gaze) in order to assess TAO activity. Results: The proposed model achieved 0.906 accuracy, 0.833 specificity, 0.906 precision, 0.906 recall, and 0.906 F1-score in active TAO diagnosis, demonstrating advanced performance in predicting CAS and TAO activity signs compared to conventional single-view unimodal approaches. The integration of multiple views and modalities, encompassing both anterior segment slit-lamp photographs and facial images, significantly improved the prediction accuracy of the model for TAO activity and CAS. Conclusion: The ensemble multi-view multimodal deep learning system developed in this study can more accurately assess the clinical activity of TAO than traditional methods that solely rely on facial images. This innovative approach is intended to enhance the efficiency of TAO activity assessment, providing a novel means for its comprehensive, early, and precise evaluation.

Deep learning-based image analysis of eyelid morphology in thyroid-associated ophthalmopathy

A Novel Automatic Morphologic Analysis of Eyelids Based on Deep Learning Methods

A Novel Approach for Automated Eyelid Measurements in Blepharoptosis Using Digital Image Analysis

An ensemble deep learning diagnostic system for determining Clinical Activity Scores in thyroid-associated ophthalmopathy: integrating multi-view multimodal images from anterior segment slit-lamp photographs and facial images

Retinal Photograph-based Deep Learning System for Detection of Thyroid-Associated Ophthalmopathy

Deep learning-based image analysis for automated measurement of eyelid morphology before and after blepharoptosis surgery

Automated Photographic Analysis of Inferior Oblique Overaction Based on Deep Learning.

An Intelligent Diagnostic System for Thyroid-Associated Ophthalmopathy Based on Facial Images

Assessing the relationship between levator palpebrae superioris and thyroid-associated ophthalmopathy using the Dixon-T2WI sequence

Diffusion Tensor Imaging Technology to Quantitatively Assess Abnormal Changes in Patients With Thyroid-Associated Ophthalmopathy

The significance of ophthalmological features in diagnosis of thyroid-associated ophthalmopathy

Automated Measurement of Ocular Movements Using Deep Learning-Based Image Analysis

Early diagnosis of thyroid-associated ophthalmopathy using label-free Raman spectroscopy and multivariate analysis

Use of extreme gradient boosting, light gradient boosting machine, and deep neural networks to evaluate the activity stage of extraocular muscles in thyroid-associated ophthalmopathy

Automatic Measurement and Comparison of Normal Eyelid Contour by Age and Gender Using Image-Based Deep Learning

A Fully Automatic Postoperative Appearance Prediction System for Blepharoptosis Surgery with Image-based Deep Learning

Corneal Morphological and Biomechanical Changes in Thyroid-Associated Ophthalmopathy

Orbital Computed Tomography Imaging Characteristics of Thyroid-Associated Ophthalmopathy

Analysis of Ocular Surface Functions in Patients with Thyroid Associated Ophthalmopathy

Advances in artificial intelligence in thyroid-associated ophthalmopathy

[Clinical Analysis of 2 170 Cases of Thyroid-Associated Ophthalmopathy Involving Extraocular Muscles].