Abstract:Background Orbital tumors present a diagnostic challenge due to their varied locations and histopathological differences. Although recent advancements in imaging have improved diagnosis, classification remains a challenge. The integration of artificial intelligence in radiology and ophthalmology has demonstrated promising outcomes. Purpose This study aimed to evaluate the performance of machine learning models in accurately distinguishing malignant orbital tumors from benign ones using multiparametric 3 T magnetic resonance imaging (MRI) data. Materials and Methods In this single-center prospective study, patients with orbital masses underwent presurgery 3 T MRI scans between December 2015 and May 2021. The MRI protocol comprised multiparametric imaging including dynamic contrast-enhanced (DCE), diffusion-weighted imaging (DWI), intravoxel incoherent motion (IVIM), as well as morphological imaging acquisitions. A repeated nested cross-validation strategy using random forest classifiers was used for model training and evaluation, considering 8 combinations of explanatory features. Shapley additive explanations (SHAP) values were used to assess feature contributions, and the model performance was evaluated using multiple metrics. Results One hundred thirteen patients were analyzed (57/113 [50.4%] were women; average age was 51.5 ± 17.5 years, range: 19–88 years). Among the 8 combinations of explanatory features assessed, the performance on predicting malignancy when using the most comprehensive model, which is the most exhaustive one incorporating all 46 explanatory features—including morphology, DWI, DCE, and IVIM, achieved an area under the curve of 0.9 [0.73–0.99]. When using the streamlined “10-feature signature” model, performance reached an area under the curve of 0.88 [0.71–0.99]. Random forest feature importance graphs measured by the mean of SHAP values pinpointed the 10 most impactful features, which comprised 3 quantitative IVIM features, 4 quantitative DCE features, 1 quantitative DWI feature, 1 qualitative DWI feature, and age. Conclusions Our findings demonstrate that a machine learning approach, integrating multiparametric MRI data such as DCE, DWI, IVIM, and morphological imaging, offers high-performing models for differentiating malignant from benign orbital tumors. The streamlined 10-feature signature, with a performance close to the comprehensive model, may be more suitable for clinical application.

The utility of orbital imaging in the evaluation of orbital disease

A comparative analysis of imaging examination of orbital lymphoma

Evaluation of orbital lesions with DCE-MRI: a literature review

Differentiation of bacterial orbital cellulitis and diffuse non-specific orbital inflammation on magnetic resonance imaging

Use of a handheld ultrasound device for detecting orbital inflammation

To Explore MR Imaging Radiomics for the Differentiation of Orbital Lymphoma and IgG4-Related Ophthalmic Disease

Content-based image retrieval assists radiologists in diagnosing eye and orbital mass lesions in MRI

Toward Precision Diagnosis

Spectrum of Orbital Cellulitis on Magnetic Resonance Imaging

Diagnostic Performance of Dynamic Contrast-Enhanced 3T MR Imaging for Characterization of Orbital Lesions: Validation in a Large Prospective Study

Differentiation of Malignant from Benign Orbital Tumours Using Dual-Energy CT.

Semiautomated MRI-Based Method for Orbital Volume and Contour Analysis

Differentiation of Orbital Lymphoma and Idiopathic Orbital Inflammatory Pseudotumor: Combined Diagnostic Value of Conventional MRI and Histogram Analysis of ADC Maps

Toward Precision Diagnosis: Machine Learning in Identifying Malignant Orbital Tumors With Multiparametric 3 T MRI

Evaluation of unilateral exophthalmos with ultrasonography: analysis of 258 consecutive cases

Evaluation of Activity of Graves' Orbitopathy with Multiparameter Orbital Magnetic Resonance Imaging (MRI)

Orbital magnetic resonance imaging of giant cell arteritis with ocular manifestations: a systematic review and individual participant data meta-analysis

CT and MRI Features of Primary Orbital Lymphoma: Review of 14 Cases

CT and MRI Imaging Features of Orbital Lymphomas

Computed tomography and magnetic resonance imaging approaches to Graves’ ophthalmopathy: a narrative review

Orbital Computed Tomography Imaging Characteristics of Thyroid-Associated Ophthalmopathy