Abstract:BACKGROUND AND OBJECTIVE: Patients with aggressive non-Hodgkin lymphoma (NHL) undergo distinct therapy strategies compared with indolent NHL patients. However, it is challenging to estimate NHL aggressiveness based on visual inspection of positron emission tomography (PET) or computed tomography (CT) images. Since diffuse large B-cell lymphoma (DLBCL) and Follicular lymphoma (FL) are the most typical and dominant aggressive and indolent NHL, respectively, this study aims to develop an artificial-intelligence-enabled model to distinguish DLBCL from FL in PET/CT images as the first step to tackle this challenge.METHODS: We propose a hybrid few-shot multiple-instance learning model to predict the aggressiveness of the NHL. First, rotation-based self-supervision learning (SSL) has been employed to train the encoder on a large-scale, publicly available CT image dataset. Second, hybrid instance-level features are obtained for each NHL lesion by combining deep features with the radiomics features from both PET and CT modalities. Third, instance-level features are transformed into bag-level (or patient-level) representations. Finally, bag-level representations are fed into a distance-based classifier through few-shot learning to predict NHL aggressiveness.RESULTS: Our model achieves an accuracy of 0.751 ± 0.008, a sensitivity of 0.787 ± 0.012, a specificity of 0.715 ± 0.013, an F1-score of 0.753 ± 0.009, and an area under the curve (AUC) of 0.795 ± 0.009 at the bag level. It outperforms the typical counterparts that use the radiomic features, random forest for feature selection, and support vector machines (SVMs) as classifiers. The three counterparts yield accuracies of 0.714 ± 0.023, 0.705 ± 0.008, and 0.698 ± 0.008, respectively. Moreover, settings of the SSL training dataset (Deep lesion) and task (rotation), hybrid CT and radiomic PET features, the pool-layer strategy of maximum, and distance-based classifier generate the best model.CONCLUSIONS: A hybrid few-shot multiple-instance learning model can predict lymphoma aggressiveness in PET/CT images and could be a potential tool for determining therapy strategies. Hybrid features and the combination of SSL, few-shot learning, and weakly supervised learning are the two powerful pillars of the model, and these can be expanded to other medical applications with limited samples and incomplete annotations.

Deep learning-based interpretable prediction of recurrence of diffuse large B-cell lymphoma

A Deep Learning Diagnostic Platform for Diffuse Large B-cell Lymphoma with High Accuracy Across Multiple Hospitals

Computational Pathology for Accurate Prediction of Breast Cancer Recurrence: Development and Validation of a Deep Learning-based Tool

Deep Learning-based Recurrence Prediction in Patients with Non-muscle-invasive Bladder Cancer

Prognosis Prediction of Diffuse Large B-cell Lymphoma in $^{18}$F-FDG PET Images Based on Multi-Deep-Learning Models

IDDF2022-ABS-0265 Deep Learning for Predicting Postoperative Recurrence of Colorectal Cancer Based on Histological Images

A hybrid few-shot multiple-instance learning model predicting the aggressiveness of lymphoma in PET/CT images

Prognosis Prediction of Diffuse Large B-Cell Lymphoma in 18F-FDG PET Images Based on Multi-Deep-Learning Models

Integration of clinical features and deep learning on pathology for the prediction of breast cancer recurrence assays and risk of recurrence

Interpretable Survival Prediction for Colorectal Cancer using Deep Learning

Deep Learning Model for Predicting Lung Adenocarcinoma Recurrence from Whole Slide Images

Preoperative prediction of lymph node metastasis using deep learning-based features

Predicting Relapse in Patients With Triple Negative Breast Cancer (TNBC) Using a Deep-Learning Approach

Interpretable Prediction of Lung Squamous Cell Carcinoma Recurrence With Self-supervised Learning

Classifying 2-year recurrence in patients with dlbcl using clinical variables with imbalanced data and machine learning methods

Predicting 5-year recurrence risk in colorectal cancer: development and validation of a histology-based deep learning approach

Multimodal Deep Learning Model on Interim 18F-FDG PET/CT for Predicting Primary Treatment Failure of Diffuse Large B-cell Lymphoma

Prediction of non-muscle invasive bladder cancer recurrence using deep learning of pathology image

A new model using deep learning to predict recurrence after surgical resection of lung adenocarcinoma

Deep learning radiomics based on contrast enhanced MRI for preoperatively predicting early recurrence in hepatocellular carcinoma after curative resection

Regression-based Deep-Learning predicts molecular biomarkers from pathology slides