Abstract:BACKGROUND AND OBJECTIVE: Patients with aggressive non-Hodgkin lymphoma (NHL) undergo distinct therapy strategies compared with indolent NHL patients. However, it is challenging to estimate NHL aggressiveness based on visual inspection of positron emission tomography (PET) or computed tomography (CT) images. Since diffuse large B-cell lymphoma (DLBCL) and Follicular lymphoma (FL) are the most typical and dominant aggressive and indolent NHL, respectively, this study aims to develop an artificial-intelligence-enabled model to distinguish DLBCL from FL in PET/CT images as the first step to tackle this challenge.METHODS: We propose a hybrid few-shot multiple-instance learning model to predict the aggressiveness of the NHL. First, rotation-based self-supervision learning (SSL) has been employed to train the encoder on a large-scale, publicly available CT image dataset. Second, hybrid instance-level features are obtained for each NHL lesion by combining deep features with the radiomics features from both PET and CT modalities. Third, instance-level features are transformed into bag-level (or patient-level) representations. Finally, bag-level representations are fed into a distance-based classifier through few-shot learning to predict NHL aggressiveness.RESULTS: Our model achieves an accuracy of 0.751 ± 0.008, a sensitivity of 0.787 ± 0.012, a specificity of 0.715 ± 0.013, an F1-score of 0.753 ± 0.009, and an area under the curve (AUC) of 0.795 ± 0.009 at the bag level. It outperforms the typical counterparts that use the radiomic features, random forest for feature selection, and support vector machines (SVMs) as classifiers. The three counterparts yield accuracies of 0.714 ± 0.023, 0.705 ± 0.008, and 0.698 ± 0.008, respectively. Moreover, settings of the SSL training dataset (Deep lesion) and task (rotation), hybrid CT and radiomic PET features, the pool-layer strategy of maximum, and distance-based classifier generate the best model.CONCLUSIONS: A hybrid few-shot multiple-instance learning model can predict lymphoma aggressiveness in PET/CT images and could be a potential tool for determining therapy strategies. Hybrid features and the combination of SSL, few-shot learning, and weakly supervised learning are the two powerful pillars of the model, and these can be expanded to other medical applications with limited samples and incomplete annotations.

Contrast effects of a gadolinium filter.

Artificial Classification of Cervical Squamous Lesions in ThinPrep Cytologic Tests Using a Deep Convolutional Neural Network.

[Botulinum toxin injection-treatment of upper lid retraction in thyroid eye disease].

False Positive Reduction in Lymph Node Detection by Using Convolutional Neural Network with Multi-view Input

A hybrid few-shot multiple-instance learning model predicting the aggressiveness of lymphoma in PET/CT images

MMViT-Seg: A Lightweight Transformer and CNN Fusion Network for COVID-19 Segmentation.

[An Improved Vision Transformer Model for the Recognition of Blood Cells].

Automatic Blood Cell Detection Based on Advanced YOLOv5s Network

Hybrid adversarial-discriminative network for leukocyte classification in leukemia

High‐Accuracy and Lightweight Image Classification Network for Optimizing Lymphoblastic Leukemia Diagnosisy

AutoLNMNet: Automated Network for Estimating Lymph‐Node Metastasis in EGC Using a Pyramid Vision Transformer and Data Derived From Multiphoton Microscopy

CB-HVTNet: A channel-boosted hybrid vision transformer network for lymphocyte assessment in histopathological images

Automated Identification of Cell Populations in Flow Cytometry Data with Transformers

CoTCoNet: An Optimized Coupled Transformer-Convolutional Network with an Adaptive Graph Reconstruction for Leukemia Detection

Automatic classification of acute lymphoblastic leukemia cells and lymphocyte subtypes based on a novel convolutional neural network

ResNeXt-CC: a novel network based on cross-layer deep-feature fusion for white blood cell classification

Weakly Supervised Ternary Stream Data Augmentation Fine-Grained Classification Network for Identifying Acute Lymphoblastic Leukemia

A deep transfer learning based approaches for the detection and classification of acute lymphocytic leukemia using microscopic images

AResNet-ViT: A Hybrid CNN-Transformer Network for Benign and Malignant Breast Nodule Classification in Ultrasound Images

Modified YOLO network model for metaphase cell detection in antinuclear antibody images

Heart failure and malnutrition.