Abstract:Background: Positron emission tomography (PET) is extensively employed for diagnosing and staging various tumors, including liver cancer, lung cancer, and lymphoma. Accurate subtype classification of tumors plays a crucial role in formulating effective treatment plans for patients. Notably, lymphoma comprises subtypes like diffuse large B-cell lymphoma and Hodgkin's lymphoma, while lung cancer encompasses adenocarcinoma, small cell carcinoma, and squamous cell carcinoma. Similarly, liver cancer consists of subtypes such as cholangiocarcinoma and hepatocellular carcinoma. Consequently, the subtype classification of tumors based on PET images holds immense clinical significance. However, in clinical practice, the number of cases available for each subtype is often limited and imbalanced. Therefore, the primary challenge lies in achieving precise subtype classification using a small dataset. Method: This paper presents a novel approach for tumor subtype classification in small datasets using RA-DL (Radiomics-DeepLearning) attention. To address the limited sample size, Support Vector Machines (SVM) is employed as the classifier for tumor subtypes instead of deep learning methods. Emphasizing the importance of texture information in tumor subtype recognition, radiomics features are extracted from the tumor regions during the feature extraction stage. These features are compressed using an autoencoder to reduce redundancy. In addition to radiomics features, deep features are also extracted from the tumors to leverage the feature extraction capabilities of deep learning. In contrast to existing methods, our proposed approach utilizes the RA-DL-Attention mechanism to guide the deep network in extracting complementary deep features that enhance the expressive capacity of the final features while minimizing redundancy. To address the challenges of limited and imbalanced data, our method avoids using classification labels during deep feature extraction and instead incorporates 2D Region of Interest (ROI) segmentation and image reconstruction as auxiliary tasks. Subsequently, all lesion features of a single patient are aggregated into a feature vector using a multi-instance aggregation layer. Result: Validation experiments were conducted on three PET datasets, specifically the liver cancer dataset, lung cancer dataset, and lymphoma dataset. In the context of lung cancer, our proposed method achieved impressive performance with Area Under Curve (AUC) values of 0.82, 0.84, and 0.83 for the three-classification task. For the binary classification task of lymphoma, our method demonstrated notable results with AUC values of 0.95 and 0.75. Moreover, in the binary classification task of liver tumor, our method exhibited promising performance with AUC values of 0.84 and 0.86. Conclusion: The experimental results clearly indicate that our proposed method outperforms alternative approaches significantly. Through the extraction of complementary radiomics features and deep features, our method achieves a substantial improvement in tumor subtype classification performance using small PET datasets.

Classification of Lymphoma Subtypes in PET/CT Images Based on a Bidirectional Feature Fusion Method.

Multiclassifier Fusion Based on Radiomics Features for the Prediction of Benign and Malignant Primary Pulmonary Solid Nodules

Diffuse Large B-cell Lymphoma Segmentation in PET-CT Images Via Hybrid Learning for Feature Fusion

Vision Transformer-based Multimodal Feature Fusion Network for Lymphoma Segmentation on PET/CT Images

A hybrid few-shot multiple-instance learning model predicting the aggressiveness of lymphoma in PET/CT images

A multi-instance tumor subtype classification method for small PET datasets using RA-DL attention module guided deep feature extraction with radiomics features

Deep PET/CT fusion with Dempster-Shafer theory for lymphoma segmentation

Hybrid Attention Fusion Segmentation Network for Diffuse Large B-cell Lymphoma in PET-CT

Joint Lymphoma Lesion Segmentation and Prognosis Prediction from Baseline FDG-PET Images Via Multitask Convolutional Neural Networks

3D Lymphoma Segmentation on PET/CT Images Via Multi-Scale Information Fusion with Cross-Attention

Automatic Detection and Classification of Regions of FDG Uptake in Whole-Body PET-CT Lymphoma Studies

Multimodal deep learning model on interim [18F]FDG PET/CT for predicting primary treatment failure in diffuse large B-cell lymphoma

Histologic Subtype Classification of Non-Small Cell Lung Cancer Using PET/CT Images

Deep Learning for Variational Multimodality Tumor Segmentation in PET/CT

Advances in the Application of 18F-FDG PET/CT Radiomics for Diagnosis, Treatment and Prognosis Prediction of Lymphoma

Harnessing Deep Learning for Accurate Pathological Assessment of Brain Tumor Cell Types

Evaluation of machine learning classifiers for diagnosing mediastinal lymph node metastasis of lung cancer from PET/CT images

Comprehensive framework for evaluation of deep neural networks in detection and quantification of lymphoma from PET/CT images: clinical insights, pitfalls, and observer agreement analyses

Comparison of machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer from 18F-FDG PET/CT images

A classification method for tumor of PET-CT image of multi feature fusion for lung based on Adaboost algorithm

LymphoML: An interpretable artificial intelligence-based method identifies morphologic features that correlate with lymphoma subtype