Abstract:Objectives: The purpose of this study was to develop and validate a new feature fusion algorithm to improve the classification performance of benign and malignant ground-glass nodules (GGNs) based on deep learning. Methods: We retrospectively collected 385 cases of GGNs confirmed by surgical pathology from three hospitals. We utilized 239 GGNs from Hospital 1 as the training and internal validation set, and 115 and 31 GGNs from Hospital 2 and Hospital 3, respectively, as external test sets 1 and 2. Among these GGNs, 172 were benign and 203 were malignant. First, we evaluated clinical and morphological features of GGNs at baseline chest CT and simultaneously extracted whole-lung radiomics features. Then, deep convolutional neural networks (CNNs) and backpropagation neural networks (BPNNs) were applied to extract deep features from whole-lung CT images, clinical, morphological features, and whole-lung radiomics features separately. Finally, we integrated these four types of deep features using an attention mechanism. Multiple metrics were employed to evaluate the predictive performance of the model. Results: The deep learning model integrating clinical, morphological, radiomics and whole lung CT image features with attention mechanism (CMRI-AM) achieved the best performance, with area under the curve (AUC) values of 0.941 (95% CI: 0.898-0.972), 0.861 (95% CI: 0.823-0.882), and 0.906 (95% CI: 0.878-0.932) on the internal validation set, external test set 1, and external test set 2, respectively. The AUC differences between the CMRI-AM model and other feature combination models were statistically significant in all three groups (all p<0.05). Conclusion: Our experimental results demonstrated that (1) applying attention mechanism to fuse whole-lung CT images, radiomics features, clinical, and morphological features is feasible, (2) clinical, morphological, and radiomics features provide supplementary information for the classification of benign and malignant GGNs based on CT images, and (3) utilizing baseline whole-lung CT features to predict the benign and malignant of GGNs is an effective method. Therefore, optimizing the fusion of baseline whole-lung CT features can effectively improve the classification performance of GGNs.

Benign and Malignant Classification of Pulmonary Nodules Based on Multi-Level Feature Fusion

Multiclassifier Fusion Based on Radiomics Features for the Prediction of Benign and Malignant Primary Pulmonary Solid Nodules

Multi-Modal Feature Fusion-Based Multi-Branch Classification Network for Pulmonary Nodule Malignancy Suspiciousness Diagnosis

Lung nodule classification using deep feature fusion in chest radiography

Combining Multi-Scale Feature Fusion with Multi-Attribute Grading, a CNN Model for Benign and Malignant Classification of Pulmonary Nodules.

Fusing Multi-Dimensional Convolution Neural Network for Lung Nodules Classification

Multi-scale Pulmonary Nodule Classification with Deep Feature Fusion Via Residual Network

Fusion of 3D lung CT and serum biomarkers for diagnosis of multiple pathological types on pulmonary nodules

A novel benign and malignant classification model for lung nodules based on multi-scale interleaved fusion integrated network

Classification of Benign and Malignant Pulmonary Nodules Based on Deep Learning

Pulmonary Nodule Detection Based on Multiscale Feature Fusion

Fusing Texture, Shape and Deep Model-Learned Information at Decision Level for Automated Classification of Lung Nodules on Chest CT.

Classification of Benign and Malignant Lung Nodules Based on Deep Convolutional Network Feature Extraction

Prediction of benign and malignant ground glass pulmonary nodules based on multi-feature fusion of attention mechanism

3D Convolutional Neural Networks Fusion Model for Lung Nodule Detection onClinical CT Scans.

Lung Nodule Classification by Jointly Using Visual Descriptors and Deep Features

A novel fusion algorithm for benign-malignant lung nodule classification on CT images

Identification of Benign and Malignant Lung Nodules in CT Images Based on Ensemble Learning Method

Extraction and Classification of Lung Nodule Features Using Fusion Method of Self-Supervised Encoder Learning and Supervised Transfer Learning

Deep-Learning Model of ResNet Combined with CBAM for Malignant–Benign Pulmonary Nodules Classification on Computed Tomography Images

Multi-Scale Supervised Contrastive Learning for Benign-Malignant Classification of Pulmonary Nodules in Chest Ct Scans.