Abstract:Background: Lung cancer is a global disease with high lethality, with early screening being considerably helpful for improving the 5-year survival rate. Multimodality features in early screening imaging are an important part of the prediction for lung adenocarcinoma, and establishing a model for adenocarcinoma diagnosis based on multimodal features is an obvious clinical need. Through our practice and investigation, we found that graph neural networks (GNNs) are excellent platforms for multimodal feature fusion, and the data can be completed using the edge-generation network. Therefore, we propose a new lung adenocarcinoma multiclassification model based on multimodal features and an edge-generation network. Methods: According to a ratio of 80% to 20%, respectively, the dataset of 338 cases was divided into the training set and the test set through 5-fold cross-validation, and the distribution of the 2 sets was the same. First, the regions of interest (ROIs) cropped from computed tomography (CT) images were separately fed into convolutional neural networks (CNNs) and radiomics processing platforms. The results of the 2 parts were then input into a graph embedding representation network to obtain the fused feature vectors. Subsequently, a graph database based on the clinical and semantic features was established, and the data were supplemented by an edge-generation network, with the fused feature vectors being used as the input of the nodes. This enabled us to clearly understand where the information transmission of the GNN takes place and improves the interpretability of the model. Finally, the nodes were classified using GNNs. Results: On our dataset, the proposed method presented in this paper achieved superior results compared to traditional methods and showed some comparability with state-of-the-art methods for lung nodule classification. The results of our method are as follows: accuracy (ACC) =66.26% (±4.46%), area under the curve (AUC) =75.86% (±1.79%), F1-score =64.00% (±3.65%), and Matthews correlation coefficient (MCC) =48.40% (±5.07%). The model with the edge-generating network consistently outperformed the model without it in all aspects. Conclusions: The experiments demonstrate that with appropriate data=construction methods GNNs can outperform traditional image processing methods in the field of CT-based medical image classification. Additionally, our model has higher interpretability, as it employs subjective clinical and semantic features as the data construction approach. This will help doctors better leverage human-computer interactions.

Classification of Lung Adenocarcinoma Subtypes Based on ViT-DenseNet

Res-TransNet: A Hybrid deep Learning Network for Predicting Pathological Subtypes of lung Adenocarcinoma in CT Images

Transformaer‐based model for lung adenocarcinoma subtypes

Lung cancer histology classification from CT images based on radiomics and deep learning models

A dual data stream hybrid neural network for classifying pathological images of lung adenocarcinoma

CC-DCNet: Dynamic Convolutional Neural Network with Contrastive Constraints for Identifying Lung Cancer Subtypes on Multi-modality Images

Classification on Histological Subtypes of Lung Adenocarcinoma from Low-Resolution CT Images Based on DenseNet

AResNet-ViT: A Hybrid CNN-Transformer Network for Benign and Malignant Breast Nodule Classification in Ultrasound Images

A novel benign and malignant classification model for lung nodules based on multi-scale interleaved fusion integrated network

An attention-based deep learning network for lung nodule malignancy discrimination

A Multi-Task Convolutional Neural Network for Lesion Region Segmentation and Classification of Non-Small Cell Lung Carcinoma

Histological Subtype Classification of Non-Small Cell Lung Cancer with Radiomics and 3D Convolutional Neural Networks

Lung adenocarcinoma identification based on hybrid feature selections and attentional convolutional neural networks

A graph neural network model for the diagnosis of lung adenocarcinoma based on multimodal features and an edge-generation network

Multi-Dimension and Multi-Feature Hybrid Learning Network for Classifying the Sub Pathological Type of Lung Nodules through LDCT

LW-MorphCNN: A lightweight morphological attention-based subtype classification network for lung cancer

Cnn models aided with a metaclassifier for lung Carcinoma classification using histopathological images

Lung Cancer Classification Using Image Enhancement and CNN-Based Pre-Trained Models

Precise and automated lung cancer cell classification using deep neural network with multiscale features and model distillation

Deep Learning Features For Lung Adenocarcinoma Classification With Tissue Pathology Images

A novel fusion algorithm for benign-malignant lung nodule classification on CT images