Abstract:Background: Lung cancer is a malignant tumor, for which pulmonary nodules are considered to be significant indicators. Early recognition and timely treatment of pulmonary nodules can contribute to improving the survival rate of patients with cancer. Positron emission tomography-computed tomography (PET/CT) is a noninvasive, fusion imaging technique that can obtain both functional and structural information of lung regions. However, studies of pulmonary nodules based on computer-aided diagnosis have primarily focused on the nodule level due to a reliance on the annotation of nodules, which is superficial and unable to contribute to the actual clinical diagnosis. The aim of this study was thus to develop a fully automated classification framework for a more comprehensive assessment of pulmonary nodules in PET/CT imaging data. Methods: We developed a two-stage multimodal learning framework for the diagnosis of pulmonary nodules in PET/CT imaging. In this framework, Stage I focuses on pulmonary parenchyma segmentation using a pretrained U-Net and PET/CT registration. Stage II aims to extract, integrate, and recognize image-level and feature-level features by employing the three-dimensional (3D) Inception-residual net (ResNet) convolutional block attention module architecture and a dense-voting fusion mechanism. Results: In the experiments, the proposed model's performance was comprehensively validated using a set of real clinical data, achieving mean scores of 89.98%, 89.21%, 84.75%, 93.38%, 86.83%, and 0.9227 for accuracy, precision, recall, specificity, F1 score, and area under curve values, respectively. Conclusions: This paper presents a two-stage multimodal learning approach for the automatic diagnosis of pulmonary nodules. The findings reveal that the main reason for limiting model performance is the nonsolitary property of nodules in pulmonary nodule diagnosis, providing direction for future research.

A ranking-based lung nodule image classification method using unlabeled image knowledge

Lung nodule classification with multilevel patch-based context analysis.

Unsupervised Representation Learning for Pulmonary Nodule Classification

Knowledge-based Collaborative Deep Learning for Benign-Malignant Lung Nodule Classification on Chest CT.

Context Curves for Classification of Lung Nodule Images

Lung Nodule Classification by Jointly Using Visual Descriptors and Deep Features

Lung Nodule Classification using Deep Local-Global Networks

Overlapping node discovery for improving classification of lung nodules.

Deep Learning for the Classification of Lung Nodules

An Anthropomorphic Diagnosis System of Pulmonary Nodules using Weak Annotation-Based Deep Learning

Using Deep Learning for Classification of Lung Nodules on Computed Tomography Images

Lung Nodule Diagnosis on 3D Computed Tomography Images Using Deep Convolutional Neural Networks

Attention-guided deep neural network with a multichannel architecture for lung nodule classification

Classification of Benign and Malignant Lung Nodules Based on Deep Convolutional Network Feature Extraction

Fully automated classification of pulmonary nodules in positron emission tomography-computed tomography imaging using a two-stage multimodal learning approach

Lung cancer classification and identification framework with automatic nodule segmentation screening using machine learning

Diagnostic classification of lung nodules using 3D neural networks

A Hybrid Deep Learning Approach for Lung Nodule Classification

An Efficient Model for Lungs Nodule Classification Using Supervised Learning Technique

Hidden Conditional Random Field for Lung Nodule Detection.

Unsupervised Multi-discriminator Generative Adversarial Network for Lung Nodule Malignancy Classification