Abstract:PURPOSE:Early screening is crucial to improve the survival rate and recovery rate of lung cancer patients. Computer-aided diagnosis system (CAD) is a powerful tool to assist clinicians in early diagnosis. Lung nodules are characterized by spatial heterogeneity. However, many attempts use the two-dimensional multi-view (MV) framework to learn and simply integrate multiple view features. These methods suffer from the problems of not capturing the spatial characteristics effectively and ignoring the variability of multiple views. In this paper, we propose a three-dimensional MV convolutional neural network (3D MVCNN) framework and embed the squeeze-and-excitation (SE) module in it to further address the variability of each view in the MV framework.METHODS:First, the 3D multiple view samples of lung nodules are extracted by the spatial sampling method, and a 3D CNN is established to extract 3D abstract features. Second, build a 3D MVCNN framework according to the 3D multiple view samples and 3D CNN. This framework can learn more features of different views of lung nodules, taking into account the characteristics of spatial heterogeneity of lung nodules. Finally, to further address the variability of each view in the MV framework, a 3D MVSECNN model is constructed by introducing a SE module in the feature fusion stage. For training and testing purposes we used independent subsets of the public LIDC-IDRI dataset.RESULTS:For the LIDC-IDRI dataset, this study achieved 96.04% accuracy and 98.59% sensitivity in the binary classification, and 87.76% accuracy in the ternary classification, which was higher than other state-of-the-art studies. The consistency score of 0.948 between the model predictions and pathological diagnosis was significantly higher than that between the clinician's annotations and pathological diagnosis.CONCLUSIONS:The results show that our proposed method can effectively learn the spatial heterogeneity of nodules and solve the problem of multiple view variability. Moreover, the consistency analysis indicates that our method can provide clinicians with more accurate results of benign-malignant lung nodule classification for auxiliary diagnosis, which is important for assisting clinicians in clinical diagnosis.

Multiview Convolutional Neural Networks for Lung Nodule Classification.

3D multi-view convolutional neural networks for lung nodule classification

A Multi-View Deep Convolutional Neural Networks For Lung Nodule Segmentation

A Hybrid CNN Feature Model for Pulmonary Nodule Malignancy Risk Differentiation.

3D Multi-View Squeeze-and-excitation Convolutional Neural Network for Lung Nodule Classification

Multi-crop Convolutional Neural Networks for Lung Nodule Malignancy Suspiciousness Classification.

Multi-scale Convolutional Neural Networks for Lung Nodule Classification.

Lung Nodule Malignancy Prediction Using Multi-Task Convolutional Neural Network

Attention Aware and Multiple Granularity 3D Convolutional Neural Networks for Lung Nodule Classification on CT Image

Classification Of Lung Nodule Malignancy Risk On Computed Tomography Images Using Convolutional Neural Network: A Comparison Between 2d And 3d Strategies

An attention-based deep learning network for lung nodule malignancy discrimination

Multi-Task Learning for Lung Nodule Classification on Chest CT

Multi-view Multi-Scale CNNs for Lung Nodule Type Classification from CT Images

Multi-view secondary input collaborative deep learning for lung nodule 3D segmentation

Multi-Scale Multi-View Model Based on Ensemble Attention for Benign-Malignant Lung Nodule Classification on Chest CT

Pulmonary Nodule Classification with Multi-View Convolutional Vision Transformer

Attention-guided deep neural network with a multichannel architecture for lung nodule classification

MSCS-DeepLN: Evaluating Lung Nodule Malignancy Using Multi-Scale Cost-Sensitive Neural Networks

TumorNet: Lung Nodule Characterization Using Multi-View Convolutional Neural Network with Gaussian Process

Using Deep Learning for Classification of Lung Nodules on Computed Tomography Images

Pulmonary nodule classification in lung cancer screening with three-dimensional convolutional neural networks