Abstract:Background: The latest international multidisciplinary histopathological classification of lung cancer indicates that a deeper study of the lung adenocarcinoma requires a comprehensive multidisciplinary platform. However, in the traditional pathological examination or previous computer-vision-based research, the entire lung is not considered in a comprehensive manner. Purpose: The study aims to develop a deep learning model proposed for diagnosing the lung adenocarcinoma histopathologically based on CT scans. Instead of just classifying the lung adenocarcinoma, the pathological report should be inferred based on both the invasiveness and growth pattern of the tumors. Methods: A self-distillation trained multitask dense-attention network (SD-MdaNet) is proposed and validated based on 2412 labeled CT scans from 476 patients and 845 unlabeled scans. Inferring the pathological report is divided into two tasks, predicting the invasiveness of the lung tumor and inferring growth patterns of tumor cells in a comprehensive histopathological subtyping manner with excellent accuracy. In the proposed method, the dense-attention module is introduced to better extract features from a small dataset in the main branch of the MdaNet. Next, task-specific attention modules are utilized in different branches and finally integrated as a multitask model. The second task is a blend of classification and regression tasks. Thus, a specialized loss function is developed. In the proposed knowledge distillation (KD) process, the MdaNet as well as its main branch trained for solving two single tasks, respectively, are treated as multiple teachers to produce a student model. A novel KD loss function is developed to take the advantage of all the models as well as data with labels and without labels. Results: SD-MdaNet achieves an AUC of 98.7 ± 0.4 % $98.7\pm 0.4\%$ on invasiveness prediction, and 91.6 ± 1.0 % $91.6\pm 1.0\%$ on predominant growth pattern prediction on our dataset. Moreover, the average mean squared error in inferring growth pattern proportion reaches 0.0217 ± 0.0019 $0.0217\pm 0.0019$ , and the AUC for predominant growth pattern proportion reaches 91.6 ± 1.0 % $91.6\pm 1.0\%$ . The proposed SD-MdaNet is significantly better than all other benchmarking methods ( F D R < 0.05 $FDR<0.05$ ). Conclusions: Experimental results demonstrate that the proposed SD-MdaNet can significantly improve the performance of the lung adenocarcinoma pathological diagnosis using only CT scans. Analyses and discussions are conducted to interpret the advantages of the SD-MdaNet.

MM-DCNet: A Multi-Scale and Multi-MOdality Dynamic Convolutional Network for Lung Cancer Subtypes Classification

CC-DCNet: Dynamic Convolutional Neural Network with Contrastive Constraints for Identifying Lung Cancer Subtypes on Multi-modality Images

3MT-Net: A Multi-modal Multi-task Model for Breast Cancer and Pathological Subtype Classification Based on a Multicenter Study

Multi-task Learning-Based Histologic Subtype Classification of Non-Small Cell Lung Cancer.

A dual data stream hybrid neural network for classifying pathological images of lung adenocarcinoma

A Multi-Task Convolutional Neural Network for Lesion Region Segmentation and Classification of Non-Small Cell Lung Carcinoma

ML3CNet: Non-local means-assisted automatic framework for lung cancer subtypes classification using histopathological images

Histological Subtype Classification of Non-Small Cell Lung Cancer with Radiomics and 3D Convolutional Neural Networks

Multi-Dimension and Multi-Feature Hybrid Learning Network for Classifying the Sub Pathological Type of Lung Nodules through LDCT

Multi-scale Convolutional Neural Networks for Lung Nodule Classification.

Combining Multi-Scale Feature Fusion with Multi-Attribute Grading, a CNN Model for Benign and Malignant Classification of Pulmonary Nodules.

Multimodal Non-Small Cell Lung Cancer Classification Using Convolutional Neural Networks

Multi-Scale Multi-View Model Based on Ensemble Attention for Benign-Malignant Lung Nodule Classification on Chest CT

MDFF-Net: A multi-dimensional feature fusion network for breast histopathology image classification

Lung cancer subtype classification using histopathological images based on weakly supervised multi-instance learning

Multi-model Ensemble Learning Architecture Based on 3D CNN for Lung Nodule Malignancy Suspiciousness Classification

Weakly supervised label propagation algorithm classifies lung cancer imaging subtypes

The self-distillation trained multitask dense-attention network for diagnosing lung cancers based on CT scans

Multi-path Convolutional Neural Network for Lung Cancer Detection

Enhanced NSCLC Subtyping and Staging Through Attention-Augmented Multi-Task Deep Learning: A Novel Diagnostic Tool

A Deep Model for Lung Cancer Type Identification by Densely Connected Convolutional Networks and Adaptive Boosting