Abstract:Background: Targeted therapy and immunotherapy put forward higher demands for accurate lung cancer classification, as well as benign versus malignant disease discrimination. Digital whole slide images (WSIs) witnessed the transition from traditional histopathology to computational approaches, arousing a hype of deep learning methods for histopathological analysis. We aimed at exploring the potential of deep learning models in the identification of lung cancer subtypes and cancer mimics from WSIs. Methods: We initially obtained 741 WSIs from the First Affiliated Hospital of Sun Yat-sen University (SYSUFH) for the deep learning model development, optimization, and verification. Additional 318 WSIs from SYSUFH, 212 from Shenzhen People's Hospital, and 422 from The Cancer Genome Atlas were further collected for multi-centre verification. EfficientNet-B5- and ResNet-50-based deep learning methods were developed and compared using the metrics of recall, precision, F1-score, and areas under the curve (AUCs). A threshold-based tumour-first aggregation approach was proposed and implemented for the label inferencing of WSIs with complex tissue components. Four pathologists of different levels from SYSUFH reviewed all the testing slides blindly, and the diagnosing results were used for quantitative comparisons with the best performing deep learning model. Results: We developed the first deep learning-based six-type classifier for histopathological WSI classification of lung adenocarcinoma, lung squamous cell carcinoma, small cell lung carcinoma, pulmonary tuberculosis, organizing pneumonia, and normal lung. The EfficientNet-B5-based model outperformed ResNet-50 and was selected as the backbone in the classifier. Tested on 1067 slides from four cohorts of different medical centres, AUCs of 0.970, 0.918, 0.963, and 0.978 were achieved, respectively. The classifier achieved high consistence to the ground truth and attending pathologists with high intraclass correlation coefficients over 0.873. Conclusions: Multi-cohort testing demonstrated our six-type classifier achieved consistent and comparable performance to experienced pathologists and gained advantages over other existing computational methods. The visualization of prediction heatmap improved the model interpretability intuitively. The classifier with the threshold-based tumour-first label inferencing method exhibited excellent accuracy and feasibility in classifying lung cancers and confused nonneoplastic tissues, indicating that deep learning can resolve complex multi-class tissue classification that conforms to real-world histopathological scenarios.

Attention Based Deep Multiple Instance Learning Approach for Lung Cancer Prediction using Histopathological Images

Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning

An Explainable Classification Method Based on Complex Scaling in Histopathology Images for Lung and Colon Cancer

Deep Learning for Lung Cancer Diagnosis, Prognosis and Prediction Using Histological and Cytological Images: A Systematic Review

MLLCD: A Meta Learning-based Method for Lung Cancer Diagnosis Using Histopathology Images.

Lung Cancer Diagnosis Using Deep Attention Based on Multiple Instance Learning and Radiomics

E2EFP-MIL: End-to-end and high-generalizability weakly supervised deep convolutional network for lung cancer classification from whole slide image

Lung Cancer Diagnosis Using Deep Attention‐based Multiple Instance Learning and Radiomics

Deep learning-based six-type classifier for lung cancer and mimics from histopathological whole slide images: a retrospective study

Weakly Supervised Deep Learning for Whole Slide Lung Cancer Image Analysis

Whole Slide Images based Cancer Survival Prediction using Attention Guided Deep Multiple Instance Learning Networks

Lung Cancer Diagnosis on Virtual Histologically Stained Tissue Using Weakly Supervised Learning

Classification of Mouse Lung Metastatic Tumor with Deep Learning

An Efficient Combination of Convolutional Neural Network and LightGBM Algorithm for Lung Cancer Histopathology Classification

Multimodal Lung Cancer Subtyping Using Deep Learning Neural Networks on Whole Slide Tissue Images and MALDI MSI

Finding Regions of Interest in Whole Slide Images Using Multiple Instance Learning

LungHist700: A dataset of histological images for deep learning in pulmonary pathology

A Multi-View Feature Decomposition Deep Learning Method for Lung Cancer Histology Classification

Pathologist-level classification of histologic patterns on resected lung adenocarcinoma slides with deep neural networks

Lung cancer subtype classification using histopathological images based on weakly supervised multi-instance learning

Abstract 2803: Classification of Lung Cancer Histology Images Using Deep Learning