E2EFP-MIL: End-to-end and high-generalizability weakly supervised deep convolutional network for lung cancer classification from whole slide image
Lei Cao,Jie Wang,Yuanyuan Zhang,Zhiwei Rong,Meng Wang,Liuying Wang,Jianxin Ji,Youhui Qian,Liuchao Zhang,Hao Wu,Jiali Song,Zheng Liu,Wenjie Wang,Shuang Li,Peiyu Wang,Zhenyi Xu,Jingyuan Zhang,Liang Zhao,Hang Wang,Mengting Sun,Xing Huang,Rong Yin,Yuhong Lu,Ziqian Liu,Kui Deng,Gongwei Wang,Mantang Qiu,Kang Li,Jun Wang,Yan Hou
DOI: https://doi.org/10.1016/j.media.2023.102837
IF: 10.9
2023-08-01
Medical Image Analysis
Abstract:Efficient and accurate distinction of histopathological subtype of lung cancer is quite critical for the individualized treatment. So far, artificial intelligence techniques have been developed, whose performance yet remained debatable on more heterogenous data, hindering their clinical deployment. Here, we propose an end-to-end, well-generalized and data-efficient weakly supervised deep learning-based method. The method, end-to-end feature pyramid deep multi-instance learning model (E2EFP-MIL), contains an iterative sampling module, a trainable feature pyramid module and a robust feature aggregation module. E2EFP-MIL uses end-to-end learning to extract generalized morphological features automatically and identify discriminative histomorphological patterns. This method is trained with 1007 whole slide images (WSIs) of lung cancer from TCGA, with AUCs of 0.95-0.97 in test sets. We validated E2EFP-MIL in 5 real-world external heterogenous cohorts including nearly 1600 WSIs from both United States and China with AUCs of 0.94-0.97, and found that 100-200 training images are enough to achieve an AUC of >0.9. E2EFP-MIL overperforms multiple state-of-the-art MIL-based methods with high accuracy and low hardware requirements. Excellent and robust results prove generalizability and effectiveness of E2EFP-MIL in clinical practice. Our code is available at https://github.com/raycaohmu/E2EFP-MIL.
engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging