Segmentation of Non-Small Cell Lung Carcinomas: Introducing DRU-Net and Multi-Lens Distortion

Soroush Oskouei,Marit Valla,André Pedersen,Erik Smistad,Vibeke Grotnes Dale,Maren Høibø,Sissel Gyrid Freim Wahl,Mats Dehli Haugum,Thomas Langø,Maria Paula Ramnefjell,Lars Andreas Akslen,Gabriel Kiss,Hanne Sorger
2024-06-20
Abstract:Considering the increased workload in pathology laboratories today, automated tools such as artificial intelligence models can help pathologists with their tasks and ease the workload. In this paper, we are proposing a segmentation model (DRU-Net) that can provide a delineation of human non-small cell lung carcinomas and an augmentation method that can improve classification results. The proposed model is a fused combination of truncated pre-trained DenseNet201 and ResNet101V2 as a patch-wise classifier followed by a lightweight U-Net as a refinement model. We have used two datasets (Norwegian Lung Cancer Biobank and Haukeland University Hospital lung cancer cohort) to create our proposed model. The DRU-Net model achieves an average of 0.91 Dice similarity coefficient. The proposed spatial augmentation method (multi-lens distortion) improved the network performance by 3%. Our findings show that choosing image patches that specifically include regions of interest leads to better results for the patch-wise classifier compared to other sampling methods. The qualitative analysis showed that the DRU-Net model is generally successful in detecting the tumor. On the test set, some of the cases showed areas of false positive and false negative segmentation in the periphery, particularly in tumors with inflammatory and reactive changes.
Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Quantitative Methods
What problem does this paper attempt to address?
The paper primarily aims to address a key issue in the field of pathology: the automatic segmentation of Non-Small Cell Lung Carcinoma (NSCLC). Specifically, the research team developed a new deep learning model—DRU-Net, designed to improve the segmentation accuracy of NSCLC in Whole Slide Images (WSIs). To achieve this goal, the paper proposes the following innovations: 1. **DRU-Net Model**: This is an architecture that integrates pre-trained DenseNet201 and ResNet101V2 for patch-level classification, followed by a lightweight U-Net for result refinement. This design leverages local features and combines global contextual information to optimize segmentation results. 2. **Multi-Lens Distortion Data Augmentation Method**: This is a novel data augmentation technique that simulates multiple random lens distortion effects in the images. This method helps enhance the model's ability to recognize different morphological cells and tissues, thereby improving the model's robustness. 3. **Experimental Setup and Evaluation**: The study used two different datasets—the Norwegian Lung Cancer Biobank (NLCB) and the lung cancer cohort from Haukeland University Hospital. The model was trained, validated, and tested on these datasets. Additionally, a series of comparative experiments were conducted, including adjustments to existing models (such as H2G-Net) and the application of different training strategies. 4. **Model Performance Evaluation**: Quantitative evaluation employed standard metrics such as the Dice Similarity Coefficient (DSC) and Hausdorff distance, while qualitative evaluation was performed by pathologists based on specific criteria. The results showed that the DRU-Net model achieved an average DSC of 0.91 on the test set, indicating its excellent performance in tumor segmentation tasks. In summary, the main objective of this paper is to propose an efficient and accurate method for NSCLC segmentation to alleviate the workload of pathologists and improve diagnostic efficiency. By introducing the DRU-Net model and the multi-lens distortion data augmentation method, the research team significantly enhanced the model's performance, providing strong support for clinical practice.