Deep learning and multiscale analysis for epithelial-mesenchyme segmentation and classification in breast cancer histological images

Tangsen Huang,Haibing Yin,Xingru Huang
DOI: https://doi.org/10.1007/s11760-024-03424-6
IF: 1.583
2024-09-15
Signal Image and Video Processing
Abstract:This paper proposes an innovative deep learning-based method called Deep WSI-Stroma for the segmentation and classification of epithelial and mesenchyme regions in whole slide images (WSIs) of breast cancer histopathology. The method adopts an end-to-end convolutional neural network architecture and designs a multi-scale, multi-level network structure that fuses feature maps from different resolutions, enabling effective modeling of both local cellular and global tissue-level features. Attention mechanisms and adversarial training strategies are also incorporated to enhance the model's robustness and generalization ability. Experiments on the TCGA-BRCA dataset demonstrate that Deep WSI-Stroma achieves an average Dice score of 0.873 for the segmentation task, significantly outperforming classical models such as U-Net and FCN. For the classification task, it attains an average F1 score of 0.921 across the three classes, substantially surpassing hand-crafted features with SVM and CNN methods. These superior results validate the excellent performance of the proposed method in handling large-scale, high-resolution WSI data and highlight the immense potential of deep learning techniques. This innovative approach leverages the powerful representation and learning capabilities of deep learning, exhibiting significant advantages in the complex task of histopathological image analysis, and provides important insights and driving forces for related fields.
engineering, electrical & electronic,imaging science & photographic technology
What problem does this paper attempt to address?