Abstract:Purpose: Semantic segmentation in high-resolution, histopathology whole slide images (WSIs) is an important fundamental task in various pathology applications. Convolutional neural networks (CNN) are the state-of-the-art approach for image segmentation. A patch-based CNN approach is often employed because of the large size of WSIs; however, segmentation performance is sensitive to the field-of-view and resolution of the input patches, and balancing the trade-offs is challenging when there are drastic size variations in the segmented structures. We propose a multiresolution semantic segmentation approach, which is capable of addressing the threefold trade-off between field-of-view, computational efficiency, and spatial resolution in histopathology WSIs. Approach: We propose a two-stage multiresolution approach for semantic segmentation of histopathology WSIs of mouse lung tissue and human placenta. In the first stage, we use four different CNNs to extract the contextual information from input patches at four different resolutions. In the second stage, we use another CNN to aggregate the extracted information in the first stage and generate the final segmentation masks. Results: The proposed method reported 95.6%, 92.5%, and 97.1% in our single-class placenta dataset and 97.1%, 87.3%, and 83.3% in our multiclass lung dataset for pixel-wise accuracy, mean Dice similarity coefficient, and mean positive predictive value, respectively. Conclusions: The proposed multiresolution approach demonstrated high accuracy and consistency in the semantic segmentation of biological structures of different sizes in our single-class placenta and multiclass lung histopathology WSI datasets. Our study can potentially be used in automated analysis of biological structures, facilitating the clinical research in histopathology applications.

Multi-Resolution Networks for Semantic Segmentation in Whole Slide Images

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

High-Resolution Histopathological Image Classification Model Based on Fused Heterogeneous Networks with Self-Supervised Feature Representation

Multiscale Fusion Convolutional Network in Real-time Semantic Segmentation

Multiresolution semantic segmentation of biological structures in digital histopathology

A deep learning based multiscale approach to segment cancer area in liver whole slide image

An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

A multi-scale pyramid of 3D fully convolutional networks for abdominal multi-organ segmentation

Hierarchical Attention Guided Framework for Multi-resolution Collaborative Whole Slide Image Segmentation

Semantic Segmentation of Very-High-Resolution Remote Sensing Images via Deep Multi-Feature Learning

Multi-Scale Feature Map Aggregation and Supervised Domain Adaptation of Fully Convolutional Networks for Urban Building Footprint Extraction

Fully Convolutional Neural Networks With Full-Scale-Features For Semantic Segmentation

A Multi-Step Fusion Network for Semantic Segmentation of High-Resolution Aerial Images

MFH‐Net: A Hybrid CNN‐Transformer Network Based Multi‐Scale Fusion for Medical Image Segmentation

Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs

Deep Multi-Scale U-Net Architecture and Label-Noise Robust Training Strategies for Histopathological Image Segmentation

Encoder- and Decoder-Based Networks Using Multiscale Feature Fusion and Nonlocal Block for Remote Sensing Image Semantic Segmentation

Biomedical image segmentation based on full-Resolution network

A Fractal Curve-Inspired Framework for Enhanced Semantic Segmentation of Remote Sensing Images

Multi-Path U-Net Architecture for Cell and Colony-Forming Unit Image Segmentation