Abstract: High resolution (HR) 3D medical image segmentation plays an important role in clinical diagnoses. However, HR images are difficult to be directly processed by mainstream graphical cards due to limited video memory. Therefore, most existing 3D medical image segmentation methods use patch-based models, which ignores global context information that is useful in accurate segmentation and has low inference efficiency. To address these problems, we propose a super-resolution (SR) guided patch-free 3D medical image segmentation framework that can realize HR segmentation with global information of low-resolution (LR) input. The framework contains two tasks: semantic segmentation (main task) and super resolution (auxiliary task). To balance the information loss with the LR input, we introduce a Self-Supervised Guidance Module (SGM), which employs a selective search method to crop a HR patch from the original image as restoration guidance. Multi-scale convolutional layers are used to mitigate the scale-inconsistency between the HR guidance features and the LR features. Moreover, we propose a Task-Fusion Module (TFM) to exploit the inter connections between segmentation and SR task. This module can also be used for Test Phase Fine-tuning (TPF), leading to a better model generalization ability. When predicting, only the main segmentation task is needed, while other modules can be removed to accelerate the inference. The experiments results on two different datasets show that our framework outperforms current patch-based and patch-free models. Our model also has a four times higher inference speed compared to traditional patch-based methods. Our codes are available at: https://github.com/Dootmaan/PFSeg-Full.

Using structural patches tiling to guide human head-shoulder segmentation.

Patch-Free 3D Medical Image Segmentation Driven by Super-Resolution Technique and Self-Supervised Guidance

Super-Resolution Based Patch-Free 3D Medical Image Segmentation with Self-Supervised Guidance

Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation.

Improving Image Segmentation with Boundary Patch Refinement

Deep Patch-based Human Segmentation

A Data-Related Patch Proposal for Semantic Segmentation of Aerial Images

Semantic Segmentation Via Structured Patch Prediction, Context Crf And Guidance Crf

Human head-shoulder segmentation

PATS: Patch Area Transportation with Subdivision for Local Feature Matching.

Real-Time Human Segmentation Using Pose Skeleton Map

Interesting moving object segmentation based on selective visual attention and Markov random field

Super-Resolution Based Patch-Free 3D Image Segmentation with High-Frequency Guidance

Robust Human Body Segmentation Based on Part Appearance and Spatial Constraint

Automatic Segmentation of Head-and-Shoulder Images by Combining Edge Feature and Shape Prior

PatchDCT: Patch Refinement for High Quality Instance Segmentation

Weakly Supervised Semantic Segmentation via Progressive Patch Learning

Adaptive Patching for High-resolution Image Segmentation with Transformers

MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation

Guided Patch-Grouping Wavelet Transformer with Spatial Congruence for Ultra-High Resolution Segmentation

Boosting Mask R-CNN Performance for Long, Thin Forensic Traces with Pre-Segmentation and IoU Region Merging