Abstract: High resolution (HR) 3D medical image segmentation plays an important role in clinical diagnoses. However, HR images are difficult to be directly processed by mainstream graphical cards due to limited video memory. Therefore, most existing 3D medical image segmentation methods use patch-based models, which ignores global context information that is useful in accurate segmentation and has low inference efficiency. To address these problems, we propose a super-resolution (SR) guided patch-free 3D medical image segmentation framework that can realize HR segmentation with global information of low-resolution (LR) input. The framework contains two tasks: semantic segmentation (main task) and super resolution (auxiliary task). To balance the information loss with the LR input, we introduce a Self-Supervised Guidance Module (SGM), which employs a selective search method to crop a HR patch from the original image as restoration guidance. Multi-scale convolutional layers are used to mitigate the scale-inconsistency between the HR guidance features and the LR features. Moreover, we propose a Task-Fusion Module (TFM) to exploit the inter connections between segmentation and SR task. This module can also be used for Test Phase Fine-tuning (TPF), leading to a better model generalization ability. When predicting, only the main segmentation task is needed, while other modules can be removed to accelerate the inference. The experiments results on two different datasets show that our framework outperforms current patch-based and patch-free models. Our model also has a four times higher inference speed compared to traditional patch-based methods. Our codes are available at: https://github.com/Dootmaan/PFSeg-Full.

Deep Patch-based Human Segmentation

3D Human Landmark Detection and Segmentation with Semantic Knowledge

Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation.

Patch-Free 3D Medical Image Segmentation Driven by Super-Resolution Technique and Self-Supervised Guidance

Super-Resolution Based Patch-Free 3D Medical Image Segmentation with Self-Supervised Guidance

Human Segmentation With Deep Contour-Aware Network

Patch-wise skin segmentation of human body parts via deep neural networks

Deep Learning based 3D Segmentation: A Survey

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Real-Time Human Segmentation Using Pose Skeleton Map

A Semantic Segmentation Approach Based On Deeplab Network In High-Resolution Remote Sensing Images

1000fps Human Segmentation With Deep Convolutional Neural Networks

Automatic Segmentation of Human Depth Map Based on Semantic Segmentation of FCN and Depth Segmentation

Voxel-Based 3D Shape Segmentation Using Deep Volumetric Convolutional Neural Networks

Localize Heavily Occluded Human Faces Via Deep Segmentation.

Unsupervised 3D Shape Segmentation and Co-Segmentation Via Deep Learning.

A Deep Learning Approach to Mesh Segmentation

DeepHuman: 3D Human Reconstruction from a Single Image

Fuzzy Neighborhood Learning for Deep 3-D Segmentation of Point Cloud.

Using structural patches tiling to guide human head-shoulder segmentation.