Abstract:BackgroundAccurate segmentation of organs has a great significance for clinical diagnosis, but it is still hard work due to the obscure imaging boundaries caused by tissue adhesion on medical images. Based on the image continuity in medical image volumes, segmentation on these slices could be inferred from adjacent slices with a clear organ boundary. Radiologists can delineate a clear organ boundary by observing adjacent slices. PurposeInspired by the radiologists' delineating procedure, we design an organ segmentation model based on boundary information of adjacent slices and a human-machine interactive learning strategy to introduce clinical experience. MethodsWe propose an interactive organ segmentation method for medical image volume based on Graph Convolution Network (GCN) called Surface-GCN. First, we propose a Surface Feature Extraction Network (SFE-Net) to capture surface features of a target organ, and supervise it by a Mini-batch Adaptive Surface Matching (MBASM) module. Then, to predict organ boundaries precisely, we design an automatic segmentation module based on a Surface Convolution Unit (SCU), which propagates information on organ surfaces to refine the generated boundaries. In addition, an interactive segmentation module is proposed to learn radiologists' experience of interactive corrections on organ surfaces to reduce interaction clicks. ResultsWe evaluate the proposed method on one prostate MR image dataset and two abdominal multi-organ CT datasets. The experimental results show that our method outperforms other state-of-the-art methods. For prostate segmentation, the proposed method conducts a DSC score of 94.49% on PROMISE12 test dataset. For abdominal multi-organ segmentation, the proposed method achieves DSC scores of 95, 91, 95, and 88% for the left kidney, gallbladder, spleen, and esophagus, respectively. For interactive segmentation, the proposed method reduces 5-10 interaction clicks to reach the same accuracy. ConclusionsTo overcome the medical organ segmentation challenge, we propose a Graph Convolutional Network called Surface-GCN by imitating radiologist interactions and learning clinical experience. On single and multiple organ segmentation tasks, the proposed method could obtain more accurate segmentation boundaries compared with other state-of-the-art methods.

Integrating 3D Geometry of Organ for Improving Medical Image Segmentation.

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Deep Multi-Task and Task-Specific Feature Learning Network for Robust Shape Preserved Organ Segmentation.

CPNet: 3D Semantic Relation and Geometry Context Prior Network for Multi-Organ Segmentation

Teaching AI the Anatomy Behind the Scan: Addressing Anatomical Flaws in Medical Image Segmentation with Learnable Prior

Shape-Aware Organ Segmentation by Predicting Signed Distance Maps

Residual Inter-slice Feature Learning for 3D Organ Segmentation.

End-to-End Adversarial Shape Learning for Abdomen Organ Deep Segmentation

Globally Guided Progressive Fusion Network for 3D Pancreas Segmentation.

Decompose-and-Integrate Learning for Multi-class Segmentation in Medical Images

Make U-Net Greater: An Easy-to-Embed Approach to Improve Segmentation Performance Using Hypergraph

A multi-scale pyramid of 3D fully convolutional networks for abdominal multi-organ segmentation

Continual Segment: Towards a Single, Unified and Accessible Continual Segmentation Model of 143 Whole-body Organs in CT Scans

SACNet: A Spatially Adaptive Convolution Network for 2D Multi-organ Medical Segmentation

Shape-Guided Dual Consistency Semi-Supervised Learning Framework for 3-D Medical Image Segmentation

Surface-GCN: Learning Interaction Experience for Organ Segmentation in 3D Medical Images.

Incorporating the hybrid deformable model for improving the performance of abdominal CT segmentation via multi-scale feature fusion network

A 3D Coarse-to-Fine Framework for Volumetric Medical Image Segmentation

Learning to In-paint: Domain Adaptive Shape Completion for 3D Organ Segmentation

Generalized Organ Segmentation by Imitating One-shot Reasoning using Anatomical Correlation

DeepIGeoS-V2 - Deep Interactive Segmentation of Multiple Organs from Head and Neck Images with Lightweight CNNs.