Abstract:Objective Kidney segmentation plays an important role in the diagnosis of kidney diseases.The volume and thickness of renal cortex are effective assessment criteria in early clinical diagnosis for renal neoplasms,chronic arteriosclerotic nephropathy,and acute rejection after kidney transplant.However,most existing methods focus on the whole kidney segmentation.This paper presents a fully automatic renal cortex segmentation based on fully convolutional network and GrowCut for multi-modality kidney images.Method Generalized Hough Transform (GHT) is used to detect non-analytic shape represented by R-table.GHT localizes the kidney and then the region of interest (ROI) is extracted.The fully convolutional network (FCN-32s) for semantic segmentation is introduced into renal cortex segmentation.Data augmentation is employed to expand labeled data and transfer learning is applied due to lack of sufficient training data.The initial parameters of the proposed network are taken from pre-trained model of VGG-16.All the fully connected layers of VGG-16 are converted into convolutional layers.The filter size of fe8 is changed from 1 000 to 2 because the proposed network regards cortex and background as two classes.The filter sizes of fc6 and fc7 are modified from 4 096 into 1024 to reduce parameters.Pooling and down-sampling layers can extract more abstract features for image classification tasks.For image segmentation,however,too much trivial information will be lost.The proposed network retains the first three pooling layers of VGG-16.Dropout,as a regularization method,prevents over-fitting,and loss function is optimized with Stochastic Gradient Descent.The proposed network is a first implementation for realizing renal cortex segmentation based on the fully convolutional network.However,the obvious disadvantage of fully convolutional network is that it is a pixel-wise classification and does not consider the spatial relationship among pixels.It will cause some unexpected results.The segmentation regions have burrs at the edge,and cortex of some slices is missegmented.The proposed method combines fully convolutional network and GrowCut for superior cortex segmentation.GrowCut is an interactive segmentation method based on the labeled seeds,and the pixels compete to gain labels in the neighborhood.The performance of GrowCut relies on the initial seeds marked by the user.In this paper,the seeds are generated by the proposed network,which realizes an automatic implementation and frees manual interventions.The images of test set are firstly segmented by the proposed network,and the feature maps of the last convolutional layer are extracted as a labeled map.The mislabeled seeds that always appears in spine,spleen,and other adjacent tissues can be corrected by GrowCut with priors of kidney.GrowCut can achieve more accurate cortex segmentation based on the correctly labeled map.A set of contrast-enhanced CT images and corresponding ground truth labeled by experts is given for training fully convolutional network.The ROI will be normalized after it is extracted from the original image,and then expanded after cutting and reflections.These images are split into a training set (5 000) and a validation set (300).Parameters of the network will be adjusted in the training processing.The proposed network is trained on a deep learning framework Caffe,with maximum iteration of 10 000,initial learning rate of 0.001,which is multiplied by 0.1 at every 2 000 interactions,momentum of 0.9,weight delay of 0.000 5,and batch size of 1 for online learning.The proposed network is quantitatively compared with three pre-trained fully convolutional networks by three metrics:pixel accuracy,overall accuracy,and mean region intersection over union (IU).The proposed method is compared with four methods,including two fully convolutional networks and two typical methods.Two metrics are used,namely,IU and Dice Similarity Coefficient (DSC),which is a common metric in medical image segmentation.Result The experimental dataset contains 30 clinical CT and MRI images.The proposed method achieved IU of 91.06％ ± 2.34％ and DSC of 91.79％ ± 2.39％.The proposed fully convolutional network has fewer parameters and higher accuracy than basic fully convolutional network for renal cortex segmentation.GrowCut algorithm considers the neighborhood information between pixels,thus further improving the segmentation accuracy by 3％.Results show that contrast-enhanced and non-contrast-enhanced images can be accurately segmented.Conclusion Deep learning model trained with huge data set of natural images can extract hierarchical features and can be introduced in medical images segmentation by transfer learning.Missegmentation is reduced by the proposed network and can be corrected effectively.The experimental results indicate that the proposed method is more suitable for kidney images from different modalities and outperforms typical methods.The proposed method can provide a reliable basis for clinical diagnosis because medical images from normal and abnormal kidneys both can be segmented accurately.The furture work includes the following tasks:the accuracy of non-contrast-enhanced image segmentation will be further improved by optimizing algorithm;the proposed network will be used for segmentation of other organs by fine-tuning the parameters of network.GrowCut will be plugged in the network as a new layer to perform end-to-end training.

Renal Compartment Segmentation in DCE-MRI Images

Automatic Segmentation of Renal Compartments in DCE-MRI Images

Functional Segmentation through Dynamic Mode Decomposition: Automatic Quantification of Kidney Function in DCE-MRI Images

Automatic Delineation of Kidney Region in DCE-MRI

Automatic renal segmentation in DCE-MRI using convolutional neural networks

Kidney segmentation from DCE-MRI converging level set methods, fuzzy clustering and Markov random field modeling

A Self-Supervised Strategy for Fully Automatic Segmentation of Renal Dynamic Contrast-Enhanced Magnetic Resonance Images.

Dynamic Contrast-Enhanced Magnetic Resonance Images of the Kidney

Nonrigid Registration and Classification of the Kidneys in 3D Dynamic Contrast Enhanced (DCE) MR Images.

Semi-automatic Segmentation of Renal Cortex and Medulla Based on Dynamic Magnetic Resonance Images

Kidney Segmentation in Computed Tomography Sequences Based on Energy Minimization

3D Fast Automatic Segmentation of Kidney Based on Modified AAM and Random Forest.

Effective Automated Kidney Locating and Segmentation Method Based on Multi-phase MR Images

Comprehensive 3D Analysis of the Renal System and Stones: Segmenting and Registering Non-Contrast and Contrast Computed Tomography Images

A Fully Automated Framework for Renal Cortex Segmentation

Simultaneous and Automatic Two Surface Detection of Renal Cortex in 3D CT Images by Enhanced Sparse Shape Composition

A deep learning-based precision and automatic kidney segmentation system using efficient feature pyramid networks in computed tomography images

Renal cortex segmentation with fully convolutional network and GrowCut

Coarse-to-fine Kidney Segmentation Framework Incorporating with Abnormal Detection and Correction

Kidney segmentation using 3D U-Net localized with Expectation Maximization

An Unsupervised Computed Tomography Kidney Segmentation with Multi-Region Clustering and Adaptive Active Contours