Abstract:Objective Kidney segmentation plays an important role in the diagnosis of kidney diseases.The volume and thickness of renal cortex are effective assessment criteria in early clinical diagnosis for renal neoplasms,chronic arteriosclerotic nephropathy,and acute rejection after kidney transplant.However,most existing methods focus on the whole kidney segmentation.This paper presents a fully automatic renal cortex segmentation based on fully convolutional network and GrowCut for multi-modality kidney images.Method Generalized Hough Transform (GHT) is used to detect non-analytic shape represented by R-table.GHT localizes the kidney and then the region of interest (ROI) is extracted.The fully convolutional network (FCN-32s) for semantic segmentation is introduced into renal cortex segmentation.Data augmentation is employed to expand labeled data and transfer learning is applied due to lack of sufficient training data.The initial parameters of the proposed network are taken from pre-trained model of VGG-16.All the fully connected layers of VGG-16 are converted into convolutional layers.The filter size of fe8 is changed from 1 000 to 2 because the proposed network regards cortex and background as two classes.The filter sizes of fc6 and fc7 are modified from 4 096 into 1024 to reduce parameters.Pooling and down-sampling layers can extract more abstract features for image classification tasks.For image segmentation,however,too much trivial information will be lost.The proposed network retains the first three pooling layers of VGG-16.Dropout,as a regularization method,prevents over-fitting,and loss function is optimized with Stochastic Gradient Descent.The proposed network is a first implementation for realizing renal cortex segmentation based on the fully convolutional network.However,the obvious disadvantage of fully convolutional network is that it is a pixel-wise classification and does not consider the spatial relationship among pixels.It will cause some unexpected results.The segmentation regions have burrs at the edge,and cortex of some slices is missegmented.The proposed method combines fully convolutional network and GrowCut for superior cortex segmentation.GrowCut is an interactive segmentation method based on the labeled seeds,and the pixels compete to gain labels in the neighborhood.The performance of GrowCut relies on the initial seeds marked by the user.In this paper,the seeds are generated by the proposed network,which realizes an automatic implementation and frees manual interventions.The images of test set are firstly segmented by the proposed network,and the feature maps of the last convolutional layer are extracted as a labeled map.The mislabeled seeds that always appears in spine,spleen,and other adjacent tissues can be corrected by GrowCut with priors of kidney.GrowCut can achieve more accurate cortex segmentation based on the correctly labeled map.A set of contrast-enhanced CT images and corresponding ground truth labeled by experts is given for training fully convolutional network.The ROI will be normalized after it is extracted from the original image,and then expanded after cutting and reflections.These images are split into a training set (5 000) and a validation set (300).Parameters of the network will be adjusted in the training processing.The proposed network is trained on a deep learning framework Caffe,with maximum iteration of 10 000,initial learning rate of 0.001,which is multiplied by 0.1 at every 2 000 interactions,momentum of 0.9,weight delay of 0.000 5,and batch size of 1 for online learning.The proposed network is quantitatively compared with three pre-trained fully convolutional networks by three metrics:pixel accuracy,overall accuracy,and mean region intersection over union (IU).The proposed method is compared with four methods,including two fully convolutional networks and two typical methods.Two metrics are used,namely,IU and Dice Similarity Coefficient (DSC),which is a common metric in medical image segmentation.Result The experimental dataset contains 30 clinical CT and MRI images.The proposed method achieved IU of 91.06％ ± 2.34％ and DSC of 91.79％ ± 2.39％.The proposed fully convolutional network has fewer parameters and higher accuracy than basic fully convolutional network for renal cortex segmentation.GrowCut algorithm considers the neighborhood information between pixels,thus further improving the segmentation accuracy by 3％.Results show that contrast-enhanced and non-contrast-enhanced images can be accurately segmented.Conclusion Deep learning model trained with huge data set of natural images can extract hierarchical features and can be introduced in medical images segmentation by transfer learning.Missegmentation is reduced by the proposed network and can be corrected effectively.The experimental results indicate that the proposed method is more suitable for kidney images from different modalities and outperforms typical methods.The proposed method can provide a reliable basis for clinical diagnosis because medical images from normal and abnormal kidneys both can be segmented accurately.The furture work includes the following tasks:the accuracy of non-contrast-enhanced image segmentation will be further improved by optimizing algorithm;the proposed network will be used for segmentation of other organs by fine-tuning the parameters of network.GrowCut will be plugged in the network as a new layer to perform end-to-end training.

Evaluating Generative Adversarial Networks for Virtual Contrast-Enhanced Kidney Segmentation using Res-UNet in Non-Contrast CT Images

Automatic Kidney Segmentation Method Based on an Enhanced Generative Adversarial Network

EfficientNet family U-Net models for deep learning semantic segmentation of kidney tumors on CT images

Tumorous kidney segmentation in abdominal CT images using active contour and 3D-UNet

ASD-Net: a novel U-Net based asymmetric spatial-channel convolution network for precise kidney and kidney tumor image segmentation

Convolutional Neural Network‐Based CT Image Segmentation of Kidney Tumours

Kidney and Kidney Tumour Segmentation in CT Images

Kidney abnormality segmentation in thorax-abdomen CT scans

Automatic Segmentation of the Kidneys and Cystic Renal Lesions on Non-Contrast CT Using a Convolutional Neural Network

SRENet: a Spatiotemporal Relationship-Enhanced 2D-Cnn-based Framework for Staging and Segmentation of Kidney Cancer Using CT Images

Hyper Vision Net: Kidney Tumor Segmentation Using Coordinate Convolutional Layer and Attention Unit

Segmentation-based quantitative measurements in renal CT imaging using deep learning

Fully-automated multi-organ segmentation tool applicable to both non-contrast and post-contrast abdominal CT: deep learning algorithm developed using dual-energy CT images

Enhancing COVID-19 CT Image Segmentation: A Comparative Study of Attention and Recurrence in UNet Models

Enhancing liver tumor segmentation with UNet-ResNet: Leveraging ResNet's power

SERU: A Cascaded SE-ResNeXT U-Net for Kidney and Tumor Segmentation

Automatic renal segmentation in DCE-MRI using convolutional neural networks

Automatic Kidney Parenchyma Segmentation Based on Improved UNeXt Model

Multi-Layer Feature Fusion with Cross-Channel Attention-Based U-Net for Kidney Tumor Segmentation

Multi-Scale Supervised 3D U-Net for Kidneys and Kidney Tumor Segmentation

Renal cortex segmentation with fully convolutional network and GrowCut