Abstract:Liver segmentation is a fundamental prerequisite for the diagnosis and surgical planning of hepatocellular carcinoma. Traditionally, the liver contour is drawn manually by radiologists using a slice-by-slice method. However, this process is time-consuming and error-prone, depending on the radiologist's experience. In this paper, we propose a new end-to-end automatic liver segmentation framework, named ResTransUNet, which exploits the transformer's ability to capture global context for remote interactions and spatial relationships, as well as the excellent performance of the original U-Net architecture. The main contribution of this paper lies in proposing a novel fusion network that combines Unet and Transformer architectures. In the encoding structure, a dual-path approach is utilized, where features are extracted separately using both convolutional neural networks (CNNs) and Transformer networks. Additionally, an effective feature enhancement unit is designed to transfer the global features extracted by the Transformer network to the CNN for feature enhancement. This model aims to address the drawbacks of traditional Unet-based methods, such as feature loss during encoding and poor capture of global features. Moreover, it avoids the disadvantages of pure Transformer models, which suffer from large parameter sizes and high computational complexity. The experimental results on the LiTS2017 dataset demonstrate remarkable performance for our proposed model, with Dice coefficients, volumetric overlap error (VOE), and relative volume difference (RVD) values for liver segmentation reaching 0.9535, 0.0804, and -0.0007, respectively. Furthermore, to further validate the model's generalization capability, we conducted tests on the 3Dircadb, Chaos, and Sliver07 datasets. The experimental results demonstrate that the proposed method outperforms other closely related models with higher liver segmentation accuracy. In addition, significant improvements can be achieved by applying our method when handling liver segmentation with small and discontinuous liver regions, as well as blurred liver boundaries. The code is available at the website: https://github.com/Jouiry/ResTransUNet .

CotepRes-Net: an Efficient U-Net Based Deep Learning Method of Liver Segmentation from Computed Tomography Images

Mfeeu-Net: A Multi-Scale Feature Extraction and Enhancement U-Net for Automatic Liver Segmentation from CT Images

Interactive Liver Segmentation in CT Volumes Using Fully Convolutional Networks.

An Automatic Liver Segmentation Algorithm for CT Images U-Net with Separated Paths of Feature Extraction

Image Segmentation of Liver CT Based on Fully Convolutional Network.

Eres-UNet++: Liver CT image segmentation based on high-efficiency channel attention and Res-UNet++

SAR-U-Net: squeeze-and-excitation block and atrous spatial pyramid pooling based residual U-Net for automatic liver segmentation in Computed Tomography

ResTransUnet: An effective network combined with Transformer and U-Net for liver segmentation in CT scans

An Improved Residual U-Net with Morphological-Based Loss Function for Automatic Liver Segmentation in Computed Tomography.

SAR-U-Net: Squeeze-and-excitation Block and Atrous Spatial Pyramid Pooling Based Residual U-Net for Automatic Liver CT Segmentation.

CR-U-Net: Cascaded U-Net with Residual Mapping for Liver Segmentation in CT Images

Automatic Liver Segmentation Using EfficientNet and Attention-Based Residual U-Net in CT

Liver segmentation based on complementary features U-Net

Empirical Comparisons of Deep Learning Networks on Liver Segmentation

Dual Attention-Based 3D U-Net Liver Segmentation Algorithm on CT Images

Hybrid-attention Densely Connected U-Net with GAP for Extracting Livers from CT Volumes.

Application of U-Shaped Convolutional Neural Network Based on Attention Mechanism in Liver CT Image Segmentation

Liver Segmentation in CT Images Using a Non-Local Fully Convolutional Neural Network

ACF-TransUNet: Attention-based Coarse-Fine Transformer U-Net for Automatic Liver Tumor Segmentation in CT Images.

Attention Unet++: A Nested Attention-Aware U-Net for Liver CT Image Segmentation

Automatic Segmentation Of Liver Ct Image Based On Dense Pyramid Network