Abstract:Liver segmentation is a fundamental prerequisite for the diagnosis and surgical planning of hepatocellular carcinoma. Traditionally, the liver contour is drawn manually by radiologists using a slice-by-slice method. However, this process is time-consuming and error-prone, depending on the radiologist's experience. In this paper, we propose a new end-to-end automatic liver segmentation framework, named ResTransUNet, which exploits the transformer's ability to capture global context for remote interactions and spatial relationships, as well as the excellent performance of the original U-Net architecture. The main contribution of this paper lies in proposing a novel fusion network that combines Unet and Transformer architectures. In the encoding structure, a dual-path approach is utilized, where features are extracted separately using both convolutional neural networks (CNNs) and Transformer networks. Additionally, an effective feature enhancement unit is designed to transfer the global features extracted by the Transformer network to the CNN for feature enhancement. This model aims to address the drawbacks of traditional Unet-based methods, such as feature loss during encoding and poor capture of global features. Moreover, it avoids the disadvantages of pure Transformer models, which suffer from large parameter sizes and high computational complexity. The experimental results on the LiTS2017 dataset demonstrate remarkable performance for our proposed model, with Dice coefficients, volumetric overlap error (VOE), and relative volume difference (RVD) values for liver segmentation reaching 0.9535, 0.0804, and -0.0007, respectively. Furthermore, to further validate the model's generalization capability, we conducted tests on the 3Dircadb, Chaos, and Sliver07 datasets. The experimental results demonstrate that the proposed method outperforms other closely related models with higher liver segmentation accuracy. In addition, significant improvements can be achieved by applying our method when handling liver segmentation with small and discontinuous liver regions, as well as blurred liver boundaries. The code is available at the website: https://github.com/Jouiry/ResTransUNet .

Hybrid-attention Densely Connected U-Net with GAP for Extracting Livers from CT Volumes.

Mfeeu-Net: A Multi-Scale Feature Extraction and Enhancement U-Net for Automatic Liver Segmentation from CT Images

Segmentation of Liver Tumor based on Mobilenetv3 U-shape Net

Hybrid dilation and attention residual U-Net for medical image segmentation

Dual Attention-Based 3D U-Net Liver Segmentation Algorithm on CT Images

AHCNet: an Application of Attention Mechanism and Hybrid Connection for Liver Tumor Segmentation in CT Volumes.

A Multi-Scale Liver Tumor Segmentation Method Based on Residual and Hybrid Attention Enhanced Network with Contextual Integration

U-Net combined with multi-scale attention mechanism for liver segmentation in CT images

Liver segmentation based on complementary features U-Net

Application of U-Shaped Convolutional Neural Network Based on Attention Mechanism in Liver CT Image Segmentation

ResTransUnet: An effective network combined with Transformer and U-Net for liver segmentation in CT scans

Automatic Liver Segmentation in CT Volumes with Improved 3D U-net.

Attention Unet++: A Nested Attention-Aware U-Net for Liver CT Image Segmentation

Automatic Liver Segmentation Using EfficientNet and Attention-Based Residual U-Net in CT

Densely Connected U-Net with Criss-Cross Attention for Automatic Liver Tumor Segmentation in CT Images

Multi-scale Attention and Deep Supervision-Based 3D UNet for Automatic Liver Segmentation from CT.

Automatic Liver Tumor Segmentation Used the Cascade Multi-Scale Attention Architecture Method Based on 3D U-Net

AG-UN-Net: U-shaped and N-shaped network with attention gate for liver segmentation.

Multi-scale-ResUNet: an Improve U-Net with Multi-Scale Attention and Hybrid Dilation for Medical Image Segmentation

CotepRes-Net: an Efficient U-Net Based Deep Learning Method of Liver Segmentation from Computed Tomography Images

RDCTrans U-Net: A Hybrid Variable Architecture for Liver CT Image Segmentation