Abstract:Liver segmentation is a fundamental prerequisite for the diagnosis and surgical planning of hepatocellular carcinoma. Traditionally, the liver contour is drawn manually by radiologists using a slice-by-slice method. However, this process is time-consuming and error-prone, depending on the radiologist's experience. In this paper, we propose a new end-to-end automatic liver segmentation framework, named ResTransUNet, which exploits the transformer's ability to capture global context for remote interactions and spatial relationships, as well as the excellent performance of the original U-Net architecture. The main contribution of this paper lies in proposing a novel fusion network that combines Unet and Transformer architectures. In the encoding structure, a dual-path approach is utilized, where features are extracted separately using both convolutional neural networks (CNNs) and Transformer networks. Additionally, an effective feature enhancement unit is designed to transfer the global features extracted by the Transformer network to the CNN for feature enhancement. This model aims to address the drawbacks of traditional Unet-based methods, such as feature loss during encoding and poor capture of global features. Moreover, it avoids the disadvantages of pure Transformer models, which suffer from large parameter sizes and high computational complexity. The experimental results on the LiTS2017 dataset demonstrate remarkable performance for our proposed model, with Dice coefficients, volumetric overlap error (VOE), and relative volume difference (RVD) values for liver segmentation reaching 0.9535, 0.0804, and -0.0007, respectively. Furthermore, to further validate the model's generalization capability, we conducted tests on the 3Dircadb, Chaos, and Sliver07 datasets. The experimental results demonstrate that the proposed method outperforms other closely related models with higher liver segmentation accuracy. In addition, significant improvements can be achieved by applying our method when handling liver segmentation with small and discontinuous liver regions, as well as blurred liver boundaries. The code is available at the website: https://github.com/Jouiry/ResTransUNet .

FcTC-UNet: Fine-grained Combination of Transformer and CNN for Thoracic Organs Segmentation

ACF-TransUNet: Attention-based Coarse-Fine Transformer U-Net for Automatic Liver Tumor Segmentation in CT Images.

OAR-UNet: Enhancing Long-Distance Dependencies for Head and Neck OAR Segmentation

A Novel U-Like Network for the Segmentation of Thoracic Organs

A 2D dilated residual U-Net for multi-organ segmentation in thoracic CT

ECA-TFUnet: A U-shaped CNN-Transformer network with efficient channel attention for organ segmentation in anatomical sectional images of canines

MultiTrans: Multi-scale Feature Fusion Transformer with Transfer Learning Strategy for Multiple Organs Segmentation of Head and Neck CT Images

TransCC: Transformer Network for Coronary Artery CCTA Segmentation

CAFCT-Net: A CNN-Transformer Hybrid Network with Contextual and Attentional Feature Fusion for Liver Tumor Segmentation

ResTransUnet: An effective network combined with Transformer and U-Net for liver segmentation in CT scans

A 3D Fusion U-Net with Dual CNN and Transformer Encoders for Lung Airway Segmentation

ITUnet: Integration Of Transformers And Unet For Organs-At-Risk Segmentation

FCTrans UNet: A Hybrid CNN and Transformer Model for Medical Image Segmentations

MSCT-UNET: multi-scale contrastive transformer within U-shaped network for medical image segmentation

CFATransUnet: Channel-wise cross fusion attention and transformer for 2D medical image segmentation

A cascaded FAS-UNet+ framework with iterative optimization strategy for segmentation of organs at risk

TFCNs: A CNN-Transformer Hybrid Network for Medical Image Segmentation

Combining CNN and Self-attention-Free Transformer Using Local-Global Attention Fusion for Lung Cancer Segmentation

CCT-Unet: A U-Shaped Network Based on Convolution Coupled Transformer for Segmentation of Peripheral and Transition Zones in Prostate MRI.

Dual encoder network with transformer-CNN for multi-organ segmentation

TCU-Net: Transformer Embedded in Convolutional U-Shaped Network for Retinal Vessel Segmentation