Abstract:Liver segmentation is a fundamental prerequisite for the diagnosis and surgical planning of hepatocellular carcinoma. Traditionally, the liver contour is drawn manually by radiologists using a slice-by-slice method. However, this process is time-consuming and error-prone, depending on the radiologist's experience. In this paper, we propose a new end-to-end automatic liver segmentation framework, named ResTransUNet, which exploits the transformer's ability to capture global context for remote interactions and spatial relationships, as well as the excellent performance of the original U-Net architecture. The main contribution of this paper lies in proposing a novel fusion network that combines Unet and Transformer architectures. In the encoding structure, a dual-path approach is utilized, where features are extracted separately using both convolutional neural networks (CNNs) and Transformer networks. Additionally, an effective feature enhancement unit is designed to transfer the global features extracted by the Transformer network to the CNN for feature enhancement. This model aims to address the drawbacks of traditional Unet-based methods, such as feature loss during encoding and poor capture of global features. Moreover, it avoids the disadvantages of pure Transformer models, which suffer from large parameter sizes and high computational complexity. The experimental results on the LiTS2017 dataset demonstrate remarkable performance for our proposed model, with Dice coefficients, volumetric overlap error (VOE), and relative volume difference (RVD) values for liver segmentation reaching 0.9535, 0.0804, and -0.0007, respectively. Furthermore, to further validate the model's generalization capability, we conducted tests on the 3Dircadb, Chaos, and Sliver07 datasets. The experimental results demonstrate that the proposed method outperforms other closely related models with higher liver segmentation accuracy. In addition, significant improvements can be achieved by applying our method when handling liver segmentation with small and discontinuous liver regions, as well as blurred liver boundaries. The code is available at the website: https://github.com/Jouiry/ResTransUNet .

Accurate segmentation of intracellular organelle networks using low-level features and topological self-similarity

Automatic Reconstruction of Mitochondria and Endoplasmic Reticulum in Electron Microscopy Volumes by Deep Learning

Advanced Deep Networks for 3D Mitochondria Instance Segmentation

EM-NET: Centerline-Aware Mitochondria Segmentation in EM Images via Hierarchical View-Ensemble Convolutional Network

OrgUNETR: Utilizing Organ Information and Squeeze and Excitation Block for Improved Tumor Segmentation

Attention-Guided Residual U-Net with SE Connection and ASPP for Watershed-Based Cell Segmentation in Microscopy Images

An Effective Fully Deep Convolutional Neural Network for Mitochondria Segmentation Based on ATUM-SEM.

Retinal Vascular Image Segmentation Using Improved UNet Based on Residual Module

ResTransUnet: An effective network combined with Transformer and U-Net for liver segmentation in CT scans

Automatic Detection and Segmentation of Mitochondria from SEM Images using Deep Neural Network.

Stable Deep Neural Network Architectures for Mitochondria Segmentation on Electron Microscopy Volumes

An Effective Encoder-Decoder Network For Neural Cell Bodies And Cell Nucleus Segmentation Of Em Images

Improved Segmentation of Cellular Nuclei Using UNET Architectures for Enhanced Pathology Imaging

HIVE-Net: Centerline-Aware HIerarchical View-Ensemble Convolutional Network for Mitochondria Segmentation in EM Images

ERDUnet: An Efficient Residual Double-coding Unet for Medical Image Segmentation

LiViT-Net: A U-Net-like, lightweight Transformer network for retinal vessel segmentation

U-HRMLP: Refining Segmentation Boundaries in Histopathology Images

MT_Net: A Multi-Scale Framework Using the Transformer Block for Retina Layer Segmentation

MC-UNet: Multimodule Concatenation Based on U-Shape Network for Retinal Blood Vessels Segmentation

Learning Multi-Level Structural Information for Small Organ Segmentation

Semi-Supervised Segmentation of Mitochondria from Electron Microscopy Images Using Spatial Continuity