Abstract:Medical image segmentation is a critical step in many imaging applications. Automatic segmentation has gained extensive concern using a convolutional neural network (CNN). However, the traditional CNN-based methods fail to extract global and long-range contextual information due to local convolution operation. Transformer overcomes the limitation of CNN-based models. Inspired by the success of transformers in computer vision (CV), many researchers focus on designing the transformer-based U-shaped method in medical image segmentation. The transformer-based approach cannot effectively capture the fine-grained details. This paper proposes a dual encoder network with transformer-CNN for multi-organ segmentation. The new segmentation framework takes full advantage of CNN and transformer to enhance the segmentation accuracy. The Swin-transformer encoder extracts global information, and the CNN encoder captures local information. We introduce fusion modules to fuse convolutional features and the sequence of features from the transformer. Feature fusion is concatenated through the skip connection to smooth the decision boundary effectively. We extensively evaluate our method on the synapse multi-organ CT dataset and the automated cardiac diagnosis challenge (ACDC) dataset. The results demonstrate that the proposed method achieves Dice similarity coefficient (DSC) metrics of 80.68% and 91.12% on the synapse multi-organ CT and ACDC datasets, respectively. We perform the ablation studies on the ACDC dataset, demonstrating the effectiveness of critical components of our method. Our results match the ground-truth boundary more consistently than the existing models. Our approach gains more accurate results on challenging 2D images for multi-organ segmentation. Compared with the state-of-the-art methods, our proposed method achieves superior performance in multi-organ segmentation tasks.

A 3D Fusion U-Net with Dual CNN and Transformer Encoders for Lung Airway Segmentation

C3D-UNET: A Comprehensive 3D Unet for Covid-19 Segmentation with Intact Encoding and Local Attention

Segmentation of Lung Airways Based on Deep Learning Methods

3D Fusion W-Net and HoloLens-Based Interactive Visualization for Lung Airway Segmentation

A Method of Lung Organ Segmentation in CT Images Based on Multiple Residual Structures and an Enhanced Spatial Attention Mechanism

A Novel Automatic Method Based on U-Net for Lung Fields Segmentation

FDA: Feature Decomposition and Aggregation for Robust Airway Segmentation

Two-stage contextual transformer-based convolutional neural network for airway extraction from CT images

Lung Parenchyma Segmentation Based on U-Net Fused With Shape Stream

An end-to-end multi-scale airway segmentation framework based on pulmonary CT image

High Throughput Lung And Lobar Segmentation By 2d And 3d Cnn On Chest Ct With Diffuse Lung Disease

Coarse-to-fine Airway Segmentation Using Multi information Fusion Network and CNN-based Region Growing

Deeply Supervised U-Net with Feature Fusion: Automatic COVID-19 Lung Infection Segmentation from CT Images

AirwayNet: A Voxel-Connectivity Aware Approach for Accurate Airway Segmentation Using Convolutional Neural Networks

Multi-Stage Airway Segmentation in Lung CT Based on Multi-scale Nested Residual UNet

LCOV-NET: A Lightweight Neural Network for COVID-19 Pneumonia Lesion Segmentation from 3D CT Images.

A segmentation method of airway from chest CT image based on VGG-Unet neural network.

A Novel U-Like Network for the Segmentation of Thoracic Organs

Dense-U-Net: A novel densely connected CNN for lung fields segmentation

A Novel Network Based on Densely Connected Fully Convolutional Networks for Segmentation of Lung Tumors on Multi-Modal MR Images

Dual encoder network with transformer-CNN for multi-organ segmentation