Abstract:Medical image segmentation is a fundamental research problem in the field of medical image processing. Recently, the Transformer have achieved highly competitive performance in computer vision. Therefore, many methods combining Transformer with convolutional neural networks (CNNs) have emerged for segmenting medical images. However, these methods cannot effectively capture the multi-scale features in medical images, even though texture and contextual information embedded in the multi-scale features are extremely beneficial for segmentation. To alleviate this limitation, we propose a novel Transformer–CNN combined network using multi-scale feature learning for three-dimensional (3D) medical image segmentation, which is called MS-TCNet. The proposed model utilizes a shunted Transformer and CNN to construct an encoder and pyramid decoder, allowing six different scale levels of feature learning. It captures multi-scale features with refinement at each scale level. Additionally, we propose a novel lightweight multi-scale feature fusion (MSFF) module that can fully fuse the different-scale semantic features generated by the pyramid decoder for each segmentation class, resulting in a more accurate segmentation output. We conducted experiments on three widely used 3D medical image segmentation datasets. The experimental results indicated that our method outperformed state-of-the-art medical image segmentation methods, suggesting its effectiveness, robustness, and superiority. Meanwhile, our model has a smaller number of parameters and lower computational complexity than conventional 3D segmentation networks . The results confirmed that the model is capable of effective multi-scale feature learning and that the learned multi-scale features are useful for improving segmentation performance. We open-sourced our code, which can be found at https://github.com/AustinYuAo/MS-TCNet .

A Combined Deformable Model and Medical Transformer Algorithm for Medical Image Segmentation

A Novel Deep Learning Model for Medical Image Segmentation with Convolutional Neural Network and Transformer

A Lightweight Multi-Scale Multi-Angle Dynamic Interactive Transformer-CNN Fusion Model for 3D Medical Image Segmentation

TSE DeepLab: An efficient visual transformer for medical image segmentation

DECTNet: Dual Encoder Network combined convolution and Transformer architecture for medical image segmentation

An Augmentation Strategy for Medical Image Processing Based on Statistical Shape Model and 3D Thin Plate Spline for Deep Learning

Enhancing medical image segmentation with a multi-transformer U-Net

MCRformer: Morphological constraint reticular transformer for 3D medical image segmentation

From CNN to Transformer: A Review of Medical Image Segmentation Models

DuAT: Dual-Aggregation Transformer Network for Medical Image Segmentation

Hybrid Deformable Models for Medical Segmentation and Registration.

HCA-former: Hybrid Convolution Attention Transformer for 3D Medical Image Segmentation

Optimization of U-shaped pure transformer medical image segmentation network

MISSFormer: an Effective Transformer for 2D Medical Image Segmentation

D-former: a U-shaped Dilated Transformer for 3D medical image segmentation

A 3D Medical Image Segmentation Framework Fusing Convolution and Transformer Features

MS-TCNet: An effective Transformer–CNN combined network using multi-scale feature learning for 3D medical image segmentation

A Improved Spatial-Reduction Attention Transformer for Medical Image Segmentation

A statistical deformation model-based data augmentation method for volumetric medical image segmentation

ConvFormer: Combining CNN and Transformer for Medical Image Segmentation