Abstract:Most recent 3D medical image segmentation methods adopt convolutional neural networks (CNNs) that rely on deep feature representation and achieve adequate performance. However, due to the convolutional architectures having limited receptive fields, they cannot explicitly model the long-range dependencies in the medical image. Recently, Transformer can benefit from global dependencies using self-attention mechanisms and learn highly expressive representations. Some works were designed based on the Transformers, but the existing Transformers suffer from extreme computational and memories, and they cannot take full advantage of the powerful feature representations in 3D medical image segmentation. In this paper, we aim to connect the different resolution streams in parallel and propose a novel network, named Trans former based H igh R esolution Net work (TransHRNet), with an Effective Transformer (EffTrans) block, which has sufficient feature representation even at high feature resolutions . Given a 3D image, the encoder first utilizes CNN to extract the feature representations to capture the local information, and then the different feature maps are reshaped elaborately for tokens that are fed into each Transformer stream in parallel to learn the global information and repeatedly exchange the information across streams. Unfortunately, the proposed framework based on the standard Transformer needs a huge amount of computation, thus we introduce a deep and effective Transformer to deliver better performance with fewer parameters. The proposed TransHRNet is evaluated on the Multi-Atlas Labeling Beyond the Cranial Vault (BCV) dataset that consists of 11 major human organs and the Medical Segmentation Decathlon (MSD) dataset for brain tumor and spleen segmentation tasks. Experimental results show that it performs better than the convolutional and other related Transformer-based methods on the 3D multi-organ segmentation tasks. Code is available at https://github.com/duweidai/TransHRNet .

3D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation

Mmformer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation

GSFormer: A Gated Skip Connection and Feature Fusion Transformer-based Neural Network for 3D MRI Brain Tumor Segmentation

TransSea: Hybrid CNN-Transformer with Semantic Awareness for 3D Brain Tumor Segmentation

TransBTS: Multimodal Brain Tumor Segmentation Using Transformer

TransSea: Hybrid CNN–Transformer With Semantic Awareness for 3-D Brain Tumor Segmentation

OdCFU-Net for Brain Tumor Segmentation Based on MRI

Attention transformer mechanism and fusion-based deep learning architecture for MRI brain tumor classification system

3D Medical image segmentation using parallel transformers

3D U-TFA: A Deep Convolutional Neural Network for Automatic Segmentation of Glioblastoma

3D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRI

Adaptive Cascaded Transformer U-Net for MRI Brain Tumor Segmentation

Hybrid-Fusion Transformer for Multisequence MRI

RFTNet: Region–Attention Fusion Network Combined with Dual-Branch Vision Transformer for Multimodal Brain Tumor Image Segmentation

Multimodal Transformer of Incomplete MRI Data for Brain Tumor Segmentation.

Deep Convolutional Neural Network with a Multi-Scale Attention Feature Fusion Module for Segmentation of Multimodal Brain Tumor.

Augmented Transformer network for MRI brain tumor segmentation

A Robust Volumetric Transformer for Accurate 3D Tumor Segmentation

Enhancing Hierarchical Transformers for Whole Brain Segmentation with Intracranial Measurements Integration

Multi -Modality Brain Tumor Segmentation Network Based on Collaborative Feature Fusion

An efficient R-Transformer network with dual encoders for brain glioma segmentation in MR images