Abstract:Most recent 3D medical image segmentation methods adopt convolutional neural networks (CNNs) that rely on deep feature representation and achieve adequate performance. However, due to the convolutional architectures having limited receptive fields, they cannot explicitly model the long-range dependencies in the medical image. Recently, Transformer can benefit from global dependencies using self-attention mechanisms and learn highly expressive representations. Some works were designed based on the Transformers, but the existing Transformers suffer from extreme computational and memories, and they cannot take full advantage of the powerful feature representations in 3D medical image segmentation. In this paper, we aim to connect the different resolution streams in parallel and propose a novel network, named Trans former based H igh R esolution Net work (TransHRNet), with an Effective Transformer (EffTrans) block, which has sufficient feature representation even at high feature resolutions . Given a 3D image, the encoder first utilizes CNN to extract the feature representations to capture the local information, and then the different feature maps are reshaped elaborately for tokens that are fed into each Transformer stream in parallel to learn the global information and repeatedly exchange the information across streams. Unfortunately, the proposed framework based on the standard Transformer needs a huge amount of computation, thus we introduce a deep and effective Transformer to deliver better performance with fewer parameters. The proposed TransHRNet is evaluated on the Multi-Atlas Labeling Beyond the Cranial Vault (BCV) dataset that consists of 11 major human organs and the Medical Segmentation Decathlon (MSD) dataset for brain tumor and spleen segmentation tasks. Experimental results show that it performs better than the convolutional and other related Transformer-based methods on the 3D multi-organ segmentation tasks. Code is available at https://github.com/duweidai/TransHRNet .

Acceleration of high-quality Raman imaging via a locality enhanced transformer network

Enhanced Stimulated Raman and Fluorescence Imaging by Single-Frame Trained BDN

High-speed, High-Sensitivity Spectroscopic Stimulated Raman Scattering Microscopy by Ultrafast Delay-Line Tuning and Deep Learning

RaT: Raman Transformer for highly accurate melanoma detection with critical features visualization

Rapid Identification of Bacterial Pathogens by Raman Spectroscopy and Transformer

High-Precision Intelligent Cancer Diagnosis Method: 2D Raman Figures Combined with Deep Learning

Deep learning-based Raman spectroscopy qualitative analysis algorithm: A convolutional neural network and transformer approach

LET-Net: locally enhanced transformer network for medical image segmentation

RETNet: Resolution enhancement Transformer network for magnetic particle imaging based on X-space

Fast Raman imaging through the combination of context-aware matrix completion and low spectral resolution

Transformer Connections: Improving Segmentation in Blurred Near‐Infrared Blood Vessel Image in Different Depth

RATIR-Net: Adaptive SAR Image Reconstruction Based on Transformer Architecture

Fast Real-Time Brain Tumor Detection Based on Stimulated Raman Histology and Self-Supervised Deep Learning Model

Towards more efficient ophthalmic disease classification and lesion location via convolution transformer

An efficient R-Transformer network with dual encoders for brain glioma segmentation in MR images

3D Medical image segmentation using parallel transformers

HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction

ULM-MbCNRT: In vivo Ultrafast Ultrasound Localization Microscopy by Combining Multi-branch CNN and Recursive Transformer

RFTNet: Region–Attention Fusion Network Combined with Dual-Branch Vision Transformer for Multimodal Brain Tumor Image Segmentation

EPT-Net: Edge Perception Transformer for 3D Medical Image Segmentation

GLFormer: an Efficient Transformer Network for Fast Magnetic Resonance Imaging Reconstruction.