Abstract:Background and Objectives: Transformer is a model relying entirely on self-attention which has a wide range of applications in the field of natural language processing. Researchers are beginning to focus on the transformer in medical images due to the past few years having seen the rapid development of transformer in many vision fields such as vision transformer (ViT) and Swin transformer. In the last year, moreover, many scholars have applied transformer to medical image segmentation and have achieved good segmentation results. Transformer-based medical image segmentation has become one of the hot spots in this field. The purpose of this work is to categorize and review the segmentation methods of Unet-based transformer and other model based transformer in medical images. Methods: This paper summarizes the transformer-based segmentation models in the abdominal organs, heart, brain, and lung based on the relevant studies in the last two years. We described and analyzed the model structure including the position of the transformer in the model, the changes made by scholars to transformer and the combination with the model. In this work, the segmentation performance results based on Dice evaluation metrics are compared. Results: Through the help of 93 references, we find that researchers prefer to use Unet-based transformer models than others and place the transformer structure in the encoder. These new models improve the segmentation performance compared with U-Net and other segmentation models. However, there are not many related studies on lungs, which points to a new way for future research. Conclusions: We found that the combination of U-Net and transformer is more suitable for segmentation. In future research on medical image segmentation, researchers can use a suitable transformer-based segmentation method or modify the transformer structure according to the segmentation requirements. We hope that this work will be helpful for improvements of the transformer to solve clinical problems in medicine.

Review of Research on Application of Vision Transformer in Medical Image Analysis

Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives

Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Review

Recent Progress in Transformer-based Medical Image Analysis

Application of visual transformer in renal image analysis

Transformers in medical image segmentation: A review

A Survey on Vision Transformer

Transformers in Medical Image Analysis

Comparison of Vision Transformers and Convolutional Neural Networks in Medical Image Analysis: A Systematic Review

A Survey on Visual Transformer

Vision Transformers in Medical Computer Vision -- A Contemplative Retrospection

Transformers in medical imaging: A survey

Using Vision Transformers in 3-D Medical Image Classifications

Transformers in medical image segmentation: a narrative review

Transformers Meet Visual Learning Understanding: A Comprehensive Review

Investigating Vision Transformer Models for Low-Resolution Medical Image Recognition

Vision Transformers for Computational Histopathology

Advantages of transformer and its application for medical image segmentation: a survey

Systematic Review of Hybrid Vision Transformer Architectures for Radiological Image Analysis

Vision Transformer for Efficient Chest X-ray and Gastrointestinal Image Classification

Comprehensive review of Transformer‐based models in neuroscience, neurology, and psychiatry