Abstract:BACKGROUND Various types of noise artifacts inevitably exist in some medical imaging modalities due to limitations of imaging techniques, which impair either clinical diagnosis or subsequent analysis. Recently, deep learning approaches have been rapidly developed and applied on medical images for noise removal or image quality enhancement. Nevertheless, due to complexity and diversity of noise distribution representations in different medical imaging modalities, most of the existing deep learning frameworks are incapable to flexibly remove noise artifacts while retaining detailed information. As a result, it remains challenging to design an effective and unified medical image denoising method that will work across a variety of noise artifacts for different imaging modalities without requiring specialized knowledge in performing the task. PURPOSE In this paper, we propose a novel encoder-decoder architecture called Swin transformer-based residual u-shape Network (StruNet), for medical image denoising. METHODS Our StruNet adopts a well-designed block as the backbone of the encoder-decoder architecture, which integrates Swin Transformer modules with residual block in parallel connection. Swin Transformer modules could effectively learn hierarchical representations of noise artifacts via self-attention mechanism in non-overlapping shifted windows and cross-window connection, while residual block is advantageous to compensate loss of detailed information via shortcut connection. Furthermore, perceptual loss and low-rank regularization are incorporated into loss function respectively in order to constrain the denoising results on feature-level consistency and low-rank characteristics. RESULTS To evaluate the performance of the proposed method, we have conducted experiments on three medical imaging modalities including computed tomography (CT), optical coherence tomography (OCT) and optical coherence tomography angiography (OCTA). CONCLUSIONS The results demonstrate that the proposed architecture yields a promising performance of suppressing multiform noise artifacts existing in different imaging modalities.

Image Denoising Using Channel Attention Residual Enhanced Swin Transformer

Vision Transformers for Single Image Dehazing

Spatial-Adaptive Network for Single Image Denoising

Residual Swin Transformer Channel Attention Network for Image Demosaicing

CTFCD: Channel Transformer Based on Full Convolutional Decoder for Single Image Deraining

A Dynamic Network with Transformer for Image Denoising

CUR Transformer: A Convolutional Unbiased Regional Transformer for Image Denoising

Comprehensive and Delicate: an Efficient Transformer for Image Restoration

Dilated Residual Encode-Decode Networks for Image Denoising

DnSwin: Toward Real-World Denoising via Continuous Wavelet Sliding-Transformer

An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network.

DnSwin: Toward real-world denoising via a continuous Wavelet Sliding Transformer

Hybrid Transformer-CNN for Real Image Denoising

Swin transformer and ResNet based deep networks for low-light image enhancement

Residual SwinV2 transformer coordinate attention network for image super resolution

Single image denoising with a feature-enhanced network

Coarse-to-Fine Video Denoising with Dual-Stage Spatial-Channel Transformer

StruNet: Perceptual and low-rank regularized transformer for medical image denoising.

Efficient Lightweight Image Denoising with Triple Attention Transformer

Efficient Swin Transformer for Remote Sensing Image Super-Resolution

SGDFormer: One-stage Transformer-based Architecture for Cross-Spectral Stereo Image Guided Denoising