Abstract:Abstract Background Convolutional neural network (CNN)–based methods have shown excellent performance in denoising and reconstruction of super-resolved structured illumination microscopy (SR-SIM) data. Therefore, CNN-based architectures have been the focus of existing studies. However, Swin Transformer, an alternative and recently proposed deep learning–based image restoration architecture, has not been fully investigated for denoising SR-SIM images. Furthermore, it has not been fully explored how well transfer learning strategies work for denoising SR-SIM images with different noise characteristics and recorded cell structures for these different types of deep learning–based methods. Currently, the scarcity of publicly available SR-SIM datasets limits the exploration of the performance and generalization capabilities of deep learning methods. Results In this work, we present SwinT-fairSIM, a novel method based on the Swin Transformer for restoring SR-SIM images with a low signal-to-noise ratio. The experimental results show that SwinT-fairSIM outperforms previous CNN-based denoising methods. Furthermore, as a second contribution, two types of transfer learning—namely, direct transfer and fine-tuning—were benchmarked in combination with SwinT-fairSIM and CNN-based methods for denoising SR-SIM data. Direct transfer did not prove to be a viable strategy, but fine-tuning produced results comparable to conventional training from scratch while saving computational time and potentially reducing the amount of training data required. As a third contribution, we publish four datasets of raw SIM images and already reconstructed SR-SIM images. These datasets cover two different types of cell structures, tubulin filaments and vesicle structures. Different noise levels are available for the tubulin filaments. Conclusion The SwinT-fairSIM method is well suited for denoising SR-SIM images. By fine-tuning, already trained models can be easily adapted to different noise characteristics and cell structures. Furthermore, the provided datasets are structured in a way that the research community can readily use them for research on denoising, super-resolution, and transfer learning strategies.

SwinDenoising: A Local and Global Feature Fusion Algorithm for Infrared Image Denoising

Vision Transformers for Single Image Dehazing

Multi Scale Detail-Preserving Denoising Method Of Infrared Image Via Relative Total Variation

SwinCT: feature enhancement based low-dose CT images denoising with swin transformer

DnSwin: Toward real-world denoising via a continuous Wavelet Sliding Transformer

Evaluation of Swin Transformer and knowledge transfer for denoising of super-resolution structured illumination microscopy data

Resolution enhancement processing on low quality images using swin transformer based on interval dense connection strategy

DnSwin: Toward Real-World Denoising via Continuous Wavelet Sliding-Transformer

A hyperspectral image denoising method based on land cover spectral autocorrelation

SwinIR: Image Restoration Using Swin Transformer

Infrared Image Super-Resolution Network Utilizing the Enhanced Transformer and U-Net

SwinFIR: Revisiting the SwinIR with Fast Fourier Convolution and Improved Training for Image Super-Resolution

SwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Images

SDRSwin: A Residual Swin Transformer Network with Saliency Detection for Infrared and Visible Image Fusion

Memorizing Swin-Transformer Denoising Network for Diffusion Model

LAGSwin: Local attention guided Swin-transformer for thermal infrared sports object detection

SwinIBSR: Towards Real-World Infrared Image Super-Resolution

Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesis

An efficient swin transformer-based method for underwater image enhancement

SwinIBSR: Toward real-world infrared image super-resolution

Practical Blind Denoising via Swin-Conv-UNet and Data Synthesis