Abstract:Blind-spot networks (BSN) have been prevalent neural architectures in self-supervised image denoising (SSID). However, most existing BSNs are conducted with convolution layers. Although transformers have shown the potential to overcome the limitations of convolutions in many image restoration tasks, the attention mechanisms may violate the blind-spot requirement, thereby restricting their applicability in BSN. To this end, we propose to analyze and redesign the channel and spatial attentions to meet the blind-spot requirement. Specifically, channel self-attention may leak the blind-spot information in multi-scale architectures, since the downsampling shuffles the spatial feature into channel dimensions. To alleviate this problem, we divide the channel into several groups and perform channel attention separately. For spatial self-attention, we apply an elaborate mask to the attention matrix to restrict and mimic the receptive field of dilated convolution. Based on the redesigned channel and window attentions, we build a Transformer-based Blind-Spot Network (TBSN), which shows strong local fitting and global perspective abilities. Furthermore, we introduce a knowledge distillation strategy that distills TBSN into smaller denoisers to improve computational efficiency while maintaining performance. Extensive experiments on real-world image denoising datasets show that TBSN largely extends the receptive field and exhibits favorable performance against state-of-the-art SSID methods. The code and pre-trained models are available at <a class="link-external link-https" href="https://github.com/nagejacob/TBSN" rel="external noopener nofollow">this https URL</a>.

Single-Channel Blind Image Separation Based on Transformer-Guided GAN

Blind source separation based on adaptive artificial bee colony algorithm

No One Can Escape: A General Approach to Detect Tampered and Generated Image

Research on Single-Channel Blind Deconvolution Algorithm of Single Mixed Image

Single-Channel Signal Separation and Deconvolution with Generative Adversarial Networks

Research on Single-channel Blind Deconvolution Algorithm for Multi-source Signals

Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising

Multi-Task Learning for Blind Source Separation

Transformer based Generative Adversarial Network for Liver Segmentation

TBSN: Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising.

A smart universal single-channel blind source separation method and applications

Swin-UNIT: Transformer-based GAN for High-resolution Unpaired Image Translation

Blind Separation of Sufficiently Sparse Sources in Multichannel Compressed Sensing.

Feature Separation GAN for Cross View Gait Recognition

Blind Source Separation of Single-Channel Mixtures via Multi-Encoder Autoencoders

Blind Source Separation Based on Improved Wave-U-Net Network

Rethinking low-light enhancement via Transformer-GAN

Hierarchical Separable Video Transformer for Snapshot Compressive Imaging

Blind separation of locally smooth images based on genetic algorithm

An Unmixing-Based Multi-Attention GAN for Unsupervised Hyperspectral and Multispectral Image Fusion

CSWin-UNet: Transformer UNet with Cross-Shaped Windows for Medical Image Segmentation