Abstract:Image super-resolution (ISR) technology aims to enhance resolution and improve image quality. It is widely applied to various real-world applications related to image processing, especially in medical images, while relatively little appliedto anime image production. Furthermore, contemporary ISR tools are often based on convolutional neural networks (CNNs), while few methods attempt to use transformers that perform well in other advanced vision tasks. We propose a so-called anime image super-resolution (AISR) method based on the Swin Transformer in this work. The work was carried out in several stages. First, a shallow feature extraction approach was employed to facilitate the features map of the input image's low-frequency information, which mainly approximates the distribution of detailed information in a spatial structure (shallow feature). Next, we applied deep feature extraction to extract the image semantic information (deep feature). Finally, the image reconstruction method combines shallow and deep features to upsample the feature size and performs sub-pixel convolution to obtain many feature map channels. The novelty of the proposal is the enhancement of the low-frequency information using a Gaussian filter and the introduction of different window sizes to replace the patch merging operations in the Swin Transformer. A high-quality anime dataset was constructed to curb the effects of the model robustness on the online regime. We trained our model on this dataset and tested the model quality. We implement anime image super-resolution tasks at different magnifications (2×, 4×, 8×). The results were compared numerically and graphically with those delivered by conventional convolutional neural network-based and transformer-based methods. We demonstrate the experiments numerically using standard peak signal-to-noise ratio (PSNR) and structural similarity (SSIM), respectively. The series of experiments and ablation study showcase that our proposal outperforms others.

The Method of Industrial Internet Image Super-resolution Based on Transformer

A Transformer-Based Model for Super-resolution of Anime Image

Transformer-based image super-resolution and its lightweight

Edge-enhanced infrared image super-resolution reconstruction model under transformer

DTCNet: Transformer-CNN Distillation for Super-Resolution of Remote Sensing Image

Image Super-Resolution Using a Simple Transformer Without Pretraining

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

Super-Resolution Algorithm Based on Transformer+CNN

MadFormer: multi-attention-driven image super-resolution method based on Transformer

Transformer Component Recognition in Pictures Taken by Submersible Robots

Efficient multi-branch dynamic fusion network for super-resolution of industrial component image

Research on Image Super-resolution Reconstruction Based on Deep Learning

Efficient Transformer for Single Image Super-Resolution.

MaxSR: Image Super-Resolution Using Improved MaxViT

EViTIB: Efficient Vision Transformer Via Inductive Bias Exploration for Image Super-Resolution

A Residual Network with Efficient Transformer for Lightweight Image Super-Resolution

Exploring Frequency-Inspired Optimization in Transformer for Efficient Single Image Super-Resolution

Research on Image Super-Resolution Reconstruction Mechanism based on Convolutional Neural Network

Image Super-resolution via Efficient Transformer Embedding Frequency Decomposition with Restart

Cross-Spatial Pixel Integration and Cross-Stage Feature Fusion Based Transformer Network for Remote Sensing Image Super-Resolution

Learning hybrid dynamic transformers for underwater image super-resolution