Abstract:Image super-resolution reconstruction has been widely used in remote sensing, medicine and other fields. In recent years, due to the rise of deep learning research and the successful application of convolutional neural networks in the image field, the super-resolution reconstruction technology based on deep learning has also achieved great development. However, there are still some problems that need to be solved. For example, the current mainstream image super-resolution algorithms based on single or multiple frames pursue high performance indicators such as PSNR and SSIM, while the reconstructed image is relatively smooth and lacks many high-frequency details. It is not conducive to application in a real environment. To address such problem, this paper proposes a super-resolution reconstruction model of sequential images based on Generative Adversarial Networks (GAN). The proposed approach combines the registration module to fuse adjacent frames, effectively use the detailed information in multiple consecutive frames, and enhances the spatio-temporality of low-resolution images in sequential images. While the GAN was used to improve the effect of image high-frequency texture detail reconstruction, WGAN was introduced to optimize model training. The reconstruction results not only improved the PSNR and SSIM indexes but also reconstructed more high-frequency detail textures. Finally, in order to further improve the perception effect, an additional registration loss item RLT is introduced in the GAN network perception loss. Through extensive experiments, it shows that the model proposed in this paper effectively obtains the information between the sequence images. When the PSNR and SSIM indicators are improve, it can reconstruct better high-frequency texture details than the current advanced multi-frame algorithms.

Reconstruction of Multi-view Video Based on GAN.

GAN-Based Multi-View Video Coding with Spatio-Temporal EPI Reconstruction

Virtual View Generation Based on 3D-Dense-attentive GAN Networks

Multi-view Learning and Reconstruction Algorithms via Generative Adversarial Networks

Video Reconstruction with Multimodal Information

Multi-View Frame Reconstruction with Conditional GAN

MV-GNN: Multi-View Graph Neural Network for Compression Artifacts Reduction

Deep Cross-View Reconstruction GAN Based on Correlated Subspace for Multi-View Transformation

Multi-view Video Coding Based on View Prediction

VideoMV: Consistent Multi-View Generation Based on Large Video Generative Model

Progressive Learning of 3D Reconstruction Network from 2D GAN Data

2D GANs Meet Unsupervised Single-view 3D Reconstruction

MS-GAN: multi-scale GAN with parallel class activation maps for image reconstruction

View Sequence Prediction GAN: Unsupervised Representation Learning for 3D Shapes by Decomposing View Content and Viewpoint Variance

Single-view 3D Reconstruction Algorithm Based on View-aware

Multi-Frame Super-Resolution Algorithm Based on a WGAN

Multi-view Image Generation by Cycle CVAE-GAN Networks.

Survey on Video Image Reconstruction Method Based on Generative Model

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds

Towards High Resolution Video Generation with Progressive Growing of Sliced Wasserstein GANs

Diverse Video Generation from a Single Video