Abstract:To address the problems in the existing video super-resolution methods, such as noise, over smooth and visual artifacts, which are caused by the reliance on limited external training or mismatch of internal similarity patch instances, this study proposes a novel video super-resolution reconstruction algorithm based on deep learning and spatio-temporal feature similarity (DLSS-VSR). The video super-resolution reconstruction mechanism with the joint internal and external constraints is established utilizing the complementary advantages of both external deep correlation mapping learning and internal spatio-temporal nonlocal self-similarity prior constraint. A deep learning model based on deep convolutional neural network is constructed to learn the nonlinear correlation mapping between low-resolution and high-resolution video frame patches. A novel spatio-temporal feature similarity calculation method is proposed, which considers both internal video spatio-temporal self-similarity and external clean nonlocal similarity. For the internal spatio-temporal feature self-similarity, we improve the accuracy and robustness of similarity matching by proposing a similarity measure strategy based on spatio-temporal moment feature similarity and structural similarity. The external nonlocal similarity prior constraint is learned by the patch group-based Gaussian mixture model. The time efficiency for spatio-temporal similarity matching is further improved based on saliency detection and region correlation judgment strategy, which achieves a better tradeoff between super-resolution accuracy and speed. Experimental results demonstrate that the DLSS-VSR algorithm achieves competitive super-resolution quality compared to other state-of-the-art algorithms in both subjective and objective evaluations.

Super-Resolution Video Target Re-Recognition Based on Joint Training

Video Super-Resolution Based on Multiple Networks Merging

Depth Image Super-resolution via Two-Branch Network

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

A Video Target Re-Recognition Method Based on Adaptive Attention Enhancement and Multi-Scale Feature Fusion

The face image super-resolution algorithm based on combined representation learning

MSTN: A Multi-granular Spatial–Temporal Network for video-based person re-identification

Real-Time Video Super-Resolution with Spatio-Temporal Modeling and Redundancy-Aware Inference

Video Super-Resolution Via a Spatio-Temporal Alignment Network.

A Super-Resolution Reconstruction Network of Space Target Images Based on Dual Regression and Deformable Convolutional Attention Mechanism

Target detection algorithm based on super- resolution color remote sensing image reconstruction

Video super-resolution via mixed spatial-temporal convolution and selective fusion

Multi-Level Fusion Temporal-Spatial Co-Attention for Video-Based Person Re-Identification

Low Resolution Information Also Matters: Learning Multi-Resolution Representations for Person Re-Identification

Video Super-Resolution Reconstruction Based on Deep Learning and Spatio-Temporal Feature Self-similarity

Image Super-Resolution Based on Adaptive Joint Distribution Modeling

Superresolution reconstruction of optical remote sensing images based on a multiscale attention adversarial network

Adaptive super-resolution for person re-identification with low-resolution images

Video Super-Resolution Reconstruction Based on Deep Convolutional Neural Network and Spatio-Temporal Similarity

Deep Low-Resolution Person Re-Identification

A High-Accuracy Unsupervised Person Re-identification Method Using Auxiliary Information Mined from Datasets