Abstract:By converting low-frame-rate, low-resolution videos into high-frame-rate, high-resolution ones, space-time video super-resolution techniques can enhance visual experiences and facilitate more efficient information dissemination. We propose a convolutional neural network (CNN) for space-time video super-resolution, namely GIRNet. To generate highly accurate features and thus improve performance, the proposed network integrates a feature-level temporal interpolation module with deformable convolutions and a global spatial-temporal information-based residual convolutional long short-term memory (convLSTM) module. In the feature-level temporal interpolation module, we leverage deformable convolution, which adapts to deformations and scale variations of objects across different scene locations. This presents a more efficient solution than conventional convolution for extracting features from moving objects. Our network effectively uses forward and backward feature information to determine inter-frame offsets, leading to the direct generation of interpolated frame features. In the global spatial-temporal information-based residual convLSTM module, the first convLSTM is used to derive global spatial-temporal information from the input features, and the second convLSTM uses the previously computed global spatial-temporal information feature as its initial cell state. This second convLSTM adopts residual connections to preserve spatial information, thereby enhancing the output features. Experiments on the Vimeo90K dataset show that the proposed method outperforms state-of-the-art techniques in peak signal-to-noise-ratio (by 1.45 dB, 1.14 dB, and 0.02 dB over STARnet, TMNet, and 3DAttGAN, respectively), structural similarity index(by 0.027, 0.023, and 0.006 over STARnet, TMNet, and 3DAttGAN, respectively), and visually.

SA-GNN: Stereo Attention and Graph Neural Network for Stereo Image Super-Resolution

Non-Local Nested Residual Attention Network for Stereo Image Super-Resolution.

Learning Accurate and Enriched Features for Stereo Image Super-Resolution

CVGSR: Stereo image Super-Resolution with Cross-View guidance

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Non-Local Similarity-Based Attentive Graph Convolution Network for Remote Sensing Image Super-Resolution

A New Convolutional Neural Network for Super-Resolution by Global and Local Residual

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Sub-Pixel Convolutional Neural Network for Image Super-Resolution Reconstruction

Stereo Endoscopic Image Super-Resolution Using Disparity-Constrained Parallel Attention

SRPGAN: Perceptual Generative Adversarial Network for Single Image Super Resolution.

Multi-Stage Edge-Guided Stereo Feature Interaction Network for Stereoscopic Image Super-Resolution

A Two-Stage Attentive Network for Single Image Super-Resolution

Image Processing GNN: Breaking Rigidity in Super-Resolution

Multi-scale Parallax Attention for Stereo Image Super-Resolution

Global Spatial-Temporal Information-based Residual ConvLSTM for Video Space-Time Super-Resolution

Cross-View Hierarchy Network for Stereo Image Super-Resolution

Second-Order Attention Network For Single Image Super-Resolution

NAFRSSR: a Lightweight Recursive Network for Efficient Stereo Image Super-Resolution

Video Super-Resolution Reconstruction Based on Deep Convolutional Neural Network and Spatio-Temporal Similarity

Cross View Capture for Stereo Image Super-Resolution