Abstract:Recently, due to higher requirements for satellite video resolution, video super-resolution (VSR) has been extensively studied. However, the following problems have not been effectively resolved: 1) previous satellite VSR methods cannot achieve continuous-scale (integer and noninteger scale) VSR with a single model; 2) satellite video has complex ground and weak textures, which increases the difficulty of capturing motion information. In addition, existing methods adopt a unified alignment path, which leads to a drop in feature alignment accuracy; and 3) during feature fusion, previous methods ignore the correlation of spatiotemporal information in satellite video and cannot make full use of the spatiotemporal information. To address the above problems, in this article, we propose a novel network for continuous-scale satellite VSR (CSVSR). Specifically, first, for effective motion capture and accurate feature alignment, we design a residual-guided and time-aware dynamic routing alignment module, which can use feature residuals to lock motion areas and then dynamically select the corresponding alignment path based on the temporal distance. Second, we proposed a nonlocal mask-based feature fusion module (NMFFM) to exploit the correlation of the spatiotemporal features and complete effective spatiotemporal feature fusion. Third, to make our network adapt to multitask learning, we develop a scale-aware convolutional (SA-Conv) layer, which lets our network dynamically extract scale-adaptive features according to the input scale factors. Finally, we propose a continuous-scale upsampling module with a global feature implicit function (GFIF), which can achieve continuous-scale mapping from features to pixel values. In addition, we carefully design a novel training strategy to optimize our network. Comprehensive experiments verify that the proposed CSVSR has superior reconstruction performance on continuous-scale factors. The code will be available at https://github.com/chongningni/CSVSR.

Video Satellite Imagery Super Resolution Via Convolutional Neural Networks

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Video Super-Resolution Based on Multiple Networks Merging

Parallel-Connected Residual Channel Attention Network for Remote Sensing Image Super-Resolution

Satellite Video Super-Resolution Based on Adaptively Spatiotemporal Neighbors and Nonlocal Similarity Regularization

Multiframe Video Satellite Image Super-Resolution via Attention-Based Residual Learning

Bidirectional Convolutional LSTM Neural Network for Remote Sensing Image Super-Resolution

Modified ESRGAN with Uformer for Video Satellite Imagery Super-Resolution

Single Satellite Imagery Superresolution Based on Hybrid Nonlocal Similarity Constrained Convolution Sparse Coding

Super-Resolution Land Cover Mapping Based on the Convolutional Neural Network

ConvMambaSR: Leveraging State-Space Models and CNNs in a Dual-Branch Architecture for Remote Sensing Imagery Super-Resolution

SUPER-RESOLUTION OF MULTISPECTRAL SATELLITE IMAGES USING CONVOLUTIONAL NEURAL NETWORKS

Unsupervised Video Satellite Super-Resolution by Using Only a Single Video

RSCNN: A CNN-Based Method to Enhance Low-Light Remote-Sensing Images

Video Super-Resolution Reconstruction Based on Deep Convolutional Neural Network and Spatio-Temporal Similarity

Space-time super-resolution for satellite video: A joint framework based on multi-scale spatial-temporal transformer

Remote Sensing Image Super-Resolution Using Enriched Spatial-Channel Feature Aggregation Networks

A Super-Resolution Algorithm Based on Hybrid Network for Multi-Channel Remote Sensing Images

Deformable Convolution Alignment and Dynamic Scale-Aware Network for Continuous-Scale Satellite Video Super-Resolution

End-to-End Image Super-Resolution via Deep and Shallow Convolutional Networks

Single-frame super-resolution for high resolution optical remote-sensing data products