Abstract:Remote sensing (RS) images are important to monitor and survey earth at varying spatial scales. Continuous observations from various RS sources complement single observations to improve applications. Fusion into single or multiple images provides more informative, accurate, complete, and coherent data. Studies intensively investigated spatial-temporal fusion for specific applications like pan-sharpening and spatial-temporal fusion for time-series analysis. Fusion methods can process different images, modalities, and tasks and are expected to be robust and adaptive to various types of images (e.g., spectral images, classification maps, and elevation maps) and scene complexities. This work presents solutions to improve existing fusion methods that process gridded data and consider their type-specific uncertainties. The contributions include: 1) A spatial-temporal filter that addresses spectral heterogeneity of multitemporal images. 2) 3D iterative spatiotemporal filter that enhances spatiotemporal inconsistencies of classification maps. 3) Adaptive semantic-guided fusion that enhances the accuracy of DSMs and compares them with traditional fusion approaches to show the significance of adaptive methods. 4) A comprehensive analysis of DL stereo matching methods against traditional Census-SGM to obtain detailed knowledge on the accuracy of the DSMs at the stereo matching level. We analyze the overall performance, robustness, and generalization capability, which helps identify the limitations of current DSM generation methods. 5) Based on previous analysis, we develop a novel finetuning strategy to enhance transferability of DL stereo matching methods, hence, the accuracy of DSMs. Our work shows the importance of spatial, temporal, and geometric fusion in enhancing RS applications. It shows that the fusion problem is case-specific and depends on the image type, scene content, and application.

Multi-source Remote Sensing Data Fusion in Human Settlements

Imaging spectrometer image data fusion

The Study on Image Fusion for Medium and High Spatial Resolution Remote Sensing Images

Multi-source remote sensing data fusion: status and trends

The Realistic Fusion of Multi-spectral Images

Multi-source Remote Sensing Image Fusion Based on Support Vector Machine

Multi-Spectral and Panchromatic Image Fusion Based on His-Wavelet Transform and Mopso Algorithm

Multisource and Multitemporal Data Fusion in Remote Sensing.

Spatiotemporal Fusion in Remote Sensing

Image Fusion Techniques in Remote Sensing

Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art

The Research on Comparing and Analyzing the Remote Sensing Image Fusion and Algorithm with High Spectral and Spatial Quality

A review of remote sensing image fusion methods

Image Fusion in Remote Sensing: An Overview and Meta Analysis

Images Fusing In Remote Sensing Mapping

Remote Sensing Image Fusion Based on Fuzzy Theory in Pixel Level and Assessing the Quality of Resulting Images

Spatial, Temporal, and Geometric Fusion for Remote Sensing Images

A Review of Spatiotemporal Super-Resolution Mapping for Remote Sensing Data Fusion

Comparison of Pixel-Based Fusion Between Multi-Spectral Data and High Spatial Resolution Data

Multi-source imagery fusion using deep learning in a cloud computing platform

An Effective Multi-model Fusion Method for SAR and Optical Remote Sensing Images