Abstract:Remote sensing (RS) images are important to monitor and survey earth at varying spatial scales. Continuous observations from various RS sources complement single observations to improve applications. Fusion into single or multiple images provides more informative, accurate, complete, and coherent data. Studies intensively investigated spatial-temporal fusion for specific applications like pan-sharpening and spatial-temporal fusion for time-series analysis. Fusion methods can process different images, modalities, and tasks and are expected to be robust and adaptive to various types of images (e.g., spectral images, classification maps, and elevation maps) and scene complexities. This work presents solutions to improve existing fusion methods that process gridded data and consider their type-specific uncertainties. The contributions include: 1) A spatial-temporal filter that addresses spectral heterogeneity of multitemporal images. 2) 3D iterative spatiotemporal filter that enhances spatiotemporal inconsistencies of classification maps. 3) Adaptive semantic-guided fusion that enhances the accuracy of DSMs and compares them with traditional fusion approaches to show the significance of adaptive methods. 4) A comprehensive analysis of DL stereo matching methods against traditional Census-SGM to obtain detailed knowledge on the accuracy of the DSMs at the stereo matching level. We analyze the overall performance, robustness, and generalization capability, which helps identify the limitations of current DSM generation methods. 5) Based on previous analysis, we develop a novel finetuning strategy to enhance transferability of DL stereo matching methods, hence, the accuracy of DSMs. Our work shows the importance of spatial, temporal, and geometric fusion in enhancing RS applications. It shows that the fusion problem is case-specific and depends on the image type, scene content, and application.

Data Fusion of Scanned Black and White Aerial Photographs with Multispectral Satellite Images

Imaging spectrometer image data fusion

The Study on Image Fusion for Medium and High Spatial Resolution Remote Sensing Images

Fusion of Single and Integral Multispectral Aerial Images

Spectral Image Data Fusion for Multisource Data Augmentation

A high-resolution panchromatic-multispectral satellite image fusion method assisted with building segmentation

Multispectral image fusion based on super pixel segmentation

Image Fusion Techniques in Remote Sensing

Image Fusion in Remote Sensing: An Overview and Meta Analysis

A review of remote sensing image fusion methods

Spatial, Temporal, and Geometric Fusion for Remote Sensing Images

Hyperspectral and multispectral image fusion techniques for high resolution applications: a review

Multisource and Multitemporal Data Fusion in Remote Sensing.

Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art

FTDN: Multispectral and Hyperspectral Image Fusion With Diverse Temporal Difference Spans

Multispectral and Panchromatic Image Fusion Based on Improved Bilateral Filter

The Time-SIFT method : detecting 3-D changes from archival photogrammetric analysis with almost exclusively image information

Spatiotemporal Fusion in Remote Sensing

Information Fusion Techniques for Change Detection from Multi-Temporal Remote Sensing Images.

Multitemporal and multispectral data fusion for super-resolution of Sentinel-2 images