Abstract:Remote sensing image fusion is considered a cost effective method for handling the tradeoff between the spatial, temporal and spectral resolutions of current satellite systems. However, most current fusion methods concentrate on fusing images in two domains among the spatial, temporal and spectral domains, and a few efforts have been made to comprehensively explore the relationships of spatio-temporal–spectral features. In this study, we propose a novel integrated spatio-temporal–spectral fusion framework based on semicoupled sparse tensor factorization to generate synthesized frequent high-spectral and high-spatial resolution images by blending multisource observations. Specifically, the proposed method regards the desired high spatio-temporal–spectral resolution images as a four-dimensional tensor and formulates the integrated fusion problem as the estimation of the core tensor and the dictionary along each mode. The high-spectral correlation across the spectral domain and the high self-similarity (redundancy) features in the spatial and temporal domains are jointly exploited using the low dimensional and sparse core tensors. In addition, assuming that the sparse coefficients in the core tensors across the observed and desired image spaces are not strictly the same, we formulate the estimation of the core tensor and the dictionaries as a semicoupled sparse tensor factorization of available heterogeneous spatial, spectral and temporal remote sensing observations. Finally, the proposed method can exploit the multicomplementary spatial, temporal and spectral information of any combination of remote sensing data based on this single unified model. Experiments on multiple data types, including spatio-spectral, spatio-temporal, and spatio-temporal–spectral data fusion, demonstrate the effectiveness and efficiency of the proposed method.

Imaging spectrometer image data fusion

Multi-Sensor Image Fusion: A Survey of the State of the Art

The Realistic Fusion of Multi-spectral Images

The Study on Image Fusion for Medium and High Spatial Resolution Remote Sensing Images

A Review of Fusion Methods of Multi-Spectral Image

[Application of Data Fusion of Microscopic Spectral Imaging in Reservoir Characterization].

Assessment of the information preservation of data fusion methods based on high spatial resolution remotely sensed imageries

Image Fusion Techniques in Remote Sensing

A review of remote sensing image fusion methods

Study on Panchromatic and Multispectral Image Fusion Based on SFIM and CA Transform

The Tradeoff Analysis for Remote Sensing Image Fusion Using Expanded Spectral Angle Mapper

Real-time multispectral image processing and narrow-band imaging spectrometer

Fusion Of Multispectral And Panchromatic Images Based On Transferable Parameters

<title>Processing of hyperspectral remote sensing images</title>

Study of optic remote sensing image fusion methods

Image Fusion in Remote Sensing: An Overview and Meta Analysis

Multisource and Multitemporal Data Fusion in Remote Sensing.

Practical Image Fusion Method Based on Spectral Mixture Analysis

The Study of Remote Sensing Image Fusion Based on GIHS Transform

Integrated Fusion Framework Based on Semicoupled Sparse Tensor Factorization for Spatio-Temporal-spectral Fusion of Remote Sensing Images.

An Integrated Spatio-Spectral–Temporal Sparse Representation Method for Fusing Remote-Sensing Images with Different Resolutions