Abstract:Spatiotemporal data fusion, as a feasible and low-cost solution for producing time-series satellite images with both high spatial and temporal resolution, has undergone rapid development over the past two decades with more than one hundred spatiotemporal fusion methods developed. Accuracy assessment of fused images is crucial for users to select appropriate methods for real-world applications. However, commonly used assessment metrics do not comprehensively cover multiple aspects of spatiotemporal fused image quality, contain redundant information, and are not comparable across different study areas. To address these problems, this study proposed a novel framework to assess all-round performances of spatiotemporal fusion methods. Four accuracy metrics, including RMSE, AD, Edge, and local binary patterns (LBP), were selected as the optimal set of assessment metrics according to the assessment criteria. These metrics not only quantify the spectral and spatial information in the fused images but also greatly alleviate information redundancy and feature computational simplicity. Furthermore, inspired by Taylor diagrams, we designed an all-round performance assessment (APA) diagram to provide a visual tool for a comprehensive assessment of the performance of spatiotemporal fusion methods, supporting cross-comparison of different spatiotemporal fusion methods by considering the effects of input data and land surface characteristics. The case study in three typical sites demonstrated that the proposed framework can better differentiate the performances of six spatiotemporal fusion methods. This new framework can promote the cross-comparison of different spatiotemporal fusion methods and guide users to select suitable methods for real-world applications, as well as facilitate the establishment of a standard accuracy assessment procedure for spatiotemporal fusion methods.

A fast method to evaluate the performances of image fusion techniques and its error analysis

Fast quantitative correlation analysis and information deviation analysis for evaluating the performances of image fusion techniques

Curvelet Based Hyperspectral Image Fusion

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

The Study of Methods of Quantitative Evaluation on Remote Sensing Image Fusion and Actualization

A new method of Quickbird own image fusion

The Realistic Fusion of Multi-spectral Images

Similarity-Based Objective Measure for Performance of Image Fusion

Comparison of quality evaluation methods for image fusion of farmland remote sensing

Remote Sensing Image Fusion Based on Fuzzy Theory in Pixel Level and Assessing the Quality of Resulting Images

Pixel Level Image Fusion Methods and Fusion Performance Evaluation

A Novel Framework to Assess All-Round Performances of Spatiotemporal Fusion Models

The Statistical methods of Pixel-Based Image Fusion Techniques

Video fusion performance evaluation based on structural similarity and human visual perception

An Image Fusion Algorithm Using Spatial Consistency and Bands Correlation

Improving the Performance of Image Fusion Based on Visual Saliency Weight Map Combined with CNN.

An Optimized Inversion Method for Hyperspectral Image Fusion Based on a Hue–Intensity–Saturation, Wavelet, and Trust-Region Conjugate Gradient Method

Comprehensive Evaluation for Fused Images of Multispectral and Panchromatic Images Based on Entropy Weight Method

A new method for multi-source remote sensing image fusion

Evaluation and analysis of fusion algorithms for active and passive remote sensing image.

Medical image fusion based on quasi-cross bilateral filtering