Abstract:Spatiotemporal data fusion, as a feasible and low-cost solution for producing time-series satellite images with both high spatial and temporal resolution, has undergone rapid development over the past two decades with more than one hundred spatiotemporal fusion methods developed. Accuracy assessment of fused images is crucial for users to select appropriate methods for real-world applications. However, commonly used assessment metrics do not comprehensively cover multiple aspects of spatiotemporal fused image quality, contain redundant information, and are not comparable across different study areas. To address these problems, this study proposed a novel framework to assess all-round performances of spatiotemporal fusion methods. Four accuracy metrics, including RMSE, AD, Edge, and local binary patterns (LBP), were selected as the optimal set of assessment metrics according to the assessment criteria. These metrics not only quantify the spectral and spatial information in the fused images but also greatly alleviate information redundancy and feature computational simplicity. Furthermore, inspired by Taylor diagrams, we designed an all-round performance assessment (APA) diagram to provide a visual tool for a comprehensive assessment of the performance of spatiotemporal fusion methods, supporting cross-comparison of different spatiotemporal fusion methods by considering the effects of input data and land surface characteristics. The case study in three typical sites demonstrated that the proposed framework can better differentiate the performances of six spatiotemporal fusion methods. This new framework can promote the cross-comparison of different spatiotemporal fusion methods and guide users to select suitable methods for real-world applications, as well as facilitate the establishment of a standard accuracy assessment procedure for spatiotemporal fusion methods.

Novel and Better Performance Evaluation Algorithm for Image Fusion Based on Medium Truth Scale

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Similarity-Based Objective Measure for Performance of Image Fusion

Video fusion performance evaluation based on structural similarity and human visual perception

Novel Multi-Resolution Image Fusion Algorithm Based on Kalman Filtering

Novel Image Fusion Algorithm with Novel Performance Evaluation Method

Objective Image Fusion Quality Evaluation Using Structural Similarity

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Fast quantitative correlation analysis and information deviation analysis for evaluating the performances of image fusion techniques

The Realistic Fusion of Multi-spectral Images

Hyperspectral Image Quality Evaluation Based On Multi-Model Fusion

A New Wavelet Image Fusion Algorithm Based on Human Visual System

The Study of Methods of Quantitative Evaluation on Remote Sensing Image Fusion and Actualization

Objective image fusion evaluation method for target recognition based on target quality factor

A Novel Metric Approach Evaluation For The Spatial Enhancement Of Pan-Sharpened Images

Rethinking the Effectiveness of Objective Evaluation Metrics in Multi-focus Image Fusion: A Statistic-based Approach

Pixel Level Image Fusion Methods and Fusion Performance Evaluation

Image Quality Assessment Based on Three Features Fusion in Three Fusion Steps

A Comprehensive Performance Evaluation of Image Quality Assessment Algorithms

Comprehensive Evaluation for Fused Images of Multispectral and Panchromatic Images Based on Entropy Weight Method

A Novel Framework to Assess All-Round Performances of Spatiotemporal Fusion Models