Abstract:SAR image simulation has attracted much attention due to its great potential to supplement the scarce training data for deep learning algorithms. Consequently, evaluating the quality of the simulated SAR image is crucial for practical applications. The current literature primarily uses image quality assessment techniques for evaluation that rely on human observers' perceptions. However, because of the unique imaging mechanism of SAR, these techniques may produce evaluation results that are not entirely valid. The distribution inconsistency between real and simulated data is the main obstacle that influences the utility of simulated SAR images. To this end, we propose a novel trustworthy utility evaluation framework with a counterfactual explanation for simulated SAR images for the first time, denoted as X-Fake. It unifies a probabilistic evaluator and a causal explainer to achieve a trustworthy utility assessment. We construct the evaluator using a probabilistic Bayesian deep model to learn the posterior distribution, conditioned on real data. Quantitatively, the predicted uncertainty of simulated data can reflect the distribution discrepancy. We build the causal explainer with an introspective variational auto-encoder to generate high-resolution counterfactuals. The latent code of IntroVAE is finally optimized with evaluation indicators and prior information to generate the counterfactual explanation, thus revealing the inauthentic details of simulated data explicitly. The proposed framework is validated on four simulated SAR image datasets obtained from electromagnetic models and generative artificial intelligence approaches. The results demonstrate the proposed X-Fake framework outperforms other IQA methods in terms of utility. Furthermore, the results illustrate that the generated counterfactual explanations are trustworthy, and can further improve the data utility in applications.

What problem does this paper attempt to address?

The problems that this paper attempts to solve are: how to evaluate and interpret the quality of simulated SAR (Synthetic Aperture Radar) images and their usability in practical applications. Specifically, existing methods mainly rely on Image Quality Assessment (IQA) techniques based on human visual perception, which are not fully applicable to SAR images because SAR images have a unique imaging mechanism. In addition, the inconsistent distribution between simulated data and real data is a major obstacle affecting the practicality of simulated SAR images. To solve these problems, the authors propose a new credibility evaluation framework called X - Fake. This framework combines a probability evaluator and a causal explainer to achieve credibility evaluation and interpretation of simulated SAR images. The following are the core problems in the paper and their solutions: ### 1. **Evaluating the Quality of Simulated SAR Images** - **Existing Problem**: Traditional IQA methods rely on human visual perception and cannot accurately evaluate the practicality of SAR images. - **Solution**: Construct a Probabilistic Evaluator (P - Eva) based on a Bayesian Deep Convolutional Neural Network (BDCNN) to quantify the distribution differences between simulated SAR images and real data. P - Eva can predict the class labels and azimuth angles of simulated images and estimate their uncertainties. ### 2. **Interpreting the Unreliable Details of Simulated SAR Images** - **Existing Problem**: Even if simulated SAR images have good visual quality, their utility in practical applications is low due to inconsistent distribution. - **Solution**: Introduce a Causal Explainer, which generates Counterfactual Images to explain the unreliable details in simulated SAR images. Specifically, the Causal Explainer uses an Introspective Variational Autoencoder (IntroVAE) to generate high - resolution counterfactual images and reveals the unrealistic details in the simulated data by optimizing the latent code. ### 3. **Unifying Evaluation and Interpretation** - **Existing Problem**: Existing research usually deals with evaluation and interpretation separately and lacks a unified framework. - **Solution**: The X - Fake framework combines evaluation and interpretation, providing a credible and interpretable tool to help users understand the quality of simulated SAR images and point out their deficiencies, thereby improving the practicality of the data. ### Summary The main contribution of the paper is the proposal of the X - Fake framework, which for the first time realizes the quantitative evaluation of simulated SAR images and the interpretation of unreliable details. This framework can not only evaluate the quality of simulated SAR images but also intuitively show the problems in the simulated data by generating counterfactual images, thus providing a basis for improving simulation methods. ### Formula Summary - **P - Eva Output**: \[ m_0 = F_{\text{Bayes}}(x_0)=[y, u_c, v, u_a] \] where \(y\) is the class label, \(u_c\) is the uncertainty of the class, \(v\) is the azimuth angle, and \(u_a\) is the uncertainty of the azimuth angle. - **IntroVAE Pretraining Loss Function**: \[ L_E=\alpha_R L_{KL}(z)+\alpha_E \mathbb{E}_{s = r,pp}[m - L_{KL}(z_s)]^+ + \beta L_{RE}(x, x_r) \] \[ L_G=\alpha_G\sum_{s = r,pp}L_{KL}(z_s)+\beta L_{RE}(x, x_r) \] - **Optimization Objective for Counterfactual Explanation Generation**: \[ L(x)=L_{\text{Entropy}}(x)+L_{\text{prior}}(x)+\lambda_d L_{

X-Fake: Juggling Utility Evaluation and Explanation of Simulated SAR Images

A Trustworthy Counterfactual Explanation Method With Latent Space Smoothing

Uncertainty Exploration: Toward Explainable SAR Target Detection

Explainable Analysis of Deep Learning Methods for SAR Image Classification

You Don't Have to Be Perfect to Be Amazing: Unveil the Utility of Synthetic Images

Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks

Explainable, Physics Aware, Trustworthy AI Paradigm Shift for Synthetic Aperture Radar

Assessing Fidelity in XAI post-hoc techniques: A Comparative Study with Ground Truth Explanations Datasets

Can We Trust Deep Learning Models in SAR ATR?

Measure Utility, Gain Trust: Practical Advice for XAI Researcher

XAI-TRIS: Non-linear image benchmarks to quantify false positive post-hoc attribution of feature importance

Recognition Rate Versus Substitution Rate Curve: An Objective Utility Assessment Criterion of Simulated Training Data

F-Fidelity: A Robust Framework for Faithfulness Evaluation of Explainable AI

Conditional Diffusion for SAR to Optical Image Translation

Fool Me Once? Contrasting Textual and Visual Explanations in a Clinical Decision-Support Setting

Uncertainty in XAI: Human Perception and Modeling Approaches

Improving Object Detection by Modifying Synthetic Data with Explainable AI

A comprehensive study on fidelity metrics for XAI

Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features

Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Survey

A Novel Method using Explainable Artificial Intelligence (XAI)-based Shapley Additive Explanations for Spatial Landslide Prediction using Time-Series SAR dataset