NN-Copula-CD: A Copula-Guided Interpretable Neural Network for Change Detection in Heterogeneous Remote Sensing Images

Weiming Li,Xueqian Wang,Gang Li,Baocheng Geng,Pramod K. Varshney

2024-09-19

Abstract:Change detection (CD) in heterogeneous remote sensing images has been widely used for disaster monitoring and land-use management. In the past decade, the heterogeneous CD problem has significantly benefited from the development of deep neural networks (DNNs). However, the purely data-driven DNNs perform like a black box where the lack of interpretability limits the trustworthiness and controllability of DNNs in most practical CD applications. As a powerful knowledge-driven tool, copula theory performs well in modeling relationships among random variables. To enhance the interpretability of existing neural networks for CD, we propose a knowledge-data-driven heterogeneous CD method based on a copula-guided neural network, named NN-Copula-CD. In our NN-Copula-CD, the mathematical characteristics of copula are employed as the loss functions to supervise a neural network to learn the dependence between bi-temporal heterogeneous superpixel pairs, and then the changed regions are identified via binary classification based on the degrees of dependence of all the superpixel pairs in the bi-temporal images. We conduct in-depth experiments on three datasets with heterogeneous images, where both quantitative and visual results demonstrate the effectiveness of our proposed NN-Copula-CD method.

Computer Vision and Pattern Recognition,Machine Learning,Image and Video Processing

What problem does this paper attempt to address?

### What problem does this paper attempt to solve?

This paper primarily aims to address the issue of change detection (CD) in heterogeneous remote sensing images. Specifically, the research objectives include the following points:

1. **Improving Interpretability**: Traditional change detection methods based on Deep Neural Networks (DNNs) exhibit a "black box" phenomenon in practical applications, lacking interpretability. Therefore, this paper proposes an interpretable neural network guided by Copula theory (NN-Copula-CD) to enhance the model's interpretability and controllability.

2. **Integrating Data-Driven and Knowledge-Driven Approaches**: By combining data-driven deep learning techniques with knowledge-driven Copula theory, this method can more accurately model the dependencies between time-series images in heterogeneous remote sensing images and identify change areas.

3. **Addressing Heterogeneity Challenges**: Heterogeneous remote sensing images are complex due to different imaging sensors. Traditional algebraic computation methods cannot directly perform pixel-level comparisons. Therefore, the proposed method aims to overcome the challenges brought by such heterogeneity and improve the accuracy of change detection.

In summary, the main contribution of this paper is the proposal of a new semi-supervised heterogeneous change detection method, NN-Copula-CD, which not only improves the interpretability of existing DNN methods but also enhances the robustness of traditional Copula methods when applied to remote sensing data. Experimental results show that this method outperforms commonly used methods on three heterogeneous change detection datasets.