Abstract:Change detection based on deep learning has made great progress recently, but there are still some challenges, such as the small data size in open-labeled datasets, the different viewpoints in image pairs, and the poor similarity measures in feature pairs. To alleviate these problems, this paper presents a novel change capsule network by taking advantage of a capsule network that can better deal with the different viewpoints and can achieve satisfactory performance with small training data for optical remote sensing image change detection. First, two identical non-shared weight capsule networks are designed to extract the vector-based features of image pairs. Second, the unchanged region reconstruction module is adopted to keep the feature space of the unchanged region more consistent. Third, vector cosine and vector difference are utilized to compare the vector-based features in a capsule network efficiently, which can enlarge the separability between the changed pixels and the unchanged pixels. Finally, a binary change map can be produced by analyzing both the vector cosine and vector difference. From the unchanged region reconstruction module and the vector cosine and vector difference module, the extracted feature pairs in a change capsule network are more comparable and separable. Moreover, to test the effectiveness of the proposed change capsule network in dealing with the different viewpoints in multi-temporal images, we collect a new change detection dataset from a taken-over Al Udeid Air Basee (AUAB) using Google Earth. The results of the experiments carried out on the AUAB dataset show that a change capsule network can better deal with the different viewpoints and can improve the comparability and separability of feature pairs. Furthermore, a comparison of the experimental results carried out on the AUAB dataset and SZTAKI AirChange Benchmark Set demonstrates the effectiveness and superiority of the proposed method.

Change Detection in Remote Sensing Images Based on Image Mapping and a Deep Capsule Network

Change Capsule Network for Optical Remote Sensing Image Change Detection

Pseudo-Siamese Capsule Network for Aerial Remote Sensing Images Change Detection

Synthetic aperture radar image change detection using saliency detection and attention capsule network

An unsupervised heterogeneous change detection method based on image translation network and post-processing algorithm

Change Detection in Heterogeneous Remote Sensing Images Based on the Fusion of Pixel Transformation.

SAR Image Change Detection Based on Multiscale Capsule Network

Change Detection in Heterogeneous Optical and SAR Remote Sensing Images via Deep Homogeneous Feature Fusion

SAR Image Change Detection Via Heterogeneous Graph with Multi-order and Multi-level Connections

Commonality Autoencoder: Learning Common Features for Change Detection From Heterogeneous Images

A domain adaptation neural network for change detection with heterogeneous optical and SAR remote sensing images

A Heterogeneity-Enhancement and Homogeneity-Restraint Network (HEHRNet) for Change Detection from Very High-Resolution Remote Sensing Imagery

Learning Transformations between Heterogeneous SAR and Optical Images for Change Detection.

A Robust Imbalanced SAR Image Change Detection Approach Based on Deep Difference Image and PCANet

Change Detection in Multitemporal SAR Images Based on Slow Feature Analysis Combined with Improving Image Fusion Strategy

Global-Local Collaborative Learning Network for Optical Remote Sensing Image Change Detection

Change Detection in Multi-Temporal SAR Images Based on Slow Feature Analysis Combined With Improving Image Fusion Strategy

Automatic SAR Change Detection Based on Visual Saliency and Multi-Hierarchical Fuzzy Clustering

Change Detection in Multi-temporal VHR Images Based on Deep Siamese Multi-scale Convolutional Networks

A Deep Siamese Network with Hybrid Convolutional Feature Extraction Module for Change Detection Based on Multi-sensor Remote Sensing Images

Change Detection from SAR Images Based on Convolutional Neural Networks Guided by Saliency Enhancement