Abstract:Change detection based on deep learning has made great progress recently, but there are still some challenges, such as the small data size in open-labeled datasets, the different viewpoints in image pairs, and the poor similarity measures in feature pairs. To alleviate these problems, this paper presents a novel change capsule network by taking advantage of a capsule network that can better deal with the different viewpoints and can achieve satisfactory performance with small training data for optical remote sensing image change detection. First, two identical non-shared weight capsule networks are designed to extract the vector-based features of image pairs. Second, the unchanged region reconstruction module is adopted to keep the feature space of the unchanged region more consistent. Third, vector cosine and vector difference are utilized to compare the vector-based features in a capsule network efficiently, which can enlarge the separability between the changed pixels and the unchanged pixels. Finally, a binary change map can be produced by analyzing both the vector cosine and vector difference. From the unchanged region reconstruction module and the vector cosine and vector difference module, the extracted feature pairs in a change capsule network are more comparable and separable. Moreover, to test the effectiveness of the proposed change capsule network in dealing with the different viewpoints in multi-temporal images, we collect a new change detection dataset from a taken-over Al Udeid Air Basee (AUAB) using Google Earth. The results of the experiments carried out on the AUAB dataset show that a change capsule network can better deal with the different viewpoints and can improve the comparability and separability of feature pairs. Furthermore, a comparison of the experimental results carried out on the AUAB dataset and SZTAKI AirChange Benchmark Set demonstrates the effectiveness and superiority of the proposed method.

Dense Optical Flow based Change Detection Network Robust to Difference of Camera Viewpoints

A Dense Optical Flow Registration Algorithm Based on Deep Learning

An Efficient Optical Flow Based Motion Detection Method for Non-stationary Scenes

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

Change Capsule Network for Optical Remote Sensing Image Change Detection

Optical Remote Sensing Image Change Detection Based on Attention Mechanism and Image Difference

Robust Scene Change Detection Using Visual Foundation Models and Cross-Attention Mechanisms

Optical Flow Based Real-time Moving Object Detection in Unconstrained Scenes.

DCFF-Net: A Densely Connected Feature Fusion Network for Change Detection in High-Resolution Remote Sensing Images

Spatio-Temporal Neural Network with Dilated Retrospective Convolution for Short-Time Change Detection

Change detection with various combinations of fluid pyramid integration networks.

Dense Continuous-Time Optical Flow from Event Cameras

Compressive Change Retrieval for Moving Object Detection

An effective motion object detection method using optical flow estimation under a moving camera

Retrospective Convolution and Static Sample Synthesis for Instantaneous Change Detection

Change detection with absolute difference of multiscale deep features

Scene Change Detection VIA Deep Convolution Canonical Correlation Analysis Neural Network

DiffPoseNet: Direct Differentiable Camera Pose Estimation

Scene Change Detection by Differential Aggregation Network and Class Probability-Based Fusion Strategy

Change Detection in Multitemporal Monitoring Images under Low Illumination.

Dense Continuous-Time Optical Flow from Events and Frames