Abstract:Change detection is a process of identifying changed ground objects by comparing image pairs obtained at different times. Compared with the pixel-level and object-level change detection, scene-level change detection can provide the semantic changes at image level, so it is important for many applications related to change descriptions and explanations such as urban functional area change monitoring. Automatic scene-level change detection approaches do not require ground truth used for training, making them more appealing in practical applications than nonautomatic methods. However, the existing automatic scene-level change detection methods only utilize low-level and mid-level features to extract changes between bitemporal images, failing to fully exploit the deep information. This article proposed a novel automatic binary scene-level change detection approach based on deep learning to address these issues. First, the pretrained VGG-16 and change vector analysis are adopted for scene-level direct predetection to produce a scene-level pseudo-change map. Second, pixel-level classification is implemented by using decision tree, and a pixel-level to scene-level conversion strategy is designed to generate the other scene-level pseudo-change map. Third, the scene-level training samples are obtained by fusing the two pseudo-change maps. Finally, the binary scene-level change map is produced by training a novel scene change detection triplet network (SCDTN). The proposed SCDTN integrates a late-fusion subnetwork and an early fusion subnetwork, comprehensively mining the deep information in each raw image as well as the temporal correlation between two raw images. Experiments were performed on a public dataset and a new challenging dataset, and the results demonstrated the effectiveness and superiority of the proposed approach

Detecting Abrupt Scene Change Using Neural Network

Video Dynamics Detection Using Deep Neural Networks

Spatio-Temporal Neural Network with Dilated Retrospective Convolution for Short-Time Change Detection

A Novel Scene Change Detection Algorithm for H.264/AVC Bitstreams

Learning to Detect Instantaneous Changes with Retrospective Convolution and Static Sample Synthesis.

Scene Change Detection by Differential Aggregation Network and Class Probability-Based Fusion Strategy

Video Scene Segmentation Using Sequential Change Detection

Automatic Urban Scene-Level Binary Change Detection Based on a Novel Sample Selection Approach and Advanced Triplet Neural Network

Dense Optical Flow based Change Detection Network Robust to Difference of Camera Viewpoints

Zero-Shot Scene Change Detection

Retrospective Convolution and Static Sample Synthesis for Instantaneous Change Detection

Video Segmentation Based On Sequential Change Detection

The Detection of Unusual Events in Video Based on Bayesian Surprise Model

Learning A Transferable Change Detection Method By Recurrent Neural Network

An Effective Error Concealment Method Based on Abrupt Scene Change Detection Algorithm

Scene Change aware Inter-Frame Forgeries Detection Technique for Surveillance Videos Based on Similarities Analysis

Automatic Change-Point Detection in Time Series via Deep Learning

A Mid-Level Scene Change Representation Via Audiovisual Alignment

Real-Time Abnormal Event Detection in Complicated Scenes

Robust Scene Change Detection Using Visual Foundation Models and Cross-Attention Mechanisms

Adaptive Spatial and Difference Learning for Change Detection