Abstract:Change detection is a significantly important task in the field of remote sensing and can be widely used in the urban construction planning, disaster survey, resource management, etc. Previous studies have shown that most of the state-of-the-art change detection methods are based on the deep learning networks. However, the problem of change detection still cannot be effectively solved due to the variations in illumination, resolution, quality, scale, location, etc. The robust methods for change detection need to be further investigated. This study aimed to address the insufficient robustness problem of the change detection between the multi-temporal images. The biological mechanism of parallel processing architecture in visual pathways gives us an inspiration to design a sensory framework with multi-sensory pathways. We propose a new framework named multi-sensory pathway network (MSPN). This framework is inspired by the parallel processing mechanism of the human visual information. Specifically, the framework utilizes three diverse but related sensory pathways: sensory pathway-1, sensory pathway-2, and sensory pathway-3. The three sensory pathways of the proposed framework are not simply parallel processing, but with some related connections. The sensory pathway-1 adopts the early fusion strategy to learn the changed information. The sensory pathway-2 uses the middle concatenation strategy to learn the changed information, while the sensory pathway-3 utilizes the middle difference strategy to learn the change information. Two fusion strategies, namely average fusion and maximum fusion, are designed for the framework. The experimental datasets consists of BCDD, LEVIR-CD, and CDD. Four metrics including overall accuracy (OA), precision, recall, and F1 are used to evaluate the competitive algorithms. The primary metric is F1. The proposed method, respectively, achieves the best F1 scores with 84.55%, 88.14%, and 85.11% on the three experimental datasets. The quantitative ablation results show the effectiveness of multi-sensory pathways on the BCDD, LEVIR-CD, and CDD. The qualitative ablation results demonstrate that different sensory pathways perform different perception mechanisms, though they belong to the united framework. The comprehensive results of MSPN-AF on the BCDD and MSPN-MF on the LEVIR-CD and CDD are superior to other methods. The experimental results demonstrate the effectiveness and robustness of the proposed method, both qualitatively and quantitatively. The proposed MSPN can promote the technology exploration of the bionic and explainable neural network.

Bio-inspired Multi-Sensory Pathway Network for Change Detection

CS-HSNet: A Cross-Siamese Change Detection Network Based on Hierarchical-Split Attention

Multilevel Features Fused and Change Information Enhanced Neural Network for Hyperspectral Image Change Detection

Multi-Scale Fusion Siamese Network Based on Three-Branch Attention Mechanism for High-Resolution Remote Sensing Image Change Detection

Global-Local Collaborative Learning Network for Optical Remote Sensing Image Change Detection

A Deep Siamese Network with Hybrid Convolutional Feature Extraction Module for Change Detection Based on Multi-sensor Remote Sensing Images

3M-CDNet-V2: An Efficient Medium-Weight Neural Network for Remote Sensing Image Change Detection

AMFNet: Attention-Guided Multi-Scale Fusion Network for Bi-Temporal Change Detection in Remote Sensing Images

Multiscale Attention Fusion Graph Network for Remote Sensing Building Change Detection

Remote Sensing Change Detection Based on Multidirectional Adaptive Feature Fusion and Perceptual Similarity

Spatial-Temporal Semantic Perception Network for Remote Sensing Image Semantic Change Detection

Multi-scale Attention Fusion Graph Network for Remote Sensing Building Change Detection

Dsfer-Net: A Deep Supervision and Feature Retrieval Network for Bitemporal Change Detection Using Modern Hopfield Networks

SMD-Net: Siamese Multi-Scale Difference-Enhancement Network for Change Detection in Remote Sensing

Deep Multiscale Siamese Network With Parallel Convolutional Structure and Self-Attention for Change Detection

A Self-Attentive Hybrid Coding Network for 3D Change Detection in High-Resolution Optical Stereo Images

Multi-scale Feature Progressive Fusion Network for Remote Sensing Image Change Detection

A Siamese Multiscale Attention Decoding Network for Building Change Detection on High-Resolution Remote Sensing Images

MFDS-Net: Multiscale Feature Depth-Supervised Network for Remote Sensing Change Detection With Global Semantic and Detail Information

Semantic feature-constrained multitask siamese network for building change detection in high-spatial-resolution remote sensing imagery

EfficientCD: A New Strategy For Change Detection Based With Bi-temporal Layers Exchanged