Abstract:Remote sensing (RS) images are characterized by high dimensionality, complex textures, and large scales. Traditional convolutional neural network (CNN) methods may overlook spatial relationships and contextual information among pixels when dealing with RS data. Therefore, graph convolutional networks (GCNs) have emerged as a promising solution. In this article, we propose a contextual spatial awareness remote sensing image change detection network based on the interaction between graphs and convolutions (CSAGC). We aim to enhance the handling of contextual information by introducing multiple augmentation modules. In CSAGC, we propose a high-performance encoder called Congraph that integrates a CNN and a graph neural network (GNN). By preserving the respective features of both branches, we effectively fuse local detailed features and global positional features, achieving superior feature extraction capabilities. Additionally, we design two modules to facilitate the integration of multiscale spatial information: contextual spatial awareness module (CSAM) and spatial integration module (SIM). CSAM, a crucial module connecting the encoder and decoder, jointly explores contextual features using the current feature branch and high-low level feature branches, leveraging spatial positional information for better content acquisition. SIM, located in the decoder module, aims to integrate the multiscale information outputted by CSAM, complementing the contextual information and improving the overall network's ability to capture spatial contextual information. We conducted extensive experiments on three datasets, namely LEVIR-CD, WHU-CD, and GZ-CD. The experimental results demonstrate that CSAGC exhibits excellent performance, achieving significant performance improvements compared to state-of-the-art (SOTA) methods.

Spatial Global Context Attention for Convolutional Neural Networks: an Efficient Method

Spatially-Aware Context Neural Networks.

Context Spatial Awareness Remote Sensing Image Change Detection Network Based on Graph and Convolution Interaction

Spatial Group-wise Enhance: Improving Semantic Feature Learning in Convolutional Networks

Gaussian Context Transformer.

SGCNet: Scale-aware and global contextual network for crowd counting

CSA-Net: Channel-wise Spatially Autocorrelated Attention Networks

SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning

Global Context Encoding For Salient Objects Detection

Multi-Scale Context Attention Network for Image Retrieval.

Latent Graph Attention for Enhanced Spatial Context

A Symmetric Efficient Spatial and Channel Attention (ESCA) Module Based on Convolutional Neural Networks

A Multi-scale Contextual Attention Mechanism for Convolutional Neural Networks

LGCE-Net: a local and global contextual encoding network for effective and efficient medical image segmentation

GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond

HCNet: Hierarchical Context Network for Semantic Segmentation

GCSANet: A Global Context Spatial Attention Deep Learning Network for Remote Sensing Scene Classification

All the attention you need: Global-local, spatial-channel attention for image retrieval

Learning to Predict Context-adaptive Convolution for Semantic Segmentation

Global Attention Mechanism: Retain Information to Enhance Channel-Spatial Interactions

Global contextual guided residual attention network for salient object detection