Abstract:In the change detection (CD) task, the UNet architecture has achieved superior results. However, due to the inherent limitation of convolution operations, UNet is inadequate in learning global context and long-range spatial relations. Transformers can capture long-range feature dependencies, but the lack of low-level details may result in limited localization capabilities. Therefore, this article proposes an end-to-end encoding-decoding hybrid transformer model for CD, TransUNetCD, which has the advantages of both transformers and UNet. The model encodes the tokenized image patches from the convolutional neural network (CNN) feature map to extract rich global context information. The decoder upsamples the encoded features, connects them with higher-resolution multiscale features through skip connections to learn local-global semantic features, and restores the full spatial resolution of the feature map to achieve precise localization. The model proposed in this article not only solves the problem that redundant information is generated when extracting low-level features under the UNet framework, but also solves the problem that the relationship between each feature layer cannot be fully modeled and the optimal feature difference representation cannot be obtained. On this basis, we introduce a difference enhancement module to generate a difference feature map containing rich change information. By weighting each pixel and selectively aggregating features, the effectiveness of the network and the accuracy of extracting changing features are improved. The results on multiple datasets demonstrate that, compared to state-of-the-art methods, the TransUNetCD can further reduce false alarms and missed alarms, and the edge of the changing area is more accurate. The model has the highest score in each metric than other baseline models and has a robust generalization ability.

GPR-TransUNet: An improved TransUNet based on self-attention mechanism for ground penetrating radar inversion

TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images

TransUNet-based Inversion Method for Ghost Imaging

GPRInvNet: Deep Learning-Based Ground-Penetrating Radar Data Inversion for Tunnel Linings

DMRF-UNet: A Two-Stage Deep Learning Scheme for GPR Data Inversion under Heterogeneous Soil Conditions

DeTransUnet: attenuation correction of gated cardiac images without structural information

Permittivity Inversion of Ground Penetrating Radar by Attention-Based Deep Learning

Semisupervised Deep Neural Network-Based Cross-Frequency Ground-Penetrating Radar Data Inversion

3DInvNet: A Deep Learning-Based 3D Ground-Penetrating Radar Data Inversion

P-TransUNet: an improved parallel network for medical image segmentation

Automatic identification of GPR targets on roads based on CNN and Grad-CAM

Monte Carlo Full-Waveform Inversion of Cross-Hole Ground-Penetrating Radar Data Based on Improved Residual Network

GPR-based Subsurface Object Detection and Reconstruction Using Random Motion and DepthNet

Real-time dual-parameter full-waveform inversion of GPR data based on robust deep learning

GPR Full-Waveform Inversion through Adaptive Filtering of Model Parameters and Gradients Using CNN

Application of GPR System with Convolutional Neural Network Algorithm Based on Attention Mechanism to Oil Pipeline Leakage Detection

Deep Learning-Based Suppression of Strong Noise in GPR Data for Railway Subgrade Detection

Underground Target Classification From Full-Polarimetric GPR Data Using Deep Convolutional Neural Network With Channel Attention Module

Layered Media Parameter Inversion Method Based on Deconvolution Autoencoder and Self-Attention Mechanism Using GPR Data

GPR detection localization of underground structures based on deep learning and reverse time migration

Deep Learning-Based Network for Underground Dielectric Target Reconstruction