Abstract:Deep learning has shown superiority in change detection (CD) tasks, notably the Transformer architecture with its self-attention mechanism, capturing long-range dependencies and outperforming traditional models. This capability provides the Transformer with significant advantages in capturing global-level features of complex changes in objects within high-resolution remote sensing images. Though Transformers are mature in Natural Language Processing (NLP), their application in computer vision, particularly CD tasks, is nascent. Current research on leveraging Transformers for CD reveals limitations, especially under varied lighting and seasonal changes. To address this, we propose VisionTwinNet, a two-stage strategy. First, our Gated EnhanceClearNet, a specially designed deep network reduces image noise and enhances brightness, preserving shadows and correcting color distortions. With its unique gating mechanism, this network can adaptively adjust the importance of features, thereby exhibiting superior performance in various remote sensing image degradation issues. Secondly, we have developed Hybrid Light-Robust CDNet, a hybrid robust lightweight network custom-designed for CD in remote sensing images. This module deeply integrates the advantages of CNN and Transformer and introduces an innovative attention mechanism design, optimizing the key/value dimensions separately, instead of adopting traditional single linear transformations, ensuring efficient detection. Specifically, the LR-Transformer Block employs a lightweight multi-head self-attention mechanism, optimizing computational efficiency while providing richer feature representations. Comparative studies with six CD methods on three public datasets validate VisionTwinNet’s robustness and efficacy. Our approach notably reduces algorithmic complexity and enhances the efficiency of the model.

Research on Non-Destructive Testing of Curtain Wall Hangings Based on Efficient Channel Attention Vision Transformer Network

An Efficient Approach for Guided Wave Structural Monitoring of Switch Rails Via Deep Convolutional Neural Network-Based Transfer Learning

Engagement Detection in Online Learning Based on Pre-trained Vision Transformer and Temporal Convolutional Network

Automatic curtain wall frame detection based on deep learning and cross-modal feature fusion

DHT: Dynamic Vision Transformer Using Hybrid Window Attention for Industrial Defect Images Classification

Improving the Concrete Crack Detection Process via a Hybrid Visual Transformer Algorithm

Curtain wall frame segmentation using a dual-flow aggregation network: Application to robot pose estimation

Network Intrusion Detection Based on Feature Image and Deformable Vision Transformer Classification

VisionTwinNet: Gated Clarity Enhancement Paired With Light-Robust CD Transformers

Image segmentation using Vision Transformer for tunnel defect assessment

Bridging Convolutional Neural Networks and Transformers for Efficient Crack Detection in Concrete Building Structures

DAT++: Spatially Dynamic Vision Transformer with Deformable Attention

High-Resolution Vision Transformers for Pixel-Level Identification of Structural Components and Damage

A novel transformer-based semantic segmentation framework for structural condition assessment

Vision transformer-based autonomous crack detection on asphalt and concrete surfaces

Automatic Pavement Crack Detection Transformer Based on Convolutional and Sequential Feature Fusion

Automatic segmentation of curtain wall frame using a context collaboration pyramid network

ETDNet: Efficient Transformer-Based Detection Network for Surface Defect Detection

Pavement crack detection with hybrid-window attentive vision transformers

A Detection and Classification Method of Asphalt Pavement Crack based on Vision Transformer

Defect-aware transformer network for intelligent visual surface defect detection