Abstract:Deep learning has shown superiority in change detection (CD) tasks, notably the Transformer architecture with its self-attention mechanism, capturing long-range dependencies and outperforming traditional models. This capability provides the Transformer with significant advantages in capturing global-level features of complex changes in objects within high-resolution remote sensing images. Though Transformers are mature in Natural Language Processing (NLP), their application in computer vision, particularly CD tasks, is nascent. Current research on leveraging Transformers for CD reveals limitations, especially under varied lighting and seasonal changes. To address this, we propose VisionTwinNet, a two-stage strategy. First, our Gated EnhanceClearNet, a specially designed deep network reduces image noise and enhances brightness, preserving shadows and correcting color distortions. With its unique gating mechanism, this network can adaptively adjust the importance of features, thereby exhibiting superior performance in various remote sensing image degradation issues. Secondly, we have developed Hybrid Light-Robust CDNet, a hybrid robust lightweight network custom-designed for CD in remote sensing images. This module deeply integrates the advantages of CNN and Transformer and introduces an innovative attention mechanism design, optimizing the key/value dimensions separately, instead of adopting traditional single linear transformations, ensuring efficient detection. Specifically, the LR-Transformer Block employs a lightweight multi-head self-attention mechanism, optimizing computational efficiency while providing richer feature representations. Comparative studies with six CD methods on three public datasets validate VisionTwinNet’s robustness and efficacy. Our approach notably reduces algorithmic complexity and enhances the efficiency of the model.

Predicting VCSEL Emission Properties Using Transformer Neural Networks

Prognostic significance of cystoscopy findings following neoadjuvant chemotherapy for muscle-invasive bladder cancer.

Simulating the Spiking Response of VCSEL-based Optical Spiking Neuron

POViT: Vision Transformer for Multi-Objective Design and Characterization of Photonic Crystal Nanocavities

POViT: Vision Transformer for Multi-objective Design and Characterization of Nanophotonic Devices

Enhanced Prediction of Transformers Vibrations under Complex Operating Conditions

ViT-LCA: A Neuromorphic Approach for Vision Transformers

Deep learning with coherent VCSEL neural networks

Degradation Prediction of Semiconductor Lasers Using Conditional Variational Autoencoder

Proposal and detailed theoretical analysis on a photonic neural network with optically pumped Spin-VCSEL spiking neurons

Wireless Vibration Signal Prediction of Power Transformers Based on Contrastive Adversarial Sparse Model

Extracting thin film structures of energy materials using transformers

High-Speed Time Series Prediction with a GHz-rate Photonic Spiking Neural Network built with a single VCSEL

Transformer Fault Prognosis Using Deep Recurrent Neural Network Over Vibration Signals

GHz Rate Neuromorphic Photonic Spiking Neural Network with a Single Vertical-Cavity Surface-Emitting Laser (VCSEL)

Physics‐informed surrogates for electromagnetic dynamics using Transformers and graph neural networks

Enhanced bi-LSTM for Modeling Nonlinear Amplification Dynamics of Ultra-Short Optical Pulses

High-Fidelity Prediction of Megapixel Longitudinal Phase-Space Images of Electron Beams Using Encoder-Decoder Neural Networks

Vertical Cavity Surface Emitting Laser Performance Maturing through Machine Learning for High-Yield Optical Wireless Network

VisionTwinNet: Gated Clarity Enhancement Paired With Light-Robust CD Transformers

Next-ViT: Next Generation Vision Transformer for Efficient Deployment in Realistic Industrial Scenarios