Abstract:Convolutional neural networks (CNNs) have been widely used with its powerful discriminative ability in change detection (CD), but most CNN-based methods are still exploring ways to capture relatively long-range context in spatial-temporal domain. The recent vision transformer (ViT), which is based on the self-attention mechanism, has been applied in CD to model long-range dependencies. However, such transformer-based architectures do not fully consider the potential of interdependencies among the high-level semantic feature maps and easily overlook local detail features, resulting in a noncompact interior of the large-scale change area and missing small changes. Therefore, we propose a new transformer-based hybrid network called interact-feature transformer network with spatial detail enhancement module (IFTSDNet), which takes advantage of transformers to capture long-range context, and of CNNs to extract local information. We design an interact-feature transformer (IFT), which can not only obtain the global contextual information, but also achieve the interactions of high-level semantic feature maps. The spatial detail enhancement module (SDEM) with a group of various receptive fields is built to refine spatial features, which incorporates more discriminative feature representations. Comparative experiments prove the effectiveness of the proposed method, which shows better performance than four recent transformer-based methods. The code will be available at https://github.com/wanglinlin0219/IFTSDNet.

Rethinking CNN Architectures in Transformer Detectors

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

DETR++: Taming Your Multi-Scale Detection Transformer

Anchor DETR: Query Design for Transformer-Based Detector

L-DETR: A Light-Weight Detector for End-to-End Object Detection With Transformers

Investigating the Robustness and Properties of Detection Transformers (DETR) Toward Difficult Images

Towards Data-Efficient Detection Transformers

AugDETR: Improving Multi-scale Learning for Detection Transformer

Rethinking Transformer-based Set Prediction for Object Detection

Hyneter: Hybrid Network Transformer for Object Detection

Conditional DETR V2: Efficient Detection Transformer with Box Queries

Deformable DETR: Deformable Transformers for End-to-End Object Detection

Miti-DETR: Object Detection based on Transformers with Mitigatory Self-Attention Convergence

DA-DETR: Domain Adaptive Detection Transformer with Information Fusion

CNN-transformer mixed model for object detection

Efficient DETR: Improving End-to-End Object Detector with Dense Prior

End-to-End Object Detection with Transformers

Unsupervised Pre-Training for Detection Transformers

End-to-End Object Detection with Adaptive Clustering Transformer

IFTSDNet: An Interact-Feature Transformer Network With Spatial Detail Enhancement Module for Change Detection

HCT-Det: a Hybrid CNN-transformer Architecture for 3D Object Detection from Point Clouds