Abstract:Object detection in remote sensing plays a crucial role in various ground identification tasks. However, due to the limited feature information contained within small targets, which are more susceptible to being buried by complex backgrounds, especially in extreme environments (e.g., low-light, motion-blur scenes). Meanwhile, event cameras offer a unique paradigm with high temporal resolution and wide dynamic range for object detection. These advantages enable event cameras without being limited by the intensity of light, to perform better in challenging conditions compared to traditional cameras. In this work, we introduce the Multi-Vision Transformer (MVT), which comprises three efficiently designed components: the downsampling module, the Channel Spatial Attention (CSA) module, and the Global Spatial Attention (GSA) module. This architecture simultaneously considers short-term and long-term dependencies in semantic information, resulting in improved performance for small object detection. Additionally, we propose Cross Deformable Attention (CDA), which progressively fuses high-level and low-level features instead of considering all scales at each layer, thereby reducing the computational complexity of multi-scale features. Nevertheless, due to the scarcity of event camera remote sensing datasets, we provide the Event Object Detection (EOD) dataset, which is the first dataset that includes various extreme scenarios specifically introduced for remote sensing using event cameras. Moreover, we conducted experiments on the EOD dataset and two typical unmanned aerial vehicle remote sensing datasets (VisDrone2019 and UAVDT Dataset). The comprehensive results demonstrate that the proposed MVT-Net achieves a promising and competitive performance.

Voxel-based Multi-scale Transformer Network for Event Stream Processing

Event Voxel Set Transformer for Spatiotemporal Representation Learning on Event Streams

TransVOS: Video Object Segmentation with Transformers

VMV-GCN: Volumetric Multi-View Based Graph CNN for Event Stream Classification

Learning Bottleneck Transformer for Event Image-Voxel Feature Fusion based Classification

Multi-scale Harmonic Mean Time Surfaces for Event-based Object Classification

PVT-SSD: Single-Stage 3D Object Detector with Point-Voxel Transformer

Event-based Video Reconstruction Using Transformer

MVF-Net: A Multi-view Fusion Network for Event-based Object Classification

SpikingViT: a Multi-scale Spiking Vision Transformer Model for Event-based Object Detection

Event Transformer

Point-voxel Dual Stream Transformer for 3d Point Cloud Learning

SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognition

Deep Representation Via Convolutional Neural Network for Classification of Spatiotemporal Event Streams

MsSVT: Mixed-scale Sparse Voxel Transformer for 3D Object Detection on Point Clouds

MTD-MVSNet: Multi-view Stereo Network with Multi-scale Transformer and Dual Attention

Event Stream Super-Resolution Via Spatiotemporal Constraint Learning

MVT: Multi-Vision Transformer for Event-Based Small Target Detection

DSVT: Dynamic Sparse Voxel Transformer with Rotated Sets

Transformer-guided Feature Pyramid Network for Multi-View Stereo

DVST: Deformable Voxel Set Transformer for 3D Object Detection from Point Clouds