Abstract:Event cameras, with their high dynamic range and temporal resolution, are ideally suited for object detection, especially under scenarios with motion blur and challenging lighting conditions. However, while most existing approaches prioritize optimizing spatiotemporal representations with advanced detection backbones and early aggregation functions, the crucial issue of adaptive event sampling remains largely unaddressed. Spiking Neural Networks (SNNs), which operate on an event-driven paradigm through sparse spike communication, emerge as a natural fit for addressing this challenge. In this study, we discover that the neural dynamics of spiking neurons align closely with the behavior of an ideal temporal event sampler. Motivated by this insight, we propose a novel adaptive sampling module that leverages recurrent convolutional SNNs enhanced with temporal memory, facilitating a fully end-to-end learnable framework for event-based detection. Additionally, we introduce Residual Potential Dropout (RPD) and Spike-Aware Training (SAT) to regulate potential distribution and address performance degradation encountered in spike-based sampling modules. Empirical evaluation on neuromorphic detection datasets demonstrates that our approach outperforms existing state-of-the-art spike-based methods with significantly fewer parameters and time steps. For instance, our method yields a 4.4\% mAP improvement on the Gen1 dataset, while requiring 38\% fewer parameters and only three time steps. Moreover, the applicability and effectiveness of our adaptive sampling methodology extend beyond SNNs, as demonstrated through further validation on conventional non-spiking models. Code is available at <a class="link-external link-https" href="https://github.com/Windere/EAS-SNN" rel="external noopener nofollow">this https URL</a>.

Self-regulation: Employing a Generative Adversarial Network to Improve Event Detection.

An enhanced algorithm for object detection based on generative adversarial structure

Event Detection Using a Self-Constructed Dependency and Graph Convolution Network

An Event-Driven Object Recognition Model Using Activated Connected Domain Detection

Exploiting the Ground-Truth: An Adversarial Imitation Based Knowledge Distillation Approach for Event Detection

Event Detection with Neural Networks: A Rigorous Empirical Evaluation

AED-Net: An Abnormal Event Detection Network

EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection.

Adversarial Training for Weakly Supervised Event Detection

Event Detection With Dynamic Word-Trigger-Argument Graph Neural Networks

Improving Event Detection Via Information Sharing Among Related Event Types

Self-supervised enhanced denoising diffusion for anomaly detection

EAS-SNN: End-to-End Adaptive Sampling and Representation for Event-based Detection with Recurrent Spiking Neural Networks

Training Adversarial Discriminators for Cross-channel Abnormal Event Detection in Crowds

Latent Regularized Generative Dual Adversarial Network For Abnormal Detection

Abnormal Event Detection and Localization via Adversarial Event Prediction

Tam-Net: Temporal Enhanced Appearance-To-Motion Generative Network For Video Anomaly Detection

Abnormal Traffic Detection: Traffic Feature Extraction and DAE-GAN With Efficient Data Augmentation

Event Extraction Via Dynamic Multi-Pooling Convolutional Neural Networks.

Generative adversarial networks for detecting contamination events in water distribution systems using multi-parameter, multi-site water quality monitoring

A low-frequency adversarial attack method for object detection using generative model