Abstract:An event camera is a novel bio-inspired sensor that effectively compensates for the shortcomings of current frame cameras, which include high latency, low dynamic range, motion blur, etc. Rather than capturing images at a fixed frame rate, an event camera produces an asynchronous signal by measuring the brightness change of each pixel. Consequently, an appropriate algorithm framework that can handle the unique data types of event-based vision is required. In this paper, we propose a dynamic object tracking framework using an event camera to achieve long-term stable tracking of event objects. One of the key novel features of our approach is to adopt an adaptive strategy that adjusts the spatiotemporal domain of event data. To achieve this, we reconstruct event images from high-speed asynchronous streaming data via online learning. Additionally, we apply the Siamese network to extract features from event data. In contrast to earlier models that only extract hand-crafted features, our method provides powerful feature description and a more flexible reconstruction strategy for event data. We assess our algorithm in three challenging scenarios: 6-DoF (six degrees of freedom), translation, and rotation. Unlike fixed cameras in traditional object tracking tasks, all three tracking scenarios involve the simultaneous violent rotation and shaking of both the camera and objects. Results from extensive experiments suggest that our proposed approach achieves superior accuracy and robustness compared to other state-of-the-art methods. Without reducing time efficiency, our novel method exhibits a 30% increase in accuracy over other recent models. Furthermore, results indicate that event cameras are capable of robust object tracking, which is a task that conventional cameras cannot adequately perform, especially for super-fast motion tracking and challenging lighting situations.

Temporal Up-Sampling for Asynchronous Events

Asynchronous "Events" are Better For Motion Estimation

A Review of Image Reconstruction Based on Event Cameras

Graph-based Asynchronous Event Processing for Rapid Object Recognition

Temporal-Mapping Photography for Event Cameras

Asynchronous Event Feature Generation and Tracking Based on Gradient Descriptor for Event Cameras

Globally-Optimal Event Camera Motion Estimation

Better and Faster: Adaptive Event Conversion for Event-Based Object Detection.

Asynchronous Spatio-Temporal Memory Network for Continuous Event-Based Object Detection

EVtracker: An Event-Driven Spatiotemporal Method for Dynamic Object Tracking

Event Stream Super-Resolution Via Spatiotemporal Constraint Learning

AsynEVO: Asynchronous Event-Driven Visual Odometry for Pure Event Streams

EventHDR: from Event to High-Speed HDR Videos and Beyond

Temporal Upsampling of Depth Maps Using a Hybrid Camera

Event Camera Denoising Using Asynchronous Spatio-Temporal Event Denoising Neural Network

High-speed Video Generation with an Event Camera

EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Dataset

Event Enhanced High-Quality Image Recovery

Backlight and dim space object detection based on a novel event camera

Adaptive spatio-temporal clustering for small object detection using event-based camera

E-detector: Asynchronous Spatio-temporal for Event-based Object Detection in Intelligent Transportation System