Abstract:Event cameras are bioinspired visual sensors that capture pixelwise intensity changes and output asynchronous event streams. They show great potential over conventional cameras to handle challenging scenarios in robotics and computer vision, such as high speed and high dynamic range. This article considers the problem of rotational motion estimation using event cameras. Several event-based rotation estimation methods have been developed in the past decade, but their performance has not been evaluated and compared under unified criteria yet. In addition, these prior works do not consider a global refinement step. To this end, we conduct a systematic study of this problem with two objectives in mind: Summarizing previous works and presenting our own solution. First, we compare prior works both theoretically and experimentally. Second, we propose the first event-based rotation-only bundle adjustment (BA) approach. We formulate it leveraging the state-of-the-art contrast maximization (CMax) framework, which is principled and avoids the need to convert events into frames. Third, we use the proposed BA to build CMax-simultaneous localization and mapping (SLAM), the first event-based rotation-only SLAM system comprising a front-end and a back-end. Our BA is able to run both offline (trajectory smoothing) and online (CMax-SLAM back-end). To demonstrate the performance and versatility of our method, we present comprehensive experiments on synthetic and real-world datasets, including indoor, outdoor, and space scenarios. We discuss the pitfalls of real-world evaluation and propose a proxy for the reprojection error as the figure of merit to evaluate event-based rotation BA methods. We release the source code and novel data sequences to benefit the community. We hope this work leads to a better understanding and fosters further research on event-based egomotion estimation.

Globally Optimal Contrast Maximisation for Event-based Motion Estimation

Globally-Optimal Event Camera Motion Estimation

Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimation

A Motion Estimation Algorithm for Mobile Video Communications

Globally Optimal Consensus Maximization for Robust Visual Inertial Localization in Point and Line Map.

Fast elastic motion estimation with improved Levenberg-Marquardt optimization

CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximization

Secrets of Edge-Informed Contrast Maximization for Event-Based Vision

Progressive Spatio-Temporal Alignment for Efficient Event-Based Motion Estimation

Spatiotemporal Registration for Event-based Visual Odometry

Asynchronous Optimisation for Event-based Visual Odometry.

Robust Camera Motion Estimation in Video Sequences

Contrast Maximization-Based Feature Tracking for Visual Odometry with an Event Camera

Optimization of Fast Block Motion Estimation Algorithms

Visual Odometry with an Event Camera Using Continuous Ray Warping and Volumetric Contrast Maximization

Active Event Alignment for Monocular Distance Estimation

Accuracy and Speed Improvement of Event Camera Motion Estimation Using a Bird’s-Eye View Transformation

AsynEVO: Asynchronous Event-Driven Visual Odometry for Pure Event Streams

An efficient and fast global motion estimation algorithm based on motion vector field

Density Invariant Contrast Maximization for Neuromorphic Earth Observations