CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximization

Shuang Guo,Guillermo Gallego

2024-03-13

Abstract:Event cameras are bio-inspired visual sensors that capture pixel-wise intensity changes and output asynchronous event streams. They show great potential over conventional cameras to handle challenging scenarios in robotics and computer vision, such as high-speed and high dynamic range. This paper considers the problem of rotational motion estimation using event cameras. Several event-based rotation estimation methods have been developed in the past decade, but their performance has not been evaluated and compared under unified criteria yet. In addition, these prior works do not consider a global refinement step. To this end, we conduct a systematic study of this problem with two objectives in mind: summarizing previous works and presenting our own solution. First, we compare prior works both theoretically and experimentally. Second, we propose the first event-based rotation-only bundle adjustment (BA) approach. We formulate it leveraging the state-of-the-art Contrast Maximization (CMax) framework, which is principled and avoids the need to convert events into frames. Third, we use the proposed BA to build CMax-SLAM, the first event-based rotation-only SLAM system comprising a front-end and a back-end. Our BA is able to run both offline (trajectory smoothing) and online (CMax-SLAM back-end). To demonstrate the performance and versatility of our method, we present comprehensive experiments on synthetic and real-world datasets, including indoor, outdoor and space scenarios. We discuss the pitfalls of real-world evaluation and propose a proxy for the reprojection error as the figure of merit to evaluate event-based rotation BA methods. We release the source code and novel data sequences to benefit the community. We hope this work leads to a better understanding and fosters further research on event-based ego-motion estimation. Project page: https://github.com/tub-rip/cmax_slam

Robotics,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper primarily addresses the following issues:

1. **Systematic Comparison of Rotational Motion Estimation Methods**:
- A theoretical and experimental comparative study of existing rotational motion estimation methods based on event cameras, aiming to summarize previous work and propose a unified evaluation standard.

2. **Proposing a New Rotational Motion Bundle Adjustment Method**:
- A novel rotational motion Bundle Adjustment (BA) method based on event cameras is proposed to optimize the trajectory of the event camera over continuous time and reconstruct a clear panoramic map.

3. **Building a Rotational SLAM System**:
- Based on the proposed bundle adjustment method, the first rotational SLAM system (CMax-SLAM) based on event cameras is constructed, including both front-end and back-end modules.

4. **Extensive Application Scenario Validation**:
- The effectiveness and generality of the proposed methods are validated in various application scenarios (including indoor, outdoor, and space environments), and potential issues in real-world evaluations are discussed, with reasonable evaluation metrics proposed.

Through these contributions, the paper aims to advance the field of self-motion estimation based on event cameras.