MoCap-less Quantitative Evaluation of Ego-Pose Estimation Without Ground Truth Measurements

Quentin Possamaï,Steeven Janny,Guillaume Bono,Madiha Nadri,Laurent Bako,Christian Wolf

DOI: https://doi.org/10.48550/arXiv.2202.00403

2022-02-01

Abstract:The emergence of data-driven approaches for control and planning in robotics have highlighted the need for developing experimental robotic platforms for data collection. However, their implementation is often complex and expensive, in particular for flying and terrestrial robots where the precise estimation of the position requires motion capture devices (MoCap) or Lidar. In order to simplify the use of a robotic platform dedicated to research on a wide range of indoor and outdoor environments, we present a data validation tool for ego-pose estimation that does not require any equipment other than the on-board camera. The method and tool allow a rapid, visual and quantitative evaluation of the quality of ego-pose sensors and are sensitive to different sources of flaws in the acquisition chain, ranging from desynchronization of the sensor flows to misevaluation of the geometric parameters of the robotic platform. Using computer vision, the information from the sensors is used to calculate the motion of a semantic scene point through its projection to the 2D image space of the on-board camera. The deviations of these keypoints from references created with a semi-automatic tool allow rapid and simple quality assessment of the data collected on the platform. To demonstrate the performance of our method, we evaluate it on two challenging standard UAV datasets as well as one dataset taken from a terrestrial robot.

Robotics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the rapid, visual and quantitative evaluation of vision - based robot ego - pose estimation without ground - truth measurements. Specifically, the paper proposes a method that does not require additional devices (such as motion - capture systems or lidar), and only uses on - board cameras to verify the data quality of ego - pose sensors. This method is particularly suitable for experimental robot platforms widely used in indoor and outdoor environments, and can detect various problems in the data acquisition chain, from sensor stream asynchrony to misestimation of geometric parameters of robot platforms.

The method proposed in the paper uses computer vision techniques to calculate the motion of semantic points in the 2D image space in the scene using sensor information, and then compares them with reference points created by semi - automatic tools, thereby achieving a rapid and simple evaluation of the quality of ego - pose estimation. To demonstrate the effectiveness of the method, the authors evaluated it on two challenging standard UAV datasets and one ground robot dataset.