Ego-motion Estimation for Vehicles with a Rolling Shutter Camera

Yongcong Zhang,Bangyan Liao,Delin Qu,Junde Wu,Xinyu Lu,Wanting Li,Yifei Xue,Yizhen Lao
DOI: https://doi.org/10.1109/TIV.2024.3436703
IF: 8.2
2024-01-01
IEEE Transactions on Intelligent Vehicles
Abstract:Modern automotive vehicles are often equipped with a budget commercial rolling shutter (RS) camera. These devices usually produce distorted images due to the camera's inter-row delay while capturing the image. They will defeat the following computer vision tasks, such as ego-motion estimation. In this paper, we present a closed-form solver for a vehicle-mounted RS camera ego-motion estimation problem with only one point-match between two consecutive distorted RS images, called <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">RS-1pt</b> . To the best of our knowledge, this is the first work to address the ego-motion estimation problem for vehicle-mounted RS cameras specifically. Thanks to the 1pt minimal solver, extensive experiments demonstrate the proposed method surpasses classical global shutter based (GS-based) solvers and existing RS-based solvers by a significant margin in terms of both efficiency and effectiveness. Besides, we synthesize and self-collect three vehicle-mounted RS camera datasets with ground-truth GS images and trajectory, which are absent from the existing works and will be publicly available as a benchmark to the research community.
What problem does this paper attempt to address?