Abstract:In this paper we propose an edge-direct visual odometry algorithm that efficiently utilizes edge pixels to find the relative pose that minimizes the photometric error between images. Prior work on exploiting edge pixels instead treats edges as features and employ various techniques to match edge lines or pixels, which adds unnecessary complexity. Direct methods typically operate on all pixel intensities, which proves to be highly redundant. In contrast our method builds on direct visual odometry methods naturally with minimal added computation. It is not only more efficient than direct dense methods since we iterate with a fraction of the pixels, but also more accurate. We achieve high accuracy and efficiency by extracting edges from only one image, and utilize robust Gauss-Newton to minimize the photometric error of these edge pixels. This simultaneously finds the edge pixels in the reference image, as well as the relative camera pose that minimizes the photometric error. We test various edge detectors, including learned edges, and determine that the optimal edge detector for this method is the Canny edge detection algorithm using automatic thresholding. We highlight key differences between our edge direct method and direct dense methods, in particular how higher levels of image pyramids can lead to significant aliasing effects and result in incorrect solution convergence. We show experimentally that reducing the photometric error of edge pixels also reduces the photometric error of all pixels, and we show through an ablation study the increase in accuracy obtained by optimizing edge pixels only. We evaluate our method on the RGB-D TUM benchmark on which we achieve state-of-the-art performance.

Bi-direction Direct RGB-D Visual Odometry

RBD-EVIO: Optimized Event-Based Visual-Inertial Odometry for a Large Field of View with a Rotated Binary DART Descriptor.

Bi-objective Optimization for Robust RGB-D Visual Odometry

Design of an Enhanced Visual Odometry by Building and Matching Compressive Panoramic Landmarks Online

Robust visual odometry based on front and back cameras

Feature Regions Segmentation Based RGB-D Visual Odometry in Dynamic Environment

Edge-Direct Visual Odometry

EdgeVO: An Efficient and Accurate Edge-based Visual Odometry

Direct RGB-D visual odometry with point features

Image Gradient-based Joint Direct Visual Odometry for Stereo Camera

RGB-D Inertial Odometry for Indoor Robot via Keyframe-based Nonlinear Optimization

R2DIO: A Robust and Real-Time Depth-Inertial Odometry Leveraging Multimodal Constraints for Challenging Environments

Direct Visual-Inertial Odometry with Semi-Dense Mapping

PVI-DSO: Leveraging Planar Regularities for Direct Sparse Visual-Inertial Odometry

Visual Odometry Estimation Algorithm Based on RGB-D

Accumulative Errors Optimization for Visual Odometry of ORB-SLAM2 Based on RGB-D Cameras

Enhancing Visual Odometry with Estimated Scene Depth: Leveraging RGB-D Data with Deep Learning

M-DIVO: Multiple ToF RGB-D Cameras Enhanced Depth-Inertial-Visual Odometry

DVIO: Depth aided visual inertial odometry for RGBD sensors

R-SDSO: Robust Stereo Direct Sparse Odometry

RGB-D Inertial Odometry for a Resource-Restricted Robot in Dynamic Environments