Approaches, Challenges, and Applications for Deep Visual Odometry: Toward Complicated and Emerging Areas
Ke Wang,Sai Ma,Junlan Chen,Fan Ren,Jianbo Lu
DOI: https://doi.org/10.1109/tcds.2020.3038898
IF: 4.546
2022-03-01
IEEE Transactions on Cognitive and Developmental Systems
Abstract:Visual odometry (VO) is a prevalent way to deal with the relative localization problem, which is becoming increasingly mature and accurate, but it tends to be fragile under challenging environments. Comparing with classical geometry-based methods, deep-learning-based methods can automatically learn effective and robust representations, such as depth, optical flow, feature, ego-motion, etc., from data without explicit computation. Nevertheless, there still lacks a thorough review of the recent advances of deep-learning-based VO (Deep VO). Therefore, this article aims to gain a deep insight on how deep learning can profit and optimize the VO systems. We first screen out a number of qualifications, including accuracy, efficiency, scalability, dynamicity, practicability, and extensibility, and employ them as the criteria. Then, using the offered criteria as the uniform measurements, we detailedly evaluate and discuss how deep learning improves the performance of VO from the aspects of depth estimation, feature extraction and matching, and pose estimation. We also summarize the complicated and emerging areas of Deep VO, such as mobile robots, medical robots, augmented and virtual reality, etc. Through the literature decomposition, analysis, and comparison, we finally put forward a number of open issues and raise some future research directions in this field.
robotics,computer science, artificial intelligence,neurosciences