Abstract:The localization of objects is a crucial task in various applications such as robotics, virtual and augmented reality, and the transportation of goods in warehouses. Recent advances in deep learning have enabled the localization using monocular visual cameras. While structure from motion (SfM) predicts the absolute pose from a point cloud, absolute pose regression (APR) methods learn a semantic understanding of the environment through neural networks. However, both fields face challenges caused by the environment such as motion blur, lighting changes, repetitive patterns, and feature-less structures. This study aims to address these challenges by incorporating additional information and regularizing the absolute pose using relative pose regression (RPR) methods. RPR methods suffer under different challenges, i.e., motion blur. The optical flow between consecutive images is computed using the Lucas-Kanade algorithm, and the relative pose is predicted using an auxiliary small recurrent convolutional network. The fusion of absolute and relative poses is a complex task due to the mismatch between the global and local coordinate systems. State-of-the-art methods fusing absolute and relative poses use pose graph optimization (PGO) to regularize the absolute pose predictions using relative poses. In this work, we propose recurrent fusion networks to optimally align absolute and relative pose predictions to improve the absolute pose prediction. We evaluate eight different recurrent units and construct a simulation environment to pre-train the APR and RPR networks for better generalized training. Additionally, we record a large database of different scenarios in a challenging large-scale indoor environment that mimics a warehouse with transportation robots. We conduct hyperparameter searches and experiments to show the effectiveness of our recurrent fusion method compared to PGO.

DFNet: Enhance Absolute Pose Regression with Direct Feature Matching

Direct-PoseNet: Absolute Pose Regression with Photometric Consistency

Neural Refinement for Absolute Pose Regression with Feature Synthesis

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

SDFMAP: Neural Signed Distance Fields for Mapping and Positioning in Real-Time

Absolute Camera Pose Regression Using an RGB-D Dual-Stream Network and Handcrafted Base Poses

A Deep Feature Aggregation Network for Accurate Indoor Camera Localization

Fusing Structure from Motion and Simulation-Augmented Pose Regression from Optical Flow for Challenging Indoor Environments

Map-Relative Pose Regression for Visual Re-Localization

FDC-NeRF: Learning Pose-Free Neural Radiance Fields with Flow-Depth Consistency.

Learning Neural Volumetric Pose Features for Camera Localization

KS-APR: Keyframe Selection for Robust Absolute Pose Regression

Structure-aware neural radiance fields without posed camera

DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Field

Pose-guided Auto-Encoder and Feature-Based Refinement for 6-Dof Object Pose Regression

Local Supports Global: Deep Camera Relocalization With Sequence Enhancement

Camera Relocalization in Shadow-free Neural Radiance Fields

Optimization Algorithm Toward Deep Features Based Camera Pose Estimation

DF-SLAM: Dictionary Factors Representation for High-Fidelity Neural Implicit Dense Visual SLAM System

Camera Pose Auto-Encoders for Improving Pose Regression

Accurate Dynamic SLAM Using CRF-Based Long-Term Consistency