Abstract:Accurate 6DoF (degrees of freedom) pose and focal length estimation are important in extended reality (XR) applications, enabling precise object alignment and projection scaling, thereby enhancing user experiences. This study focuses on improving 6DoF pose estimation using single RGB images of unknown camera metadata. Estimating the 6DoF pose and focal length from an uncontrolled RGB image, obtained from the internet, is challenging because it often lacks crucial metadata. Existing methods such as FocalPose and Focalpose++ have made progress in this domain but still face challenges due to the projection scale ambiguity between the translation of an object along the z-axis (tz) and the camera's focal length. To overcome this, we propose a two-stage strategy that decouples the projection scaling ambiguity in the estimation of z-axis translation and focal length. In the first stage, tz is set arbitrarily, and we predict all the other pose parameters and focal length relative to the fixed tz. In the second stage, we predict the true value of tz while scaling the focal length based on the tz update. The proposed two-stage method reduces projection scale ambiguity in RGB images and improves pose estimation accuracy. The iterative update rules constrained to the first stage and tailored loss functions including Huber loss in the second stage enhance the accuracy in both 6DoF pose and focal length estimation. Experimental results using benchmark datasets show significant improvements in terms of median rotation and translation errors, as well as better projection accuracy compared to the existing state-of-the-art methods. In an evaluation across the Pix3D datasets (chair, sofa, table, and bed), the proposed two-stage method improves projection accuracy by approximately 7.19%. Additionally, the incorporation of Huber loss resulted in a significant reduction in translation and focal length errors by 20.27% and 6.65%, respectively, in comparison to the Focalpose++ method.

6-DOF Image Localization From Massive Geo-Tagged Reference Images.

Fast Estimation of Relative Poses for 6-DOF Image Localization

Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matching

Global Localization: Utilizing Relative Spatio-Temporal Geometric Constraints from Adjacent and Distant Cameras

Deep Convolutional Neural Network for 6-DOF Image Localization

BDLoc: Global Localization from 2.5D Building Map

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

Real-time Image-based 6-DOF Localization in Large-Scale Environments

InLoc: Indoor Visual Localization with Dense Matching and View Synthesis

Relative geometry-aware siamese neural network for 6DOF camera relocalization

A Real-Time Fusion Framework for Long-term Visual Localization

Normalized Localization for 6-DOF Camera Pose Regression

Triangulate Geometric Constraint Combined with Visual-Flow Fusion Network for Accurate 6dof Pose Estimation.

6DoF Object Pose and Focal Length Estimation from Single RGB Images in Uncontrolled Environments

6D Camera Relocalization in Visually Ambiguous Extreme Environments

Accurate sensing of scene geo-context via mobile visual localization

Render-and-Compare: Cross-View 6 DoF Localization from Noisy Prior

FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimation

Estimating 6 DOF pose transformation of a TOF laser camera

Estimating poses of world's photos with geographic metadata

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation.