Abstract:Accurate 6DoF (degrees of freedom) pose and focal length estimation are important in extended reality (XR) applications, enabling precise object alignment and projection scaling, thereby enhancing user experiences. This study focuses on improving 6DoF pose estimation using single RGB images of unknown camera metadata. Estimating the 6DoF pose and focal length from an uncontrolled RGB image, obtained from the internet, is challenging because it often lacks crucial metadata. Existing methods such as FocalPose and Focalpose++ have made progress in this domain but still face challenges due to the projection scale ambiguity between the translation of an object along the z-axis (tz) and the camera's focal length. To overcome this, we propose a two-stage strategy that decouples the projection scaling ambiguity in the estimation of z-axis translation and focal length. In the first stage, tz is set arbitrarily, and we predict all the other pose parameters and focal length relative to the fixed tz. In the second stage, we predict the true value of tz while scaling the focal length based on the tz update. The proposed two-stage method reduces projection scale ambiguity in RGB images and improves pose estimation accuracy. The iterative update rules constrained to the first stage and tailored loss functions including Huber loss in the second stage enhance the accuracy in both 6DoF pose and focal length estimation. Experimental results using benchmark datasets show significant improvements in terms of median rotation and translation errors, as well as better projection accuracy compared to the existing state-of-the-art methods. In an evaluation across the Pix3D datasets (chair, sofa, table, and bed), the proposed two-stage method improves projection accuracy by approximately 7.19%. Additionally, the incorporation of Huber loss resulted in a significant reduction in translation and focal length errors by 20.27% and 6.65%, respectively, in comparison to the Focalpose++ method.

A large depth-of-field virtual measurement network for non-cooperative 6DOF pose estimation in occlusion scenes

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Improve the Estimation of Monocular Vision 6-DOF Pose Based on the Fusion of Camera and Laser Rangefinder

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

6D pose estimation of 3D objects in scenes with mutual similarities and occlusions

6DoF Object Pose and Focal Length Estimation from Single RGB Images in Uncontrolled Environments

A Method for Unseen Object Six Degrees of Freedom Pose Estimation Based on Segment Anything Model and Hybrid Distance Optimization

Real-time Image-based 6-DOF Localization in Large-Scale Environments

Relative Pose Estimation of Non-Cooperative Space Targets Using a TOF Camera

Research on 6DOF Pose Measurement Algorithm of Industrial Metal Workpiece Based on Binocular Vision

A novel robotic 6DOF pose measurement strategy for large-size casts based on stereo vision

Virtual Stereovision Pose Measurement of Noncooperative Space Targets for a Dual-Arm Space Robot

An Efficient Virtual Stereo-vision Measurement Method of a Space Non-cooperative Target

Multi-Camera-Based Universal Measurement Method for 6-DOF of Rigid Bodies in World Coordinate System

A 6DOF pose measurement method for metal casts object based on stereo vision sensor

img2pose: Face Alignment and Detection via 6DoF, Face Pose Estimation

OmniSLAM: Omnidirectional Localization and Dense Mapping for Wide-baseline Multi-camera Systems.

Pose Measurement and Motion Estimation of Space Non-Cooperative Targets Based on Laser Radar and Stereo-Vision Fusion

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion