Abstract:Camera localisation is an essential task in the field of computer vision. The objective is to determine the precise position and orientation of one newly introduced camera station based on a collection of control images that are geographically referenced. Traditional feature-based approaches have been found to face difficulties when confronted with the task of localising images that exhibit significant disparities in viewpoint. Modern deep learning approaches, on the contrary, aim to directly regress camera poses from input image content, being holistic to remedy the problem of viewpoint disparities. This paper posits that although deep networks possess the ability to learn robust and invariant visual features, the incorporation of geometry models can provide rigorous constraints in the process of pose estimation. Following the classic structure-from-motion (SfM) pipeline, we propose a PL-Pose framework to perform camera localisation. First, to improve feature correlations for images with large viewpoint disparities, we perform the combination of point and line features based on a deep learning framework and geometric relation of wireframes. Then, a cost function is constructed using the combined point and line features in order to impose constraints on the bundle adjustment process. Finally, the camera pose parameters and 3D points are estimated through an iterative optimisation process. We verify the accuracy of the PL-Pose approach through the utilisation of two datasets, that is, the publicly available S3DIS dataset and the self-collected dataset CUMTB_Campus. The experimental results demonstrate that in both indoor and outdoor scenes, our PL-Pose method can achieve localisation errors of less than 1 m for 82% of the test points. In contrast, the other four comparison methods yield a best result of merely 72%. Meanwhile, the PL-Pose method can successfully obtain the camera pose parameters in all the scenes with small or large viewpoint disparities, indicating its good stability and adaptability.

Exploring Matching Rates: from Keypoint Selection to Camera Relocalization

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Long-Term Map-Based Visual Localization: Analysis of Individual Components of a Hierarchical Pipeline

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Keyframe-Based Camera Relocalization Method Using Landmark and Keypoint Matching

An End-to-end Learning Framework for Visual Camera Relocalization Using RGB and RGB-D Images

Regression-Based Camera Pose Estimation through Multi-Level Local Features and Global Features

DDM-NET: End-to-end learning of keypoint feature Detection, Description and Matching for 3D localization

Local Optimized and Scalable Frame-to-model SLAM

Local Supports Global: Deep Camera Relocalization With Sequence Enhancement

PL‐Pose: Robust Camera Localisation Based on Combined Point and Line Features Using Control Images

Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization

SRPose: Two-view Relative Pose Estimation with Sparse Keypoints

EP2P-Loc: End-to-End 3D Point to 2D Pixel Localization for Large-Scale Visual Localization

Joint Representation Learning and Keypoint Detection for Cross-View Geo-Localization

Learning Camera Localization via Dense Scene Matching

PixSelect: Less but Reliable Pixels for Accurate and Efficient Localization

HGSLoc: 3DGS-based Heuristic Camera Pose Refinement

Scene Coordinate Regression with Angle-Based Reprojection Loss for Camera Relocalization

Multi-level feature fusion and joint refinement for simultaneous object pose estimation and camera localization

High-Precision Camera Localization in Scenes with Repetitive Patterns