Abstract:Camera localisation is an essential task in the field of computer vision. The objective is to determine the precise position and orientation of one newly introduced camera station based on a collection of control images that are geographically referenced. Traditional feature-based approaches have been found to face difficulties when confronted with the task of localising images that exhibit significant disparities in viewpoint. Modern deep learning approaches, on the contrary, aim to directly regress camera poses from input image content, being holistic to remedy the problem of viewpoint disparities. This paper posits that although deep networks possess the ability to learn robust and invariant visual features, the incorporation of geometry models can provide rigorous constraints in the process of pose estimation. Following the classic structure-from-motion (SfM) pipeline, we propose a PL-Pose framework to perform camera localisation. First, to improve feature correlations for images with large viewpoint disparities, we perform the combination of point and line features based on a deep learning framework and geometric relation of wireframes. Then, a cost function is constructed using the combined point and line features in order to impose constraints on the bundle adjustment process. Finally, the camera pose parameters and 3D points are estimated through an iterative optimisation process. We verify the accuracy of the PL-Pose approach through the utilisation of two datasets, that is, the publicly available S3DIS dataset and the self-collected dataset CUMTB_Campus. The experimental results demonstrate that in both indoor and outdoor scenes, our PL-Pose method can achieve localisation errors of less than 1 m for 82% of the test points. In contrast, the other four comparison methods yield a best result of merely 72%. Meanwhile, the PL-Pose method can successfully obtain the camera pose parameters in all the scenes with small or large viewpoint disparities, indicating its good stability and adaptability.

Image-Based Camera Localization For Large And Outdoor Environments

Two-Stage Multi-Camera Constrain Mapping Pipeline for Large-Scale 3D Reconstruction

Indoor Visual Positioning Aided by CNN-Based Image Retrieval: Training-Free, 3D Modeling-Free

On Localizing a Camera from a Single Image

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Human Localization in a Cluttered Space Using Multiple Cameras

Structure-guided Camera Localization for Indoor Environments

Image-Based Indoor Localization Using Smartphone Camera.

6D Camera Relocalization in Visually Ambiguous Extreme Environments

Ground Camera Images And Uav 3d Model Registration For Outdoor Augmented Reality

Large-Scale Indoor Camera Positioning Using Fiducial Markers

PL‐Pose: Robust Camera Localisation Based on Combined Point and Line Features Using Control Images

ReLoc: Indoor Visual Localization with Hierarchical Sitemap and View Synthesis

A Critical Analysis of Image-based Camera Pose Estimation Techniques.

EnforceNet: Monocular Camera Localization in Large Scale Indoor Sparse LiDAR Point Cloud

Real-time Image-based 6-DOF Localization in Large-Scale Environments

Automated image localization to support rapid building reconnaissance in a large‐scale area

Convolutional Neural Network-Based Coarse Initial Position Estimation Of A Monocular Camera In Large-Scale 3d Light Detection And Ranging Maps

Large-Scale 3D Semantic Mapping Using Monocular Vision

A Robust Approach for Person Localization in Multi-camera Environment

Visual Localization Using Sparse Semantic 3D Map