Abstract:Object pose estimation and camera localization are critical in various applications. However, achieving algorithm universality, which refers to category-level pose estimation and scene-independent camera localization, presents challenges for both techniques. Although the two tasks keep close relationships due to spatial geometry constraints, different tasks require distinct feature extractions. This paper pays attention to a unified RGB-D based framework that simultaneously performs category-level object pose estimation and scene-independent camera localization. The framework consists of a pose estimation branch called SLO-ObjNet, a localization branch called SLO-LocNet, a pose confidence calculation process and object-level optimization. At the start, we obtain the initial camera and object results from SLO-LocNet and SLO-ObjNet. In these two networks, we design there-level feature fusion modules as well as the loss function to achieve feature sharing between two tasks. Then the proposed approach involves a confidence calculation process to determine the accuracy of object poses obtained. Additionally, an object-level Bundle Adjustment (BA) optimization algorithm is further used to improve the precision of these techniques. The BA algorithm establishes relationships among feature points, objects, and cameras with the usage of camera-point, camera-object, and object-point metrics. To evaluate the performance of this approach, experiments are conducted on localization and pose estimation datasets including REAL275, CAMERA25, LineMOD, YCB-Video, 7 Scenes, ScanNet and TUM RGB-D. The results show that this approach outperforms existing methods in terms of both estimation and localization accuracy. Additionally, SLO-LocNet and SLO-ObjNet are trained on ScanNet data and tested on 7 Scenes and TUM RGB-D datasets to demonstrate its universality performance. Finally, we also highlight the positive effects of fusion modules, loss function, confidence process and BA for improving overall performance.

A Robust Approach for Person Localization in Multi-camera Environment

A Robust Localization Approach Using Multi-Sensor Fusion

2-Entity RANSAC for Robust Visual Localization in Changing Environment

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Human Localization in a Cluttered Space Using Multiple Cameras

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

A Robust Tracking Algorithm in Crowded Environment

Robust Multi-Camera 3D People Tracking with Partial Occlusion Handling

Wide-Baseline Multi-Camera Calibration using Person Re-Identification

Auto Calibration of Multi-Camera System for Human Pose Estimation

Geometric constraints of locating cameras and people

A multi-camera approach to tracking and localization of people with coexisting robots

A New Camera Calibration Method for Multi-Camera Localization

Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views

Mean of Means: A 10-dollar Solution for Human Localization with Calibration-free and Unconstrained Camera Settings

Multi-level feature fusion and joint refinement for simultaneous object pose estimation and camera localization

Human Localization Using Multi-Source Heterogeneous Data in Indoor Environments

A Method of Personnel Location Based on Monocular Camera in Complex Terrain.

Robust 3-D Human Detection in Complex Environments With a Depth Camera.