Abstract:Accurate localization between cameras is a prerequisite for a vision-based heterogeneous robot systems task. The core issue is how to accurately perform place recognition from different view-points. Traditional appearance-based methods have a high probability of failure in place recognition and localization under large view-point changes. In recent years, semantic graph matching-based place recognition methods have been proposed to solve the above problem. However, these methods rely on high-precision semantic segmentation results and have a high time complexity in node extraction or graph matching. In addition, methods only utilize the semantic labels of the landmarks themselves to construct graphs and descriptors, making such approaches fail in some challenging scenarios (e.g., scene repetition). In this paper, we propose a graph-matching method based on a novel landmark topology descriptor, which is robust to view-point changes. According to the experiment on real-world data, our algorithm can run in real-time and is approximately four times and three times faster than state-of-the-art algorithms in the graph extraction and matching phases, respectively. In terms of place recognition performance, our algorithm achieves the best place recognition precision at a recall of 0–70% compared with classic appearance-based algorithms and an advanced graph-based algorithm in the scene of significant view-point changes. In terms of positioning accuracy, compared to the traditional appearance-based DBoW2 and NetVLAD algorithms, our method outperforms by 95%, on average, in terms of the mean translation error and 95% in terms of the mean RMSE. Compared to the state-of-the-art SHM algorithm, our method outperforms by 30%, on average, in terms of the mean translation error and 29% in terms of the mean RMSE. In addition, our method outperforms the current state-of-the-art algorithm, even in challenging scenarios where the benchmark algorithms fail.

3D Human Landmark Detection and Segmentation with Semantic Knowledge

Automatic Location and Semantic Labeling of Landmarks on 3D Human Body Models

Semantic Graph Based Place Recognition for 3D Point Clouds.

Real-Time Human Segmentation Using Pose Skeleton Map

Automatic Detection of Anatomical Landmarks on Geometric Mesh Data Using Deep Semantic Segmentation

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Incorporating Human Domain Knowledge in 3D LiDAR-based Semantic Segmentation.

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

3D Semantic Segmentation Algorithm for Indoor Scenes based on Long-term Memory

Hierarchical Insights: Exploiting Structural Similarities for Reliable 3D Semantic Segmentation

Automatic landmark detection for high resolution non-rigid 3D faces based on geometric information

Automatic X-ray Landmark Detection and Shape Segmentation Via Data-Driven Joint Estimation of Image Displacements.

Deep Patch-based Human Segmentation

Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning

Human Segmentation With Deep Contour-Aware Network

3D Scene Segmentation with a Shape Repository

Landmark Topology Descriptor-Based Place Recognition and Localization under Large View-Point Changes

Human Detection Using Multi-Camera And 3d Scene Knowledge

Robust Facial Landmark Detection for Three-Dimensional Face Segmentation and Alignment

Recent Advances In Segmentation Of 3d Models

A novel 3D object retrieval method based on model segmentation