Abstract:Registering 3D point clouds with low overlap is challenging in 3D computer vision, primarily due to difficulties in identifying small overlap regions and removing correspondence outliers. We observe that the neighborhood similarity can be utilized to detect point correspondence, and the consistent neighborhood correspondence can be used as a criterion to detect robust overlapping regions. So that a Double-layer Multi-scale Star-graph (DMS) structure is proposed to detect robust correspondences using two different types of multi-scale star-graphs. The first-layer Multi-scale Neighbor Feature Star-graphs (MNFS) takes each point as the center and its multi-scale nearest neighbors as the leaves. The MNFS enables to establish the initial correspondence candidate set between the two point clouds based on multi-scale neighborhood topology and feature similarity. Subsequently, each pair of corresponding points find their nearest neighbors within the correspondence sets to construct a Multi-scale Matching Star-graphs (MMS) on each side, so the mutual correspondence relationships between the MMS vertices are identified. These identified mutual correspondences are treated as vertices to construct the Multi-scale Correspondence Star-graphs (MCS), that indicate the relationships among the correspondences. We design edge weight and vertex weight criterion in MCS to detect only the robust correspondence set that has strong neighborhood consistency, so as to reject the outliers. Finally, the point cloud registration is conducted based on the detected robust correspondence. The experimental results demonstrate clearly that the proposed DMS method exhibits superior robustness when compared to existing state-of-the-art registration algorithms. The code of this study will be available at https://github.com/HualongCao/DMS.

A robust method for multi-view 3D data stitching based on pasted marked points

A New Method for Registration of 3d Point Sets with Low Overlapping Ratios

A Robust Image Stitching Based on Solution Set Smoothing

A Submap Joining Algorithm for 3D Reconstruction Using an RGB-D Camera Based on Point and Plane Features

PM-PM: PatchMatch with Potts Model for Object Segmentation and Stereo Matching.

CNLPA-MVS: Coarse-Hypotheses Guided Non-Local PatchMatch Multi-View Stereo

3D Multi-Angle Point Cloud Stitching Using Iterative Closest-point Stitching and K-Nearest-Neighbors

City-Scale Point Cloud Stitching Using 2D/3D Registration for Large Geographical Coverage

Multi-Viewpoint Panorama Construction with Wide-Baseline Images

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

MP-MVS: Multi-Scale Windows PatchMatch and Planar Prior Multi-View Stereo

Reconstruction of 3D Structural Semantic Points Based on Multiple Camera Views

HQP-MVS:High-Quality Plane Priors Assisted Multi-View Stereo for Low-Textured Areas

High Fidelity Aggregated Planar Prior Assisted PatchMatch Multi-View Stereo

Matching Algorithm for 3D Point Cloud Recognition and Registration Based on Multi-Statistics Histogram Descriptors

Vanishing Point Guided Natural Image Stitching

Comparative analysis of multimodal feature-based 3D point cloud stitching techniques for aeronautic applications

A fast stitching method based on verticality calibration using three marker points

Parallax-Robust Hexahedral Panoramic Video Stitching

DMS: Low-overlap Registration of 3D Point Clouds with Double-layer Multi-scale Star-graph