Abstract:As technology evolves, the cost of 3D scanners is falling, which makes 3D computer vision for industrial applications increasingly popular. More and more researchers have started to study 3D computer vision. Point cloud feature descriptors are a fundamental task in 3D computer vision, and descriptors that use spatial features tend to perform better than those without them. Point cloud descriptors can generally be divided into local reference frames-based (LRF-based) and local reference frames-free (LRF-free). The former uses LRFs to provide spatial features to the descriptors, while the latter uses point pair features to provide spatial features. However, the performance of those LRF-based descriptors is more affected by local reference frames (LRFs), and the descriptors with spatial information LRF-free tend to be more computationally intensive because of its point pair combination strategy. Therefore, we propose a strategy named Multi-scale Point Pair Combination Strategy (MSPPCS) that reduces the computation of point pair-based feature descriptors by nearly 70%$$\%$$ while ensuring that the performance of the descriptor is almost unaffected. We also propose a new descriptor, Spatial Feature Point Pair Histograms (SFPPH), which has excellent performance and robustness due to the diverse spatial features used. We critically evaluate the performance of our descriptor on the Bologna dataset, Kinect dataset, and UWA dataset. The experimental results show that our descriptor is the most robust and performing point cloud feature descriptor.

Enhanced point descriptors for dense stereo matching

Enhanced point descriptors

A Speeded-Up Local Descriptor for dense stereo matching

Learning Local Event-based Descriptor for Patch-based Stereo Matching

A Two-Layer Descriptor and Two-Step Matching for Stereoscopic Images

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Improved Polar Complex Exponential Transform for Robust Local Image Description

Low-dimension Local Descriptor for Dense Stereo Matching and Scene Reconstruction

An improved point feature-based sparse stereo vision

Hybrid stereo matching by dynamic programming with enhanced cost entry for real-time depth generation

Rank-Based Encoding Features for Stereo Matching

Feature Based Stereo Matching Using Two-Step Expansion

Dense stereo matching based on edge constraint and variable windows

Area-based stereo matching based on SIFT feature guidance

A method of window and edge selection for color stereo images

Dense Stereo Correspondence with Contrast Context Histogram, Segmentation-Based Two-Pass Aggregation and Occlusion Handling

P-SURF: A Robust Local Image Descriptor

Embrace descriptors that use point pairs feature

Dense correspondence through descriptor matching

A Local Structural Descriptor for Image Matching Via Normalized Graph Laplacian Embedding

Extend Point Descriptors for Line, Curve and Region Matching