Abstract:—Distortion quantiﬁcation of point clouds plays a stealth, yet vital role in a wide range of human and machine perception tasks. For human perception tasks, a distortion quantiﬁcation can substitute subjective experiments to guide 3D visualization; while for machine perception tasks, a distortion quantiﬁcation can work as a loss function to guide the training of deep neural networks for unsupervised learning tasks. To handle a variety of demands in many applications, a distortion quantiﬁcation needs to be distortion discriminable, differentiable, and have a low computational complexity. Currently, however, there is a lack of a general distortion quantiﬁcation that can satisfy all three conditions. To ﬁll this gap, this work proposes multiscale potential energy discrepancy (MPED), a distortion quantiﬁcation to measure point cloud geometry and color difference. The proposed MPED is able to capture both geometrical and color impairments by quantifying the total distortion between reference and distorted samples. By evaluating at various neighborhood sizes, the proposed MPED achieves global-local tradeoffs, capturing distortion in a multiscale fashion. We further theoretically show that classical Chamfer distance is a special case of our MPED. Extensive experimental studies validate MPED’s superiority for both human and machine perception tasks. For human perception tasks, the proposed MPED works as subjective score predictor. In terms of Spearman rank-order correlation coefﬁcient, MPED is 4% to 35% better than other state-of-the-art distortion quantiﬁcations on SJTU-PCQA database, and 27% to 190% on LSPCQA database. For machine perception tasks, the proposed MPED is plugged in as the loss function to enable the training of deep neural networks for three tasks, including point cloud reconstruction, shape completion and upsampling. The experimental results reveal that the proposed MPED produces better results than the point-wise Chamfer distance and Earth Mover’s distance under the same network architecture. For instance, in point cloud reconstruction, MPED is over 80% and 70% better than Chamfer distance and Earth Mover’s distance in terms of Jensen-Shannon divergence, respectively. We further study the robustness and convergence rate of MPED in ablation study, and the results show that: i) MPED is robust to the variations in color space, neighborhood scale and spatial ﬁeld; ii) MPED can converge to stable results with less training time and epochs using the same network model. Our code is avaliable at https://github.com/Qi-Yangsjtu/MPED.

DPDist : Comparing Point Clouds Using Deep Point Cloud Distance

Learnable Chamfer Distance for Point Cloud Reconstruction

Aggregating Feature Point Cloud for Depth Completion

Distinctive 3D local deep descriptors

Concavity-Induced Distance for Unoriented Point Cloud Decomposition

DeepICP: An End-to-End Deep Neural Network for 3D Point Cloud Registration

PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection

DeepMatch: Toward Lightweight in Point Cloud Registration

Measuring the Discrepancy between 3D Geometric Models using Directional Distance Fields

Deep Learning Point Cloud Registration based on Distance Features

Point cloud registration method based on deep learning

MPED: Quantifying Point Cloud Distortion Based on Multiscale Potential Energy Discrepancy

DeepPoint3D: Learning discriminative local descriptors using deep metric learning on 3D point clouds

Deep Learning-Based Quality Assessment Of 3d Point Clouds Without Reference

Deep Learning for 3D Point Clouds: A Survey

CEDR: Contrastive Embedding Distribution Refinement for 3D point cloud representation

A Visualization-aware Loss for Point Cloud Comparison

Deep Learning on Point Clouds and Its Application: A Survey

PnP-3D: A Plug-and-Play for 3D Point Clouds

Point Cloud Distortion Quantification based on Potential Energy for Human and Machine Perception