Abstract:—Distortion quantiﬁcation of point clouds plays a stealth, yet vital role in a wide range of human and machine perception tasks. For human perception tasks, a distortion quantiﬁcation can substitute subjective experiments to guide 3D visualization; while for machine perception tasks, a distortion quantiﬁcation can work as a loss function to guide the training of deep neural networks for unsupervised learning tasks. To handle a variety of demands in many applications, a distortion quantiﬁcation needs to be distortion discriminable, differentiable, and have a low computational complexity. Currently, however, there is a lack of a general distortion quantiﬁcation that can satisfy all three conditions. To ﬁll this gap, this work proposes multiscale potential energy discrepancy (MPED), a distortion quantiﬁcation to measure point cloud geometry and color difference. The proposed MPED is able to capture both geometrical and color impairments by quantifying the total distortion between reference and distorted samples. By evaluating at various neighborhood sizes, the proposed MPED achieves global-local tradeoffs, capturing distortion in a multiscale fashion. We further theoretically show that classical Chamfer distance is a special case of our MPED. Extensive experimental studies validate MPED’s superiority for both human and machine perception tasks. For human perception tasks, the proposed MPED works as subjective score predictor. In terms of Spearman rank-order correlation coefﬁcient, MPED is 4% to 35% better than other state-of-the-art distortion quantiﬁcations on SJTU-PCQA database, and 27% to 190% on LSPCQA database. For machine perception tasks, the proposed MPED is plugged in as the loss function to enable the training of deep neural networks for three tasks, including point cloud reconstruction, shape completion and upsampling. The experimental results reveal that the proposed MPED produces better results than the point-wise Chamfer distance and Earth Mover’s distance under the same network architecture. For instance, in point cloud reconstruction, MPED is over 80% and 70% better than Chamfer distance and Earth Mover’s distance in terms of Jensen-Shannon divergence, respectively. We further study the robustness and convergence rate of MPED in ablation study, and the results show that: i) MPED is robust to the variations in color space, neighborhood scale and spatial ﬁeld; ii) MPED can converge to stable results with less training time and epochs using the same network model. Our code is avaliable at https://github.com/Qi-Yangsjtu/MPED.

A Visualization-aware Loss for Point Cloud Comparison

Learning to Measure the Point Cloud Reconstruction Loss in a Representation Space

Learnable Chamfer Distance for Point Cloud Reconstruction

Point Cloud Completion Cascade Optimization Network Based on Feature Fusion

Perceptual Point Cloud Qality Assessment for Immersive Metaverse Experience

Loss Distillation via Gradient Matching for Point Cloud Completion with Weighted Chamfer Distance

A Novel Score-Based LiDAR Point Cloud Degradation Analysis Method

Adaptive Cloud-to-Cloud (AC2C) Comparison Method for Photogrammetric Point Cloud Error Estimation Considering Theoretical Error Space

Winding Clearness for Differentiable Point Cloud Optimization

Reduced-Reference Quality Assessment of Point Clouds via Content-Oriented Saliency Projection

Point Cloud Distortion Quantification based on Potential Energy for Human and Machine Perception

Point Clouds Matching Based on Discrete Optimal Transport

Point Clouds Outlier Removal Method Based on Improved Mahalanobis and Completion

Zoom to Perceive Better: No-reference Point Cloud Quality Assessment via Exploring Effective Multiscale Feature

Learning to Train a Point Cloud Reconstruction Network Without Matching

Enhancing Performance of Point Cloud Completion Networks with Consistency Loss

Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Model

Evaluating Point Cloud from Moving Camera Videos: A No-Reference Metric

Unsupervised contrastive learning with simple transformation for 3D point cloud data

Perceptual Quality Assessment of Colored 3D Point Clouds

MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessment