Abstract:—Distortion quantiﬁcation of point clouds plays a stealth, yet vital role in a wide range of human and machine perception tasks. For human perception tasks, a distortion quantiﬁcation can substitute subjective experiments to guide 3D visualization; while for machine perception tasks, a distortion quantiﬁcation can work as a loss function to guide the training of deep neural networks for unsupervised learning tasks. To handle a variety of demands in many applications, a distortion quantiﬁcation needs to be distortion discriminable, differentiable, and have a low computational complexity. Currently, however, there is a lack of a general distortion quantiﬁcation that can satisfy all three conditions. To ﬁll this gap, this work proposes multiscale potential energy discrepancy (MPED), a distortion quantiﬁcation to measure point cloud geometry and color difference. The proposed MPED is able to capture both geometrical and color impairments by quantifying the total distortion between reference and distorted samples. By evaluating at various neighborhood sizes, the proposed MPED achieves global-local tradeoffs, capturing distortion in a multiscale fashion. We further theoretically show that classical Chamfer distance is a special case of our MPED. Extensive experimental studies validate MPED’s superiority for both human and machine perception tasks. For human perception tasks, the proposed MPED works as subjective score predictor. In terms of Spearman rank-order correlation coefﬁcient, MPED is 4% to 35% better than other state-of-the-art distortion quantiﬁcations on SJTU-PCQA database, and 27% to 190% on LSPCQA database. For machine perception tasks, the proposed MPED is plugged in as the loss function to enable the training of deep neural networks for three tasks, including point cloud reconstruction, shape completion and upsampling. The experimental results reveal that the proposed MPED produces better results than the point-wise Chamfer distance and Earth Mover’s distance under the same network architecture. For instance, in point cloud reconstruction, MPED is over 80% and 70% better than Chamfer distance and Earth Mover’s distance in terms of Jensen-Shannon divergence, respectively. We further study the robustness and convergence rate of MPED in ablation study, and the results show that: i) MPED is robust to the variations in color space, neighborhood scale and spatial ﬁeld; ii) MPED can converge to stable results with less training time and epochs using the same network model. Our code is avaliable at https://github.com/Qi-Yangsjtu/MPED.

Perceptual Distortion Measure For Polygon-Based Shape Coding

Region-based Saliency Estimation for 3D Shape Analysis and Understanding

Perceptual-Saliency Extremum Lines for 3d Shape Illustration

A Lossy Contour-Based Representation of Segmentation Maps Using Quadratic Transformations Motion Prediction

A New Shape-Coding Algorithm by Using Wavelet Transform

Compressive Sensing Image Coding with Perceptual Weighting Measuring Matrix

A Modified Vertex-Based Shape Coding Algorithm

Point Cloud Distortion Quantification based on Potential Energy for Human and Machine Perception

TCDM: Transformational Complexity Based Distortion Metric for Perceptual Point Cloud Quality Assessment

A Novel Virtual View Distortion Estimation for Depth Maps Coding

Pseudo-reference Point Cloud Quality Measurement Based on Joint 2D and 3D Distortion Description

A Shape Enhancement Technique Based on Multi-channel Salience Measure.

Efficient rendering distortion estimation for depth map compression

A Method of Perceptual-Based Shape Decomposition

A Shape Reconstructability Measure of Object Part Importance with Applications to Object Detection and Localization

Visual saliency guided normal enhancement technique for 3D shape depiction

Computing Importance Of 2d Contour Parts By Reconstructability

SSIM Based Perceptual Distortion Rate Optimization Coding.

MPED: Quantifying Point Cloud Distortion Based on Multiscale Potential Energy Discrepancy

V-PCC Projection Based Blind Point Cloud Quality Assessment for Compression Distortion

Rate-distortion optimized quantization for geometry-based point cloud compression