Abstract:—Distortion quantiﬁcation of point clouds plays a stealth, yet vital role in a wide range of human and machine perception tasks. For human perception tasks, a distortion quantiﬁcation can substitute subjective experiments to guide 3D visualization; while for machine perception tasks, a distortion quantiﬁcation can work as a loss function to guide the training of deep neural networks for unsupervised learning tasks. To handle a variety of demands in many applications, a distortion quantiﬁcation needs to be distortion discriminable, differentiable, and have a low computational complexity. Currently, however, there is a lack of a general distortion quantiﬁcation that can satisfy all three conditions. To ﬁll this gap, this work proposes multiscale potential energy discrepancy (MPED), a distortion quantiﬁcation to measure point cloud geometry and color difference. The proposed MPED is able to capture both geometrical and color impairments by quantifying the total distortion between reference and distorted samples. By evaluating at various neighborhood sizes, the proposed MPED achieves global-local tradeoffs, capturing distortion in a multiscale fashion. We further theoretically show that classical Chamfer distance is a special case of our MPED. Extensive experimental studies validate MPED’s superiority for both human and machine perception tasks. For human perception tasks, the proposed MPED works as subjective score predictor. In terms of Spearman rank-order correlation coefﬁcient, MPED is 4% to 35% better than other state-of-the-art distortion quantiﬁcations on SJTU-PCQA database, and 27% to 190% on LSPCQA database. For machine perception tasks, the proposed MPED is plugged in as the loss function to enable the training of deep neural networks for three tasks, including point cloud reconstruction, shape completion and upsampling. The experimental results reveal that the proposed MPED produces better results than the point-wise Chamfer distance and Earth Mover’s distance under the same network architecture. For instance, in point cloud reconstruction, MPED is over 80% and 70% better than Chamfer distance and Earth Mover’s distance in terms of Jensen-Shannon divergence, respectively. We further study the robustness and convergence rate of MPED in ablation study, and the results show that: i) MPED is robust to the variations in color space, neighborhood scale and spatial ﬁeld; ii) MPED can converge to stable results with less training time and epochs using the same network model. Our code is avaliable at https://github.com/Qi-Yangsjtu/MPED.

Perceptual Point Cloud Qality Assessment for Immersive Metaverse Experience

Perceptual Quality Assessment of Colored 3D Point Clouds

Predicting the Perceptual Quality of Point Cloud: A 3D-to-2D Projection-Based Exploration

Perception-Guided Quality Metric of 3D Point Clouds Using Hybrid Strategy

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

PQA-Net: Deep No Reference Point Cloud Quality Assessment via Multi-View Projection

MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessment

PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors

TCDM: Transformational Complexity Based Distortion Metric for Perceptual Point Cloud Quality Assessment

Zoom to Perceive Better: No-reference Point Cloud Quality Assessment via Exploring Effective Multiscale Feature

Reduced-Reference Quality Assessment of Point Clouds via Content-Oriented Saliency Projection

Point Cloud Quality Assessment using 3D Saliency Maps

Deep Learning-Based Quality Assessment Of 3d Point Clouds Without Reference

A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences

No-Reference Quality Assessment for 3D Colored Point Cloud and Mesh Models

Point Cloud Quality Assessment Using a One-Dimensional Model Based on the Convolutional Neural Network

PCQD‐AR: Subjective quality assessment of compressed point clouds with head‐mounted augmented reality

Blind Quality Assessment of 3D Dense Point Clouds with Structure Guided Resampling

Point Cloud Distortion Quantification based on Potential Energy for Human and Machine Perception