Abstract:Point clouds offer a novel 3D data representation that has proven pivotal in immersive visual media applications involving human perception. Developing objective point cloud quality assessment (PCQA) methods is imperative, as they can substantially reduce human evaluation costs and drive advancements for visual perceptual experiences in point cloud related applications. Point cloud quality assessment without reference remains challenging. Previous PCQA methods predominantly employ a fixed perceptual distance and often overlook the variability in quality perceived from different viewpoints, which impedes their effectiveness in multiscale or multi-granularity feature extraction and learning, particularly for deep neural networks. The single fixed observation distance fails to capture the multi-resolution characteristics intrinsic to human perception. Addressing this gap, in this paper, we introduce a novel no-reference PCQA method (MOD-PCQA) that integrates multiscale features to enhance point cloud quality perception across diverse scales and granularities. MOD-PCQA pioneers a viewpoint aware feature learning framework, capable of capturing visual features across various granularity levels, from fine to coarse. Specifically, we process and project point clouds into images from different viewpoints. Then, we extract multi-scale features under corresponding perspectives through three branch networks. Finally, we design an alternate learning strategy to optimize the feature extraction network to continuously refine the learned feature information from both inter-scale and intra-scale perspectives. Comprehensive experiments conducted on the SJTU-PCQA and WPC databases validate the superiority of our proposed model over state-of-the-art PCQA methods. Our method achieves optimal performance on both benchmarks by a significant margin, which comprehensively validates its effectiveness for the challenging PCQA task. The source code will be available at https://openi.pcl.ac.cn/OpenPointCloud/MOD-PCQA [1].

Improving Point Cloud Quality Metrics with Noticeable Possibility Maps

Perception-Guided Quality Metric of 3D Point Clouds Using Hybrid Strategy

Zoom to Perceive Better: No-reference Point Cloud Quality Assessment via Exploring Effective Multiscale Feature

Impact of Geometry and Attribute Distortion in Subjective Quality of Point Clouds for G-PCC

MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessment

TCDM: Transformational Complexity Based Distortion Metric for Perceptual Point Cloud Quality Assessment

Perceptual Point Cloud Qality Assessment for Immersive Metaverse Experience

PQA-Net: Deep No Reference Point Cloud Quality Assessment via Multi-View Projection

PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors

3QNet: 3D Point Cloud Geometry Quantization Compression Network

Point Cloud Quality Assessment using 3D Saliency Maps

Perceptual Quality Assessment of Colored 3D Point Clouds

Predicting the Perceptual Quality of Point Cloud: A 3D-to-2D Projection-Based Exploration

Hallucinated-PQA: No reference point cloud quality assessment via injecting pseudo-reference features

Pseudo-reference Point Cloud Quality Measurement Based on Joint 2D and 3D Distortion Description

Compressed Point Cloud Quality Index by Combining Global Appearance and Local Details

Once-Training-All-Fine: No-Reference Point Cloud Quality Assessment via Domain-relevance Degradation Description

A Point-to-Distribution Joint Geometry and Color Metric for Point Cloud Quality Assessment

Uncertainty-aware No-Reference Point Cloud Quality Assessment

No-reference Bitstream-based Perceptual Quality Assessment of Octree-Lifting Encoded 3D Point Clouds