Abstract:Point clouds offer a novel 3D data representation that has proven pivotal in immersive visual media applications involving human perception. Developing objective point cloud quality assessment (PCQA) methods is imperative, as they can substantially reduce human evaluation costs and drive advancements for visual perceptual experiences in point cloud related applications. Point cloud quality assessment without reference remains challenging. Previous PCQA methods predominantly employ a fixed perceptual distance and often overlook the variability in quality perceived from different viewpoints, which impedes their effectiveness in multiscale or multi-granularity feature extraction and learning, particularly for deep neural networks. The single fixed observation distance fails to capture the multi-resolution characteristics intrinsic to human perception. Addressing this gap, in this paper, we introduce a novel no-reference PCQA method (MOD-PCQA) that integrates multiscale features to enhance point cloud quality perception across diverse scales and granularities. MOD-PCQA pioneers a viewpoint aware feature learning framework, capable of capturing visual features across various granularity levels, from fine to coarse. Specifically, we process and project point clouds into images from different viewpoints. Then, we extract multi-scale features under corresponding perspectives through three branch networks. Finally, we design an alternate learning strategy to optimize the feature extraction network to continuously refine the learned feature information from both inter-scale and intra-scale perspectives. Comprehensive experiments conducted on the SJTU-PCQA and WPC databases validate the superiority of our proposed model over state-of-the-art PCQA methods. Our method achieves optimal performance on both benchmarks by a significant margin, which comprehensively validates its effectiveness for the challenging PCQA task. The source code will be available at https://openi.pcl.ac.cn/OpenPointCloud/MOD-PCQA [1].

Zoom to Perceive Better: No-reference Point Cloud Quality Assessment via Exploring Effective Multiscale Feature

MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessment

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

PQA-Net: Deep No Reference Point Cloud Quality Assessment via Multi-View Projection

No-Reference Point Cloud Quality Assessment via Graph Convolutional Network

Point Cloud Quality Assessment using 3D Saliency Maps

Hallucinated-PQA: No reference point cloud quality assessment via injecting pseudo-reference features

Perceptual Quality Assessment of Colored 3D Point Clouds

No-Reference Point Cloud Quality Assessment via Domain Adaptation

A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences

Evaluating Point Cloud from Moving Camera Videos: A No-Reference Metric

Simple Baselines for Projection-based Full-reference and No-reference Point Cloud Quality Assessment

PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors

Once-Training-All-Fine: No-Reference Point Cloud Quality Assessment via Domain-relevance Degradation Description

No-reference Bitstream-based Perceptual Quality Assessment of Octree-Lifting Encoded 3D Point Clouds

Perception-Guided Quality Metric of 3D Point Clouds Using Hybrid Strategy

GPA-Net:No-Reference Point Cloud Quality Assessment With Multi-Task Graph Convolutional Network

Perceptual Point Cloud Qality Assessment for Immersive Metaverse Experience

Perceptual Quality Assessment of Octree-RAHT Encoded 3D Point Clouds

Perceptual Quality Assessment of Trisoup-Lifting Encoded 3D Point Clouds