Abstract:In reviewing the research progress in Point Cloud Quality Assessment (PCQA), two main pathways have emerged, i.e., 2D projections and 3D point descriptors. The former primarily focuses on visual information, while the latter concentrates on crucial geometrical information in three-dimensional space. However, the current studies lack a thorough investigation of the impact of visual components and seldom pay special attention to plane-point fusion strategies. To comprehensively represent features and effectively tackle various types of impairments, we propose an end-to-end learning paradigm, only considering plain visual and geometrical factors called Plain-PCQA, for quantitatively evaluating objective metrics of 3D dense point clouds associated with human perception. Firstly, we explore a sophisticated preprocessing technique. The entire point clouds are packaged into six projections by moving virtual cameras, which can conveniently increase the visual samples during the training stage. Given the high resolution of the projected image, we have opted for a relatively lightweight network, namely ResNet-18, as the backbone to enable higher resolution input data. Five cropped patches from the projected image are collectively fed into this network. In light of the presence of some invalid information in the projections, a mask weight is devised to calculate the significance of each patch based on its effective informational content. Secondly, dual neural networks, comprising of a No-Reference (NR) branch and a Degraded-Reference (DR) branch, are designed with fundamental visual components to provide quantitative quality metrics. Specifically, the NR branch utilizes the feature output of each block in the Vision Transformer (ViT) model to obtain long-range low-level and high-level visual NR quality. The DR branch employs KLT (Karhunen-Loève Transform) to acquire the principal component information of an image as the macro-structural image, and then feeds the difference between input images and macro-structural images into a network for DR quality extraction. Thirdly, a Plane-Point Interaction Transformer (P2IT) is presented by incorporating texture and semantic features in 2D projections and geometrical features in 3D spaces to characterize the complete features with a connected 2D-3D feature representation. With these elaborately designed deep features, the proposed model can achieve competitive performances relying solely on plain visual and geometrical components. The experimental results demonstrate the potential of the proposed approach in multiple representative databases, which surpasses existing state-of-the-art methods significantly.

Optimizing Projection-Based Point Cloud Quality Assessment with Human Preferred Viewpoints Selection

Zoom to Perceive Better: No-reference Point Cloud Quality Assessment via Exploring Effective Multiscale Feature

Simple Baselines for Projection-based Full-reference and No-reference Point Cloud Quality Assessment

Impact of Geometry and Attribute Distortion in Subjective Quality of Point Clouds for G-PCC

Reduced-Reference Quality Assessment of Point Clouds via Content-Oriented Saliency Projection

Predicting the Perceptual Quality of Point Cloud: A 3D-to-2D Projection-Based Exploration

Subjective Quality Database and Objective Study of Compressed Point Clouds With 6DoF Head-Mounted Display

PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors

Perceptual Quality Assessment of Colored 3D Point Clouds

PQA-Net: Deep No Reference Point Cloud Quality Assessment via Multi-View Projection

MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessment

Hallucinated-PQA: No reference point cloud quality assessment via injecting pseudo-reference features

Plain-PCQA: No-Reference Point Cloud Quality Assessment by Analysis of Plain Visual and Geometrical Components

Compressed Point Cloud Quality Index by Combining Global Appearance and Local Details

Point Cloud Quality Assessment using 3D Saliency Maps

Perception-Guided Quality Metric of 3D Point Clouds Using Hybrid Strategy

Evaluating Point Cloud from Moving Camera Videos: A No-Reference Metric

Viewpoint selection benchmark design and application

V-PCC Projection Based Blind Point Cloud Quality Assessment for Compression Distortion

Uncertainty-aware No-Reference Point Cloud Quality Assessment

A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences