Abstract:Point cloud is one of the most widely used digital representation formats for three-dimensional (3D) contents, the visual quality of which may suffer from noise and geometric shift distortions during the production procedure as well as compression and downsampling distortions during the transmission process. To tackle the challenge of point cloud quality assessment (PCQA), many PCQA methods have been proposed to evaluate the visual quality levels of point clouds by assessing the rendered static 2D projections. Although such projection-based PCQA methods achieve competitive performance with the assistance of mature image quality assessment (IQA) methods, they neglect that the 3D model is also perceived in a dynamic viewing manner, where the viewpoint is continually changed according to the feedback of the rendering device. Therefore, in this paper, we evaluate the point clouds from moving camera videos and explore the way of dealing with PCQA tasks via using video quality assessment (VQA) methods. First, we generate the captured videos by rotating the camera around the point clouds through several circular pathways. Then we extract both spatial and temporal quality-aware features from the selected key frames and the video clips through using trainable 2D-CNN and pre-trained 3D-CNN models respectively. Finally, the visual quality of point clouds is represented by the video quality values. The experimental results reveal that the proposed method is effective for predicting the visual quality levels of the point clouds and even competitive with full-reference (FR) PCQA methods. The ablation studies further verify the rationality of the proposed framework and confirm the contributions made by the quality-aware features extracted via the dynamic viewing manner. The code is available at <a class="link-external link-https" href="https://github.com/zzc-1998/VQA_PC" rel="external noopener nofollow">this https URL</a>.

Non-Reference Quality Evaluation for Indoor 3d Point Clouds

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

Deep Learning-Based Quality Assessment Of 3d Point Clouds Without Reference

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Comparison of the Selected State-Of-The-Art 3D Indoor Scanning and Point Cloud Generation Methods

Point Cloud Quality Assessment Using a One-Dimensional Model Based on the Convolutional Neural Network

Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning

Blind Quality Assessment of Dense 3D Point Clouds with Structure Guided Resampling

Quality evaluation of point clouds: a novel no-reference approach using transformer-based architecture

Blind Quality Assessment of 3D Dense Point Clouds with Structure Guided Resampling

A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences

Understanding the Imperfection of 3D point Cloud and Semantic Segmentation algorithms for 3D Models of Indoor Environment

Volumetric wall detection in unorganized indoor point clouds using continuous segments in 2D grids

A New Framework for Generating Indoor 3D Digital Models from Point Clouds

A Fast Flatness Deviation Evaluation Algorithm for Point Cloud Data

Semantic-aware Room-Level Indoor Modeling from Point Clouds

PQA-Net: Deep No Reference Point Cloud Quality Assessment via Multi-View Projection

No-Reference Point Cloud Quality Assessment via Domain Adaptation

Perceptual Quality Assessment of Colored 3D Point Clouds

Evaluating Point Cloud from Moving Camera Videos: A No-Reference Metric