Abstract:Point cloud is an essential format for three-dimensional (3-D) object modelling and interaction in Augmented Reality and Virtual Reality applications. In the current state of the art video-based point cloud compression (V-PCC), a dynamic point cloud is projected onto geometry and attribute videos patch by patch, each represented by its texture, depth, and occupancy map for reconstruction. To deal with occlusion, each patch is projected onto near and far depth fields in the geometry video. Once there are artifacts on the compressed two-dimensional (2-D) geometry video, they would be propagated to the 3-D point-cloud frames. In addition, in the lossy compression, there always exists a tradeoff between the rate of bitstream and distortion. Although some geometry-related methods were proposed to attenuate these artifacts and improve the coding efficiency, the interactive correlation between projected near and far depth fields has been ignored. Moreover, the non-linear representation ability of Convolutional Neural Network has not been fully considered. Therefore, we propose a learning-based approach to remove the geometry artifacts and improve the compressing efficiency. We have the following contributions. We devise a two-step method working on the near and far depth fields decomposed from geometry. The first stage is learning-based Pseudo-Motion Compensation. The second stage exploits the potential of the strong correlations between near and far depth fields. Our proposed algorithm is embedded in the V-PCC reference software. To the best of our knowledge, this is the first learning-based solution of the geometry artifacts removal in V-PCC. The extensive experimental results show that the proposed approach achieves significant gains on geometry artifacts removal and quality improvement of 3-D point-cloud reconstruction compared to the state-of-the-art schemes.

Understanding Geometry for Point Cloud Segmentation Via Covariance

GeoSegNet: Point Cloud Semantic Segmentation via Geometric Encoder-Decoder Modeling

Geometry and Uncertainty-Aware 3D Point Cloud Class-Incremental Semantic Segmentation

Learning Point Cloud Shapes with Geometric and Topological Structures.

GEOMETRIC ATTRIBUTE ANALYSIS AND SEGMENTATION OF POINT CLOUD

Learnable scene prior for point cloud semantic segmentation

GSTran: Joint Geometric and Semantic Coherence for Point Cloud Segmentation

A Semantic-Based Loop Closure Detection of 3D Point Cloud

RegGeoNet: Learning Regular Representations for Large-Scale 3D Point Clouds

Geometrically-driven Aggregation for Zero-shot 3D Point Cloud Understanding

CGA-Net: Category Guided Aggregation for Point Cloud Semantic Segmentation.

Learning to Segment 3D Point Clouds in 2D Image Space

A Large-Scale Point Cloud Semantic Segmentation Network Via Local Dual Features and Global Correlations

Deep Learning Geometry Compression Artifacts Removal for Video-Based Point Cloud Compression

Semantic Context Encoding for Accurate 3D Point Cloud Segmentation

InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perception

SPCGC: Scalable Point Cloud Geometry Compression for Machine Vision

Unsupervised Learning of Geometric Sampling Invariant Representations for 3D Point Clouds

Learning Geometric Transformation for Point Cloud Completion

Doubly Deformable Aggregation of Covariance Matrices for Few-shot Segmentation

LiDAR-Camera Panoptic Segmentation via Geometry-Consistent and Semantic-Aware Alignment