Abstract:The lossy Geometry-based Point Cloud Compression (G-PCC) inevitably impairs the geometry information of point clouds, which deteriorates the quality of experience (QoE) in reconstruction and/or misleads decisions in tasks such as classification. To tackle it, this work proposes GRNet for the geometry restoration of G-PCC compressed large-scale point clouds. By analyzing the content characteristics of original and G-PCC compressed point clouds, we attribute the G-PCC distortion to two key factors: point vanishing and point displacement. Visible impairments on a point cloud are usually dominated by an individual factor or superimposed by both factors, which are determined by the density of the original point cloud. To this end, we employ two different models for coordinate reconstruction, termed Coordinate Expansion and Coordinate Refinement, to attack the point vanishing and displacement, respectively. In addition, 4-byte auxiliary density information is signaled in the bitstream to assist the selection of Coordinate Expansion, Coordinate Refinement, or their combination. Before being fed into the coordinate reconstruction module, the G-PCC compressed point cloud is first processed by a Feature Analysis Module for multiscale information fusion, in which kNN-based Transformer is leveraged at each scale to adaptively characterize neighborhood geometric dynamics for effective restoration. Following the common test conditions recommended in the MPEG standardization committee, GRNet significantly improves the G-PCC anchor and remarkably outperforms state-of-the-art methods on a great variety of point clouds (e.g., solid, dense, and sparse samples) both quantitatively and qualitatively. Meanwhile, GRNet runs fairly fast and uses a smaller-size model when compared with existing learning-based approaches, making it attractive to industry practitioners.

GDR-Net: A Geometric Detail Recovering Network for 3D Scanned Objects

STD-Net: Structure-preserving and Topology-adaptive Deformation Network for Single-View 3D Reconstruction

A Detail Geometry Learning Network for High-Fidelity Face Reconstruction

DMNet: Delaunay Meshing Network for 3D Shape Representation

A Geometry-Enhanced 6D Pose Estimation Network with Incomplete Shape Recovery for Industrial Parts

ResGEM: Multi-scale Graph Embedding Network for Residual Mesh Denoising.

GTR: Improving Large 3D Reconstruction Models through Geometry and Texture Refinement

Multi-scale Edge-guided Learning for 3D Reconstruction

A Progressive Quadric Graph Convolutional Network for 3D Human Mesh Recovery

HR-NeuS: Recovering High-Frequency Surface Geometry via Neural Implicit Surfaces

Geometric Object 3D Reconstruction from Single Line Drawing Image Based on a Network for Classification and Sketch Extraction

Decoupling Fine Detail and Global Geometry for Compressed Depth Map Super-Resolution

High-Quality Textured 3D Shape Reconstruction with Cascaded Fully Convolutional Networks

DE-Net: Detail-enhanced MR Reconstruction Network Via Global-Local Dependent Attention

ResGS: Residual Densification of 3D Gaussian for Efficient Detail Recovery

High-frequency Details Enhancing DenseNet for Super-Resolution.

Facial Geometric Detail Recovery via Implicit Representation

GRNet:Geometry Restoration for G-PCC Compressed Point Clouds Using Auxiliary Density Signaling

Multi-granularity Relationship Reasoning Network for High-Fidelity 3D Shape Reconstruction

Spherical Space Feature Decomposition for Guided Depth Map Super-Resolution

ATMNet: Adaptive Texture Migration Network for Guided Depth Super-Resolution