Abstract:Deep learning has proven an effective tool for 3D point cloud processing. Currently, most deep set architectures are developed for sparse inputs (typically with a few thousand points), which are unable to provide sufficient structural statistics and semantic cues due to low resolutions. Since these architectures suffer from unacceptable computational and memory costs when consuming dense inputs, there is a pressing need in real-world applications to handle large-scale 3D point clouds. To bridge this gap, this paper presents a novel unsupervised neural architecture called RegGeoNet to parameterize an unstructured point set into a completely regular image structure dubbed as deep geometry image (DeepGI), such that spatial coordinates of unordered points are recorded in three-channel grid pixels. Intuitively, our goal is to embed irregular 3D surface points onto uniform 2D lattice grids, while trying to preserve local neighborhood consistency. Functionally, DeepGI serves as a generic representation modality for raw point cloud data and can be conveniently integrated into mature image processing pipelines. Driven by its unique structural characteristics, we are motivated to customize a set of efficient feature extractors that directly operate on DeepGIs for achieving a rich variety of downstream tasks. To demonstrate the potential and universality of our proposed learning paradigms built upon DeepGIs for large-scale point cloud processing, we conduct extensive experiments on various downstream tasks, including shape classification, object part segmentation, scene semantic segmentation, normal estimation, and geometry compression, where our frameworks achieve highly competitive performance, compared with state-of-the-art methods. The source code will be publicly available at https://github.com/keeganhk/RegGeoNet.

GridNet: Efficiently Learning Deep Hierarchical Representation for 3D Point Cloud Understanding.

3Dti-Net: Learn 3D Transform-Invariant Feature Using Hierarchical Graph CNN

Edge Aware Learning for 3D Point Cloud

GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Clouds

Hierarchical Depthwise Graph Convolutional Neural Network for 3D Semantic Segmentation of Point Clouds

3DContextNet: K-d Tree Guided Hierarchical Learning of Point Clouds Using Local and Global Contextual Cues

Learned Gridification for Efficient Point Cloud Processing

Learning to Segment 3D Point Clouds in 2D Image Space

EGCT: Enhanced Graph Convolutional Transformer for 3D Point Cloud Representation Learning

GeoNet: Deep Geodesic Networks for Point Cloud Analysis

Point-GR: Graph Residual Point Cloud Network for 3D Object Classification and Segmentation

RegGeoNet: Learning Regular Representations for Large-Scale 3D Point Clouds

A Hierarchical Graph Network for 3D Object Detection on Point Clouds

Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysis

GRNet: Gridding Residual Network for Dense Point Cloud Completion

HQ-Net: A heatmap-based query backbone for point cloud understanding

ParaNet: Deep Regular Representation for 3D Point Clouds

3DTI-Net: Learn Inner Transform Invariant 3D Geometry Features using Dynamic GCN.

Hierarchical Dilated Graph Convolutional Network for Point Cloud Analysis

Deep Neural Network for Point Sets Based on Local Feature Integration

GridFormer: Point-Grid Transformer for Surface Reconstruction