Abstract:Deep learning has proven an effective tool for 3D point cloud processing. Currently, most deep set architectures are developed for sparse inputs (typically with a few thousand points), which are unable to provide sufficient structural statistics and semantic cues due to low resolutions. Since these architectures suffer from unacceptable computational and memory costs when consuming dense inputs, there is a pressing need in real-world applications to handle large-scale 3D point clouds. To bridge this gap, this paper presents a novel unsupervised neural architecture called RegGeoNet to parameterize an unstructured point set into a completely regular image structure dubbed as deep geometry image (DeepGI), such that spatial coordinates of unordered points are recorded in three-channel grid pixels. Intuitively, our goal is to embed irregular 3D surface points onto uniform 2D lattice grids, while trying to preserve local neighborhood consistency. Functionally, DeepGI serves as a generic representation modality for raw point cloud data and can be conveniently integrated into mature image processing pipelines. Driven by its unique structural characteristics, we are motivated to customize a set of efficient feature extractors that directly operate on DeepGIs for achieving a rich variety of downstream tasks. To demonstrate the potential and universality of our proposed learning paradigms built upon DeepGIs for large-scale point cloud processing, we conduct extensive experiments on various downstream tasks, including shape classification, object part segmentation, scene semantic segmentation, normal estimation, and geometry compression, where our frameworks achieve highly competitive performance, compared with state-of-the-art methods. The source code will be publicly available at https://github.com/keeganhk/RegGeoNet.

Fast Graph Representation Learning with PyTorch Geometric

Efficient Graph Deep Learning in TensorFlow with tf_geometric

Geometric Deep Learning: Going beyond Euclidean data

Representation Learning of Geometric Trees

Geometric Graph Representations and Geometric Graph Convolutions for Deep Learning on Three-Dimensional (3D) Graphs

EGCT: Enhanced Graph Convolutional Transformer for 3D Point Cloud Representation Learning

PyTorch Geometric High Order: A Unified Library for High Order Graph Neural Network

Deep Feature Learning for Graphs

Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds

Massively Parallel Graph Drawing and Representation Learning

Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges

Learning the Geodesic Embedding with Graph Neural Networks

Graph representations of 3D data for machine learning

PyTorch-Direct: Enabling GPU Centric Data Access for Very Large Graph Neural Network Training with Irregular Accesses

GPr-Net: Geometric Prototypical Network for Point Cloud Few-Shot Learning

RegGeoNet: Learning Regular Representations for Large-Scale 3D Point Clouds

TorchGeo: Deep Learning With Geospatial Data

Modeling Graphs Beyond Hyperbolic: Graph Neural Networks in Symmetric Positive Definite Matrices

Tiered Graph Autoencoders with PyTorch Geometric for Molecular Graphs

Deep Learning and Geometric Deep Learning: an introduction for mathematicians and physicists

Scalable and Effective Temporal Graph Representation Learning With Hyperbolic Geometry