Abstract:The ability to generate novel, diverse, and realistic 3D shapes along with associated part semantics and structure is central to many applications requiring high-quality 3D assets or large volumes of realistic training data. A key challenge towards this goal is how to accommodate diverse shape variations, including both continuous deformations of parts as well as structural or discrete alterations which add to, remove from, or modify the shape constituents and compositional structure. Such object structure can typically be organized into a hierarchy of constituent object parts and relationships, represented as a hierarchy of n-ary graphs. We introduce StructureNet, a hierarchical graph network which (i) can directly encode shapes represented as such n-ary graphs; (ii) can be robustly trained on large and complex shape families; and (iii) can be used to generate a great diversity of realistic structured shape geometries. Technically, we accomplish this by drawing inspiration from recent advances in graph neural networks to propose an order-invariant encoding of n-ary graphs, considering jointly both part geometry and inter-part relations during network training. We extensively evaluate the quality of the learned latent spaces for various shape families and show significant advantages over baseline and competing methods. The learned latent spaces enable several structure-aware geometry processing applications, including shape generation and interpolation, shape editing, or shape structure discovery directly from un-annotated images, point clouds, or partial scans.

PolyNet: Polynomial Neural Network for 3D Shape Recognition with PolyShape Representation

Learning Geometric Invariant Features for Classification of Vector Polygons with Graph Message-passing Neural Network

PolyNet: A Pursuit of Structural Diversity in Very Deep Networks

MeshNet: Mesh Neural Network for 3D Shape Representation

3D ShapeNets: A Deep Representation for Volumetric Shapes

PGNet: Progressive Feature Guide Learning Network for Three-dimensional Shape Recognition.

PolyGNN: Polyhedron-based Graph Neural Network for 3D Building Reconstruction from Point Clouds

A Unified Feature Representation and Learning Framework for 3D Shape

PAI-GCN: Permutable Anisotropic Graph Convolutional Networks for 3D Shape Representation Learning.

TPNet: A Novel Mesh Analysis Method Via Topology Preservation and Perception Enhancement

DMNet: Delaunay Meshing Network for 3D Shape Representation

PolyGen: An Autoregressive Generative Model of 3D Meshes

Learning Local Neighboring Structure for Robust 3D Shape Representation

Feature-preserved Convolutional Neural Network for 3D Mesh Recognition

PolygonGNN: Representation Learning for Polygonal Geometries with Heterogeneous Visibility Graph

Reconstruction of 3D Object Shape Using Hybrid Modular Neural Network Architecture Trained on 3D Models from ShapeNetCore Dataset

StructureNet: Hierarchical Graph Networks for 3D Shape Generation

SSN: Shape Signature Networks for Multi-class Object Detection from Point Clouds

Matryoshka Networks: Predicting 3D Geometry via Nested Shape Layers

Regularization of polynomial networks for image recognition

DFNet: Deep Fusion Network for 3D Shape Classification and Retrieval