Abstract:Recently researchers have been shifting their focus towards learned 3D shape descriptors from hand-craft ones to better address challenging issues of the deformation and structural variation inherently present in 3D objects. 3D geometric data are often transformed to 3D Voxel grids with regular format in order to be better fed to a deep neural net architecture. However, the computational intractability of direct application of 3D convolutional nets to 3D volumetric data severely limits the efficiency (i.e. slow processing) and effectiveness (i.e. unsatisfied accuracy) in processing 3D geometric data. In this paper, powered with a novel design of adversarial networks (3D-A-Nets), we have developed a novel 3D deep dense shape descriptor (3D-DDSD) to address the challenging issues of efficient and effective 3D volumetric data processing. We developed new definition of 2D multilayer dense representation (MDR) of 3D volumetric data to extract concise but geometrically informative shape description and a novel design of adversarial networks that jointly train a set of convolution neural network (CNN), recurrent neural network (RNN) and an adversarial discriminator. More specifically, the generator network produces 3D shape features that encourages the clustering of samples from the same category with correct class label, whereas the discriminator network discourages the clustering by assigning them misleading adversarial class labels. By addressing the challenges posed by the computational inefficiency of direct application of CNN to 3D volumetric data, 3D-A-Nets can learn high-quality 3D-DSDD which demonstrates superior performance on 3D shape classification and retrieval over other state-of-the-art techniques by a great margin.

STD-Net: Structure-preserving and Topology-adaptive Deformation Network for Single-View 3D Reconstruction

View-Aware Geometry-Structure Joint Learning for Single-View 3D Shape Reconstruction

DMNet: Delaunay Meshing Network for 3D Shape Representation

Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networks

Learning Point Cloud Shapes with Geometric and Topological Structures.

DSANet: Dynamic and Structure-Aware GCN for Sparse and Incomplete Point Cloud Learning

DV-Net: Dual-view Network for 3D Reconstruction by Fusing Multiple Sets of Gated Control Point Clouds

DeformNet: Free-Form Deformation Network for 3D Shape Reconstruction from a Single Image

GDR-Net: A Geometric Detail Recovering Network for 3D Scanned Objects

Saliency Guided Subdivision for Single-View Mesh Reconstruction

3D-A-Nets: 3D Deep Dense Descriptor for Volumetric Shapes with Adversarial Networks

A Coarse-to-Fine Transformer-Based Network for 3D Reconstruction from Non-Overlapping Multi-View Images

Learning Deformable Tetrahedral Meshes for 3D Reconstruction.

HDM-Net: Monocular Non-Rigid 3D Reconstruction with Learned Deformation Model

DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstruction

Fast Mesh Reconstruction from Single View Based on GCN and Topology Modification.

DC-GNet: Deep Mesh Relation Capturing Graph Convolution Network for 3D Human Shape Reconstruction

3D Former: Monocular Scene Reconstruction with 3D SDF Transformers

Shape registration with learned deformations for 3D shape reconstruction from sparse and incomplete point clouds

DmifNet:3D Shape Reconstruction Based on Dynamic Multi-Branch Information Fusion

StructureNet: Hierarchical Graph Networks for 3D Shape Generation