Abstract:Recently researchers have been shifting their focus towards learned 3D shape descriptors from hand-craft ones to better address challenging issues of the deformation and structural variation inherently present in 3D objects. 3D geometric data are often transformed to 3D Voxel grids with regular format in order to be better fed to a deep neural net architecture. However, the computational intractability of direct application of 3D convolutional nets to 3D volumetric data severely limits the efficiency (i.e. slow processing) and effectiveness (i.e. unsatisfied accuracy) in processing 3D geometric data. In this paper, powered with a novel design of adversarial networks (3D-A-Nets), we have developed a novel 3D deep dense shape descriptor (3D-DDSD) to address the challenging issues of efficient and effective 3D volumetric data processing. We developed new definition of 2D multilayer dense representation (MDR) of 3D volumetric data to extract concise but geometrically informative shape description and a novel design of adversarial networks that jointly train a set of convolution neural network (CNN), recurrent neural network (RNN) and an adversarial discriminator. More specifically, the generator network produces 3D shape features that encourages the clustering of samples from the same category with correct class label, whereas the discriminator network discourages the clustering by assigning them misleading adversarial class labels. By addressing the challenges posed by the computational inefficiency of direct application of CNN to 3D volumetric data, 3D-A-Nets can learn high-quality 3D-DSDD which demonstrates superior performance on 3D shape classification and retrieval over other state-of-the-art techniques by a great margin.

DFNet: Deep Fusion Network for 3D Shape Classification and Retrieval

Hamming Embedding Sensitivity Guided Fusion Network for 3D Shape Representation.

Local Deep Feature Learning Framework for 3D Shape.

A Dimensional Reduction Guiding Deep Learning Architecture for 3D Shape Retrieval

Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and Recognition.

3D-A-Nets: 3D Deep Dense Descriptor for Volumetric Shapes with Adversarial Networks

DAN: Deep-Attention Network for 3D Shape Recognition

DV-Net: Dual-view Network for 3D Reconstruction by Fusing Multiple Sets of Gated Control Point Clouds

A Unified Feature Representation and Learning Framework for 3D Shape

Effective 3-D Shape Retrieval by Integrating Traditional Descriptors and Pointwise Convolution

PVRNet: Point-View Relation Neural Network for 3D Shape Recognition

DmifNet:3D Shape Reconstruction Based on Dynamic Multi-Branch Information Fusion

PVNet: A Joint Convolutional Network of Point Cloud and Multi-View for 3D Shape Recognition.

MANet: Multimodal Attention Network based Point- View fusion for 3D Shape Recognition

Multimodal 2D+3D Facial Expression Recognition with Deep Fusion Convolutional Neural Network

Dual-Neighborhood Deep Fusion Network for Point Cloud Analysis

LATFormer: Locality-Aware Point-View Fusion Transformer for 3D shape recognition

MBDF-Net

Learning Discriminative and Generative Shape Embeddings for Three-Dimensional Shape Retrieval

DeformNet: Free-Form Deformation Network for 3D Shape Reconstruction from a Single Image