Abstract:Recently, point-based networks have exhibited extraordinary potential for 3D point cloud processing. However, owing to the meticulous design of both parameters and hyperparameters inside the network, constructing a promising network for each point cloud task can be an expensive endeavor. In this work, we develop a novel one-shot search framework called Point-NAS to automatically determine optimum architectures for various point cloud tasks. Specifically, we design an elastic feature extraction (EFE) module that serves as a basic unit for architecture search, which expands seamlessly alongside both the width and depth of the network for efficient feature extraction. Based on the EFE module, we devise a searching space, which is encoded into a supernet to provide a wide number of latent network structures for a particular point cloud task. To fully optimize the weights of the supernet, we propose a weight coupling sandwich rule that samples the largest, smallest, and multiple medium models at each iteration and fuses their gradients to update the supernet. Furthermore, we present a united gradient adjustment algorithm that mitigates gradient conflict induced by distinct gradient directions of sampled models and supernet, thus expediting the convergence of the supernet and assuring that it can be comprehensively trained. Pursuant to the provided techniques, the trained supernet enables a multitude of subnets to be incredibly well-optimized. Finally, we conduct an evolutionary search for the supernet under resource constraints to find promising architectures for different tasks. Experimentally, the searched Point-NAS with weights inherited from the supernet realizes outstanding results across a variety of benchmarks. i.e., 94.2% and 88.9% overall accuracy under ModelNet40 and ScanObjectNN, 68.6% mIoU under S3DIS, 63.6% and 69.3% mAP@0.25 under SUN RGB-D and ScanNet V2 datasets.

An Improved Deep Multiple-input and Single-output PointNet for 3D Model Retrieval

Deep Point Convolutional Approach for 3D Model Retrieval.

3D Reconstruction and Semantic Segmentation Method Combining PointNet and 3D-Lmnet from Single Image

3D Point Cloud Classification Segmentation Model Based on Improved PointNet++

AttPNet: Attention-Based Deep Neural Network for 3D Point Set Analysis

FMP: Enhancing 3D Point Cloud Classification With Functional Multi-Head Pooling to Surpass PointNet

BiPointNet: Binary Neural Network for Point Clouds

Deep Multi-scale Learning on Point Sets for 3D Object Recognition.

PVNet: A Joint Convolutional Network of Point Cloud and Multi-View for 3D Shape Recognition.

Triangle-Net: Towards Robustness in Point Cloud Learning

Mini-PointNetPlus: a local feature descriptor in deep learning model for 3d environment perception

PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies

Deep Neural Network for Point Sets Based on Local Feature Integration

MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

MVPointNet: Multi-View Network for 3D Object Based on Point Cloud

PVRNet: Point-View Relation Neural Network for 3D Shape Recognition

PointNetX: Part Segmentation Based on PointNet Promotion

MANet: Multimodal Attention Network based Point- View fusion for 3D Shape Recognition

FatNet: A Feature-attentive Network for 3D Point Cloud Processing

PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space

Point-NAS: A Novel Neural Architecture Search Framework for Point Cloud Analysis.