Abstract:Recently, point-based networks have exhibited extraordinary potential for 3D point cloud processing. However, owing to the meticulous design of both parameters and hyperparameters inside the network, constructing a promising network for each point cloud task can be an expensive endeavor. In this work, we develop a novel one-shot search framework called Point-NAS to automatically determine optimum architectures for various point cloud tasks. Specifically, we design an elastic feature extraction (EFE) module that serves as a basic unit for architecture search, which expands seamlessly alongside both the width and depth of the network for efficient feature extraction. Based on the EFE module, we devise a searching space, which is encoded into a supernet to provide a wide number of latent network structures for a particular point cloud task. To fully optimize the weights of the supernet, we propose a weight coupling sandwich rule that samples the largest, smallest, and multiple medium models at each iteration and fuses their gradients to update the supernet. Furthermore, we present a united gradient adjustment algorithm that mitigates gradient conflict induced by distinct gradient directions of sampled models and supernet, thus expediting the convergence of the supernet and assuring that it can be comprehensively trained. Pursuant to the provided techniques, the trained supernet enables a multitude of subnets to be incredibly well-optimized. Finally, we conduct an evolutionary search for the supernet under resource constraints to find promising architectures for different tasks. Experimentally, the searched Point-NAS with weights inherited from the supernet realizes outstanding results across a variety of benchmarks. i.e., 94.2% and 88.9% overall accuracy under ModelNet40 and ScanObjectNN, 68.6% mIoU under S3DIS, 63.6% and 69.3% mAP@0.25 under SUN RGB-D and ScanNet V2 datasets.

Customized Cross-device Neural Architecture Search with Images

Search-time Efficient Device Constraints-Aware Neural Architecture Search

Generalized Global Ranking-Aware Neural Architecture Ranker for Efficient Image Classifier Search

Resource-Aware Federated Neural Architecture Search over Heterogeneous Mobile Devices

An Adaptive Neural Architecture Search Design for Collaborative Edge-Cloud Computing

Hardware-Aware NAS Framework with Layer Adaptive Scheduling on Embedded System

MODULARNAS: TOWARDS MODULARIZED AND REUSABLE NEURAL ARCHITECTURE SEARCH

FBNetV5: Neural Architecture Search for Multiple Tasks in One Run

LightNAS: on Lightweight and Scalable Neural Architecture Search for Embedded Platforms

One Proxy Device Is Enough for Hardware-Aware Neural Architecture Search

EFNAS: Efficient Federated Neural Architecture Search Across AIoT Devices

EAT-NAS: Elastic Architecture Transfer for Accelerating Large-scale Neural Architecture Search

HSCoNAS: Hardware-Software Co-Design of Efficient DNNs Via Neural Architecture Search

Hardware/Software Co-Exploration of Neural Architectures.

Point-NAS: A Novel Neural Architecture Search Framework for Point Cloud Analysis.

InstaNAS: Instance-aware Neural Architecture Search

Neural Architecture Search over Decentralized Data.

AutoSpace: Neural Architecture Search with Less Human Interference

DDPNAS: Efficient Neural Architecture Search Via Dynamic Distribution Pruning

XC-NAS: A New Cellular Encoding Approach for Neural Architecture Search of Multi-path Convolutional Neural Networks

Multinomial Distribution Learning for Effective Neural Architecture Search