Abstract:The success of DL can be attributed to hours of parameter and architecture tuning by human experts. Neural Architecture Search (NAS) techniques aim to solve this problem by automating the search procedure for DNN architectures making it possible for non-experts to work with DNNs. Specifically, One-shot NAS techniques have recently gained popularity as they are known to reduce the search time for NAS techniques. One-Shot NAS works by training a large template network through parameter sharing which includes all the candidate NNs. This is followed by applying a procedure to rank its components through evaluating the possible candidate architectures chosen randomly. However, as these search models become increasingly powerful and diverse, they become harder to understand. Consequently, even though the search results work well, it is hard to identify search biases and control the search progression, hence a need for explainability and human-in-the-loop (HIL) One-Shot NAS. To alleviate these problems, we present NAS-Navigator, a visual analytics (VA) system aiming to solve three problems with One-Shot NAS; explainability, HIL design, and performance improvements compared to existing state-of-the-art (SOTA) techniques. NAS-Navigator gives full control of NAS back in the hands of the users while still keeping the perks of automated search, thus assisting non-expert users. Analysts can use their domain knowledge aided by cues from the interface to guide the search. Evaluation results confirm the performance of our improved One-Shot NAS algorithm is comparable to other SOTA techniques. While adding Visual Analytics (VA) using NAS-Navigator shows further improvements in search time and performance. We designed our interface in collaboration with several deep learning researchers and evaluated NAS-Navigator through a control experiment and expert interviews.

MNGNAS: Distilling Adaptive Combination of Multiple Searched Networks for One-Shot Neural Architecture Search

Distribution Consistent Neural Architecture Search

Multi-shot NAS for Discovering Adversarially Robust Convolutional Neural Architectures at Targeted Capacities

One-Shot Neural Architecture Search: Maximising Diversity to Overcome Catastrophic Forgetting

One-Shot Neural Architecture Search Through A Posteriori Distribution Guided Sampling.

Prioritized Architecture Sampling with Monto-Carlo Tree Search

BayesNAS: A Bayesian Approach for Neural Architecture Search

Efficient Novelty-Driven Neural Architecture Search

Posterior-Guided Neural Architecture Search

Block-wisely Supervised Neural Architecture Search with Knowledge Distillation

Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift

Overcoming Multi-Model Forgetting in One-Shot NAS With Diversity Maximization

Multinomial Distribution Learning for Effective Neural Architecture Search

M²NAS: Joint Neural Architecture Optimization System with Network Transmission

One-Shot Neural Architecture Search Via Novelty Driven Sampling

Single Path One-Shot Neural Architecture Search with Uniform Sampling

Balanced Quantum Neural Architecture Search

NAS-Navigator: Visual Steering for Explainable One-Shot Deep Neural Network Synthesis

Efficient Search of Multiple Neural Architectures with Different Complexities via Importance Sampling

HEP-NAS: Towards Efficient Few-shot Neural Architecture Search via Hierarchical Edge Partitioning

Towards a configurable and non-hierarchical search space for NAS