Abstract:Evolutionary neural architecture search (ENAS) aims to automate the architecture design of deep neural networks (DNNs). In recent years, various ENAS algorithms have been proposed, and their effectiveness has been demonstrated. In practice, most ENAS methods based on genetic algorithms (GAs) use fixed-length encoding strategies because the generated chromosomes can be directly processed by the standard genetic operators (especially the crossover operator). However, the performance of existing ENAS methods with fixed-length encoding strategies can also be improved because the optimal depth is regarded as a known priori. Although variable-length encoding strategies may alleviate this issue, the standard genetic operators are replaced by the developed operators. In this paper, we proposed a framework to bridge this gap and to improve the performance of existing ENAS methods based on GAs. First, the fixed-length chromosomes were transformed into variable-length chromosomes with the encoding rules of the original ENAS methods. Second, an encoder was proposed to encode variable-length chromosomes into fixed-length representations that can be efficiently processed by standard genetic operators. Third, a decoder cotrained with the encoder was adopted to decode those processed high-dimensional representations which cannot directly describe architectures into original chromosomal forms. Overall, the performances of existing ENAS methods with fixed-length encoding strategies and variable-length encoding strategies have both improved by the proposed framework, and the effectiveness of the framework was justified through experimental results. Moreover, ablation experiments were performed and the results showed that the proposed framework does not negatively affect the original ENAS methods.

Bridge the Gap Between Fixed-Length and Variable-Length Evolutionary Neural Architecture Search Algorithms

Evolutionary Architecture Search Via Adaptive Parameter Control and Gene Potential Contribution

An Evolutionary Neural Architecture Search Method based on Performance Prediction and Weight Inheritance

Evolutionary Neural Architecture Search Based on Evaluation Correction and Functional Units

Asynchronous Evolution of Deep Neural Network Architectures

Sampled Training and Node Inheritance for Fast Evolutionary Neural Architecture Search

A Survey of Advances in Evolutionary Neural Architecture Search

Multiple Population Alternate Evolution Neural Architecture Search

Evolutionary Neural Network Architecture Search

Benchmarking Analysis of Evolutionary Neural Architecture Search

Efficient Evolutionary Neural Architecture Search Based on Hybrid Search Space

A Fast Evolutionary Knowledge Transfer Search for Multiscale Deep Neural Architecture

AS-NAS: Adaptive Scalable Neural Architecture Search with Reinforced Evolutionary Algorithm for Deep Learning.

Automated Design of CNN Architecture Based on Efficient Evolutionary Search

Accelerating Evolutionary Neural Architecture Search Via Multi-Fidelity Evaluation

ENAO: Evolutionary Neural Architecture Optimization in the Approximate Continuous Latent Space of a Deep Generative Model

BenchENAS: A Benchmarking Platform for Evolutionary Neural Architecture Search

Architecture search of accurate and lightweight CNNs using genetic algorithm

Analysis of Expected Hitting Time for Designing Evolutionary Neural Architecture Search Algorithms

A First Step Towards Runtime Analysis of Evolutionary Neural Architecture Search

Toward Evolutionary Multitask Convolutional Neural Architecture Search