Abstract:Evolutionary neural architecture search (ENAS) aims to automate the architecture design of deep neural networks (DNNs). In recent years, various ENAS algorithms have been proposed, and their effectiveness has been demonstrated. In practice, most ENAS methods based on genetic algorithms (GAs) use fixed-length encoding strategies because the generated chromosomes can be directly processed by the standard genetic operators (especially the crossover operator). However, the performance of existing ENAS methods with fixed-length encoding strategies can also be improved because the optimal depth is regarded as a known priori. Although variable-length encoding strategies may alleviate this issue, the standard genetic operators are replaced by the developed operators. In this paper, we proposed a framework to bridge this gap and to improve the performance of existing ENAS methods based on GAs. First, the fixed-length chromosomes were transformed into variable-length chromosomes with the encoding rules of the original ENAS methods. Second, an encoder was proposed to encode variable-length chromosomes into fixed-length representations that can be efficiently processed by standard genetic operators. Third, a decoder cotrained with the encoder was adopted to decode those processed high-dimensional representations which cannot directly describe architectures into original chromosomal forms. Overall, the performances of existing ENAS methods with fixed-length encoding strategies and variable-length encoding strategies have both improved by the proposed framework, and the effectiveness of the framework was justified through experimental results. Moreover, ablation experiments were performed and the results showed that the proposed framework does not negatively affect the original ENAS methods.

Searching Search Spaces: Meta-evolving a Geometric Encoding for Neural Networks

Efficient Evolutionary Neural Architecture Search Based on Hybrid Search Space

Evolutionary NAS with Gene Expression Programming of Cellular Encoding

Neural Network Architecture Search with Differentiable Cartesian Genetic Programming for Regression

Neural Network Training Using Genetic Algorithm with a Novel Binary Encoding

An Aggressive Genetic Programming Approach for Searching Neural Network Structure Under Computational Constraints

Evolving Novel Gene Regulatory Networks for Structural Engineering Designs

Neural Architecture Search based on Cartesian Genetic Programming Coding Method

Bridge the Gap Between Fixed-Length and Variable-Length Evolutionary Neural Architecture Search Algorithms

Improving greedy local search methods by switching the search space

Meta-Learning an Evolvable Developmental Encoding

Evolving Dynamic Change and Exchange of Genotype Encoding in Genetic Algorithms for Difficult Optimization Problems

Guiding Genetic Programming with Graph Neural Networks

Evolving Efficient Genetic Encoding for Deep Spiking Neural Networks

Improved Search in Neuroevolution Using a Neural Architecture Classifier With the CNN Architecture Encoding as Feature Vector

A genetic programming approach to the automated design of CNN models for image classification and video shorts creation

NeuroLGP-SM: Scalable Surrogate-Assisted Neuroevolution for Deep Neural Networks

A Novel Splicing/decomposable Binary Encoding and Its Operators for Genetic and Evolutionary Algorithms.

An ensemble learning interpretation of geometric semantic genetic programming

Evolutionary Neural Networks Based on GT Algorithm

Efficiently evolving programs through the search for novelty