Abstract:Convolutional neural networks (CNNs) are the backbones of deep learning paradigms for numerous vision tasks. Early advancements in CNN architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network design process and generating task-dependent architectures. While existing approaches have achieved competitive performance in image classification, they are not well suited to problems where the computational budget is limited for two reasons: 1) the obtained architectures are either solely optimized for classification performance, or only for one deployment scenario and 2) the search process requires vast computational resources in most approaches. To overcome these limitations, we propose an evolutionary algorithm for searching neural architectures under multiple objectives, such as classification performance and floating point operations (FLOPs). The proposed method addresses the first shortcoming by populating a set of architectures to approximate the entire Pareto frontier through genetic operations that recombine and modify architectural components progressively. Our approach improves computational efficiency by carefully down-scaling the architectures during the search as well as reinforcing the patterns commonly shared among past successful architectures through Bayesian model learning. The integration of these two main contributions allows an efficient design of architectures that are competitive and in most cases outperform both manually and automatically designed architectures on benchmark image classification datasets: CIFAR, ImageNet, and human chest X-ray. The flexibility provided from simultaneously obtaining multiple architecture choices for different compute requirements further differentiates our approach from other methods in the literature.

Using Cartesian Genetic Programming Approach with New Crossover Technique to Design Convolutional Neural Networks

Cartesian Genetic Programming Approach for Designing Convolutional Neural Networks

GACNN: Training Deep Convolutional Neural Networks with Genetic Algorithm

Continuous Cartesian Genetic Programming based representation for Multi-Objective Neural Architecture Search

Neural Architecture Search based on Cartesian Genetic Programming Coding Method

Designing Convolutional Neural Network Architecture Using Genetic Algorithms

Automatically Designing CNN Architectures Using the Genetic Algorithm for Image Classification

Genetic CNN

Multiobjective Evolutionary Design of Deep Convolutional Neural Networks for Image Classification

A genetic programming approach to the automated design of CNN models for image classification and video shorts creation

Automatically designing CNN architectures using genetic algorithm for image classification

A Hybrid GA-PSO Method for Evolving Architecture and Short Connections of Deep Convolutional Neural Networks

Improved Search in Neuroevolution Using a Neural Architecture Classifier With the CNN Architecture Encoding as Feature Vector

Evolutionary convolutional neural network for image classification based on multi-objective genetic programming with leader–follower mechanism

An Aggressive Genetic Programming Approach for Searching Neural Network Structure Under Computational Constraints

A Hybrid DE Approach to Designing CNN for Image Classification

Neural Architecture Search for Text Classification with Limited Computing Resources Using Efficient Cartesian Genetic Programming

Safe Crossover of Neural Networks Through Neuron Alignment

Hybrid Genetic Algorithm and Hill Climbing Optimization for the Neural Network

Automated CNN Architectural Design: A Simple and Efficient Methodology for Computer Vision Tasks