Abstract:Convolutional neural networks (CNNs) are the backbones of deep learning paradigms for numerous vision tasks. Early advancements in CNN architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network design process and generating task-dependent architectures. While existing approaches have achieved competitive performance in image classification, they are not well suited to problems where the computational budget is limited for two reasons: 1) the obtained architectures are either solely optimized for classification performance, or only for one deployment scenario and 2) the search process requires vast computational resources in most approaches. To overcome these limitations, we propose an evolutionary algorithm for searching neural architectures under multiple objectives, such as classification performance and floating point operations (FLOPs). The proposed method addresses the first shortcoming by populating a set of architectures to approximate the entire Pareto frontier through genetic operations that recombine and modify architectural components progressively. Our approach improves computational efficiency by carefully down-scaling the architectures during the search as well as reinforcing the patterns commonly shared among past successful architectures through Bayesian model learning. The integration of these two main contributions allows an efficient design of architectures that are competitive and in most cases outperform both manually and automatically designed architectures on benchmark image classification datasets: CIFAR, ImageNet, and human chest X-ray. The flexibility provided from simultaneously obtaining multiple architecture choices for different compute requirements further differentiates our approach from other methods in the literature.

Evolutionary Compact Embedding for Large-Scale Image Classification

Gender Classification Based On Evolutionary Extreme Learning Machine

Genetic Programming-Based Evolutionary Deep Learning for Data-Efficient Image Classification

Large-Margin Learning of Compact Binary Image Encodings

Evolving Deep Convolutional Neural Networks for Image Classification

Parallel Compact Differential Evolution for Optimization Applied to Image Segmentation

EvoDCNN: An evolutionary deep convolutional neural network for image classification

A new genetic algorithm based evolutionary neural architecture search for image classification

Evolutionary convolutional neural network for image classification based on multi-objective genetic programming with leader–follower mechanism

A class-incremental learning approach for learning feature-compatible embeddings

Simple-Encoded evolving convolutional neural network and its application to skin disease image classification

Coupled Binary Embedding for Large-Scale Image Retrieval

Evolutionary Simplicial Learning as a Generative and Compact Sparse Framework for Classification

Real-time Memory Efficient Large-pose Face Alignment via Deep Evolutionary Network

FSCIL-EACA: Few-Shot Class-Incremental Learning Network Based on Embedding Augmentation and Classifier Adaptation for Image Classification

Learning Binary Codes and Binary Weights for Efficient Classification

Evolutionary Computation in Action: Feature Selection for Deep Embedding Spaces of Gigapixel Pathology Images

A Hybrid GA-PSO Method for Evolving Architecture and Short Connections of Deep Convolutional Neural Networks

Multiobjective Evolutionary Design of Deep Convolutional Neural Networks for Image Classification

Automatically Evolving Texture Image Descriptors Using the Multitree Representation in Genetic Programming Using Few Instances