Abstract:Data-efficient image classification is a challenging task that aims to solve image classification using small training data. Neural network-based deep learning methods are effective for image classification, but they typically require large-scale training data and have major limitations such as requiring expertise to design network architectures and having poor interpretability. Evolutionary deep learning is a recent hot topic that combines evolutionary computation with deep learning. However, most evolutionary deep learning methods focus on evolving architectures of neural networks, which still suffer from limitations such as poor interpretability. To address this, this paper proposes a new genetic programming-based evolutionary deep learning approach to data-efficient image classification. The new approach can automatically evolve variable-length models using many important operators from both image and classification domains. It can learn different types of image features from colour or gray-scale images, and construct effective and diverse ensembles for image classification. A flexible multi-layer representation enables the new approach to automatically construct shallow or deep models/trees for different tasks and perform effective transformations on the input data via multiple internal nodes. The new approach is applied to solve five image classification tasks with different training set sizes. The results show that it achieves better performance in most cases than deep learning methods for data-efficient image classification. A deep analysis shows that the new approach has good convergence and evolves models with high interpretability, different lengths/sizes/shapes, and good transferability.

Impacts of Darwinian Evolution on Pre-trained Deep Neural Networks

Is it conceivable that neurogenesis, neural Darwinism, and species evolution could all serve as inspiration for the creation of evolutionary deep neural networks?

Multiobjective Visual Evolutionary Neural Network and Related Convolutional Neural Network Optimization

Evolving Deep Convolutional Neural Networks for Image Classification

Genetic Programming-Based Evolutionary Deep Learning for Data-Efficient Image Classification

A Gradient-Guided Evolutionary Approach to Training Deep Neural Networks

Evolutionary Programming Based Deep Learning Feature Selection and Network Construction for Visual Data Classification

Deep Neural Networks and the Tree of Life

Seeing eye-to-eye? A comparison of object recognition performance in humans and deep convolutional neural networks under image manipulation

Deep neural networks: a new framework for modelling biological vision and brain information processing

Generative NeuroEvolution for Deep Learning

Evolving Deep Neural Networks via Cooperative Coevolution With Backpropagation

Neuroevolution in Deep Neural Networks: Current Trends and Future Challenges

Enhancing Deep Neural Network Corruption Robustness using Evolutionary Algorithm.

Brain-like emergent properties in deep networks: impact of network architecture, datasets and training

Exploring the Imposition of Synaptic Precision Restrictions For Evolutionary Synthesis of Deep Neural Networks

Adaptively Transferring Deep Neural Networks with a Hybrid Evolution Strategy

Finding Better Topologies for Deep Convolutional Neural Networks by Evolution

Darwinian Model Upgrades: Model Evolving with Selective Compatibility

EvoDCNN: An evolutionary deep convolutional neural network for image classification

Exploring the Brain-like Properties of Deep Neural Networks: A Neural Encoding Perspective