Abstract:As an advanced artificial intelligence technique for solving learning problems, deep learning (DL) has achieved great success in many real-world applications and attracted increasing attention in recent years. However, as the performance of DL depends on many factors such as the architecture and hyperparameters, how to optimize DL has become a hot research topic in the field of DL and artificial intelligence. Evolutionary computation (EC), including evolutionary algorithm and swarm intelligence, is a kind of efficient and intelligent optimization methodology inspired by the mechanisms of biological evolution and behaviors of swarm organisms. Therefore, a large number of researches have proposed EC algorithms to optimize DL, so called evolutionary deep learning (EDL), which have obtained promising results. Given the great progress and rapid development of EDL in recent years, it is quite necessary to review these developments in order to summarize previous research experiences and knowledge, as well as provide references to benefit the development of more researches and applications. For this aim, this paper categorizes existing works in a two-level taxonomy. The higher level includes four categories based on when the EC can be adopted in optimizing the DL, which are the four procedures of the whole DL lifetime, including data processing, model search, model training, and model evaluation and utilization. In the lower level, related works in each category are further classified according to the functionality and the aim of using EC in the corresponding DL procedure, i.e., why using EC in this DL procedure. As a result, the taxonomy can clearly show how an EC algorithm can be used to optimize and improve DL. Moreover, this survey also discusses the potential research directions to provide the prospect of EDL in the future.

A Survey on Unbalanced Classification: How Can Evolutionary Computation Help?

Gender Classification Based On Evolutionary Extreme Learning Machine

Research on methodology of evolutionary computing

Optimal Weighted Extreme Learning Machine for Imbalanced Learning with Differential Evolution [research Frontier]

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

A survey on imbalanced learning: latest research, applications and future directions

A Survey on Evolutionary Computation for Computer Vision and Image Analysis: Past, Present, and Future Trends

Survey on Evolutionary Deep Learning: Principles, Algorithms, Applications and Open Issues

Advanced techniques in evolutionary algorithms with applications to power systems

A Survey on Distributed Evolutionary Computation

Review of Classification Methods on Unbalanced Data Sets

Evolutionary deep learning: A survey

Evolutionary computation for solving search-based data analytics problems

Differential Evolution: A Survey on Their Operators and Variants

Reinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities

A hybrid ensemble and evolutionary algorithm for imbalanced classification and its application on bioinformatics

Imbalanced Data Classification:A Survey and Experiments in Medical Domain

A Survey of Methods for Managing the Classification and Solution of Data Imbalance Problem

The application of evolutionary computation in generative adversarial networks (GANs): a systematic literature survey

Survey on extreme learning machines for outlier detection

Towards Theoretically Grounded Evolutionary Learning.