Abstract:This paper proposes an adaptive two-stage large-scale multi-objective evolutionary algorithm, in which a neural network-based accelerating optimizer is designed in the first stage to speed up the population's convergence and a layer-based competitive swarm optimizer is used in the second stage to maintain the population's diversity by spreading the solutions obtained in the first stage. To properly train the neural network in the first stage, the whole population, i.e., the training data, is evenly divided into two subsets with different qualities based on the dominant relationship between solutions. Then, the paired low-quality solutions and high-quality solutions, respectively, act as the input and the expected output when training the neural network. In this way, the potentially directional improvement information of the evolutionary population can be learned by this neural network, which is used to guide the adopted differential evolution in promising search directions. Once the population is detected to be evolutionarily stagnated in the first stage, the second stage will be activated for remedying the population's diversity. Specifically, the promising solutions gained in the first stage are assigned into four layers with different qualities by sequentially implementing reference vectors-guided sorting and shift-based density estimation. After that, the solutions in low-quality layers can learn from that in high-quality layers in the proposed competitive swarm optimizer, which allows the population to evolve further in appreciable directions while increasing its diversity. Experimental studies validate the performance of the proposed evolutionary large-scale optimizer when compared with eight state-of-the-art algorithms in solving two widely tested benchmark suites of large-scale multi-objective optimization problems with decision variables ranging from 100 to 1000 under a limited computational resource.

Artificial Neural Networks As Feature Extractors in Continuous Evolutionary Optimization.

Representing Experience in Continuous Evolutionary Optimisation Through Problem-tailored Search Operators.

Graph Neural Networks Are Evolutionary Algorithms

A Graph Neural Network Assisted Evolutionary Algorithm for Expensive Multi-Objective Optimization.

DECN: Automated Evolutionary Algorithms Via Evolution Inspired Deep Convolution Network

Research on Continuous Ant Colony Optimization Algorithm and Application in Neural Network Modeling.

Enhancing the Precision of Redundant Data in Feature Extraction by an Improved Evolutionary Algorithm

Neuroevolution in Deep Neural Networks: Current Trends and Future Challenges

Genetic-GNN: Evolutionary architecture search for Graph Neural Networks

Efficacy of Modern Neuro-Evolutionary Strategies for Continuous Control Optimization

Cars: Continuous Evolution For Efficient Neural Architecture Search

ENAO: Evolutionary Neural Architecture Optimization in the Approximate Continuous Latent Space of a Deep Generative Model

A Survey of Advances in Evolutionary Neural Architecture Search

NGDE: A Niching-Based Gradient-Directed Evolution Algorithm for Nonconvex Optimization

A Survey on Evolutionary Construction of Deep Neural Networks.

DECN: Evolution Inspired Deep Convolution Network for Black-box Optimization

The Networked Evolutionary Algorithm: A Network Science Perspective

Evolution Strategies for Continuous Optimization: A Survey of the State-of-the-art

An Adaptive Two-Stage Evolutionary Algorithm for Large-Scale Continuous Multi-Objective Optimization

Journal of Computer Science and Technology: Preface

Beyond Discrete Selection: Continuous Embedding Space Optimization for Generative Feature Selection