Abstract:The expensive optimization problem, widespread in real-world applications, poses great challenges to traditional evolutionary algorithms (EAs) due to its costly evaluations. A lot of investigations have proved that it is a practical way to incorporate surrogate models into EAs to reduce the number of time-consuming evaluations. Although various types of surrogate models from the community of machine learning, such as regression models that approximate the fitness values of candidate solutions or classification models that predict candidate solutions’ category, have been widely applied separately, none of them consistently outperforms the other. Considering the intrinsic consistency of alleviating computational burden to improve the optimization efficiency, this paper introduces a two-layer architecture to integrate regression and classification models and synergize global and local evolution for high-dimensional expensive many-objective optimization problem (EMaOP). To implement this idea, the Kriging model based on incremental learning is utilized to explore the potential promising space. Further, multi local support vector machine (SVM) classifiers assisted improved differential evolution is run by turn with the global search to accelerate convergence. Accordingly, a novel surrogate-assisted EA, named Classification- and Regression-assisted evolutionary algorithm (CR-SAEA), is proposed on this basis. Experimental studies on several benchmark functions with up to 11 objectives and 200 dimensions confirm the effectiveness of the proposed algorithm and its competitiveness against state-of-the-art algorithms.

On Sampling-And-Classification Optimization In Discrete Domains

The sampling-and-learning framework: A statistical view of evolutionary algorithms

AN ADAPTIVE ANT COLONY SYSTEM ALGORITHM FOR CONTINUOUS-SPACE OPTIMIZATION PROBLEMS

An On-Line Learning Approach with Support Vector Dormain Classifier

Derivative-Free Optimization Via Classification.

An Improved Multiple Single Objective Pareto Sampling Algorithm Applied to Many-Objective Inverse Problems

On the Effectiveness of Sampling for Evolutionary Optimization in Noisy Environments

An Adaptive Sampling Algorithm for Simulation-Based Optimization With Descriptive Complexity Preference

A classification and regression assisted optimization algorithm for high-dimensional expensive many-objective problems

Revisiting Discrete Soft Actor-Critic

An adaptive sampling algorithm for simulation-based optimization with descriptive complexity constraints

A low-sample-count, high-precision Pareto front adaptive sampling algorithm based on multi-criteria and Voronoi

A Compact Cat Swarm Optimization Algorithm Based on Small Sample Probability Model

A novel chaotic and neighborhood search-based artificial bee colony algorithm for solving optimization problems

On Sampling Efficiency Optimization in Constrained Reinforcement Learning*

Subsampled Optimization: Statistical Guarantees, Mean Squared Error Approximation, and Sampling Method

Data-driven Evolutionary Sampling Optimization Forexpensive Problems

Evolutionary Sampling Agent for Expensive Problems

Enabling the extended compact genetic algorithm for real-parameter optimization by using adaptive discretization

A Classifier-Assisted Level-Based Learning Swarm Optimizer for Expensive Optimization

Intelligent sampling for surrogate modeling, hyperparameter optimization, and data analysis