Abstract:Many real-world engineering and industrial optimization problems involve expensive function evaluations (e.g., computer simulations and physical experiments) and possess a large number of decision variables. In many such scenarios, the optimization task has to be performed based on the previously available simulation data only. Also, to cut down the experimental expenses, it has been an open-ended research area to approximate these expensive function evaluations using a less expensive data-driven model trained on historical offline data collected from various expensive simulations. Offline data-driven evolutionary algorithms (DDEAs) efficiently use available data and surrogates to guide the optimization process. However, while building the surrogate models from limited offline data, the existing methods lack properties like reliability, scalability, and robustness. To address these challenges, in this work, we have proposed novel active learning with a reliability sampling-based evolutionary framework, where an ensemble of heterogeneous RBFNs (radial basis function neural networks), acting as an active learner, can gain insightful knowledge from unlabeled data. Consequently, a novel reliability sampling for selecting query individuals is also introduced for model management. It selects the utmost reliable candidate solutions for which the ensemble members have the least conflict to enrich the training data. These reliable query individuals are labeled as a weighted sum of RBFNs output, where the RBFN model with less error has more weightage. Furthermore, this article discusses the theoretical idea from which reliability sampling-based query strategy is inspired and provides the complexity analysis. Moreover, the results on five benchmark problems and CES 2017 test suit with 10, 30, 50, and 100-dimensional decision variables show that the proposed algorithm has achieved highly competitive results compared with four state-of-the-art offline DDEAs and three online DDEAs. Finally, our algorithm is applied to an offline data-driven expensive engineering optimization problem-aerodynamic airfoil design optimization from offline data to verify its efficacy on real-world problems. The experimental results demonstrate that the proposed active learning-based framework provides a highly reliable, efficient, and robust surrogate to assist evolutionary algorithms in solving offline data-driven expensive engineering problems.

Symbolic Regression-Assisted Offline Data-Driven Evolutionary Computation

Offline Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles

Data-Driven Evolutionary Algorithm With Perturbation-Based Ensemble Surrogates

Boosting Data-Driven Evolutionary Algorithm With Localized Data Generation

ALeRSa-DDEA: active learning with reliability sampling-based evolutionary algorithm framework for solving offline data-driven expensive engineering optimization

Offline Data -Driven Evolutionary Optimization Based on Model Selection

Island-Based Evolutionary Computation with Diverse Surrogates and Adaptive Knowledge Transfer for High-Dimensional Data-Driven Optimization

Offline Data-Driven Optimization at Scale: A Cooperative Coevolutionary Approach

Regression Versus Classification for Predicting Feasibility in Offline Data- Driven Evolutionary Constrained Optimization.

Offline data-driven optimization based on dual-scale surrogate ensemble

Trimmed Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles

An Offline Weighted-Bagging Data-Driven Evolutionary Algorithm with Data Generation Based on Clustering

Data-driven Evolutionary Sampling Optimization Forexpensive Problems

Social Learning Particle Swarm Optimization with Two-Surrogate Collaboration for Offline Data-Driven Multiobjective Optimization

A Data-Driven Evolutionary Algorithm with Multi-Evolutionary Sampling Strategy for Expensive Optimization

A Surrogate Model Assisted Evolutionary Algorithm for Computationally Expensive Design Optimization Problems with Discrete Variables.

Data-Driven Surrogate-Assisted Evolutionary Optimization

Two-Stage Data-Driven Evolutionary Optimization for High-Dimensional Expensive Problems

Contrastive Learning: an Alternative Surrogate for Offline Data-Driven Evolutionary Computation

A two-stage dominance-based surrogate-assisted evolution algorithm for high-dimensional expensive multi-objective optimization

A Data Stream Ensemble Assisted Multifactorial Evolutionary Algorithm for Offline Data-Driven Dynamic Optimization