Abstract:Expensive multiobjective optimization problems pose great challenges to evolutionary algorithms due to their costly evaluation. Building cheap surrogate models to replace the expensive real models has been proved to be a practical way to reduce the number of costly evaluations. Supervised learning techniques from the community of machine learning have been widely applied to build either regressors, which approximate the fitness values of candidate solutions, or classifiers, which estimate the categories of candidate solutions. Considering the characteristics of the data produced in optimization, this article proposes a new surrogate model, called a relation model, for evolutionary multiobjective optimization. Instead of estimating the qualities of candidate solutions directly, the relation model tries to estimate the relationship between a pair of solutions $\langle \mathbf {x}, \mathbf {y}\rangle $ , i.e., $\mathbf {x}$ dominates $\mathbf {y}$ , $\mathbf {x}$ is dominated by $\mathbf {y}$ , or $\mathbf {x}$ is nondominated with $\mathbf {y}$ in the case of multiobjective optimization. To implement this idea, first a balanced training set is prepared, then a classifier is built based on the training data set to learn the relationship, and finally, the classifier with a voting-scoring strategy is applied to estimate the relationship between the candidate solutions and parent solutions. By this way, the promising candidate solutions are recognized and evaluated by the real models. The new approach is applied to three well-known benchmark suites and two real-world applications, and the experimental results suggest that the proposed method outperforms some state-of-the-art methods based on regression and classification models on the given instances.

Learning Objective Adaptation by Correlation-Based Model Reuse

Multi-View Correlated Feature Learning by Uncovering Shared Component.

Adaptive Model Update Strategy for Correlation Filter Trackers.

Exploring Cross-model Neuronal Correlations in the Context of Predicting Model Performance and Generalizability

Preference Based Adaptation for Learning Objectives.

Nonlinear Multi-Model Reuse.

Expensive Multiobjective Optimization by Relation Learning and Prediction

Deep Model Transferability from Attribution Maps

Model Reuse with Domain Knowledge

Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitate

Model Linkage Selection for Cooperative Learning

Transfer Learning with Reconstruction Loss

Fine-grained Correlation Loss for Regression

A Unified View on Solving Objective Mismatch in Model-Based Reinforcement Learning

Handling Varied Objectives by Online Decision Making

On the Versatile Uses of Partial Distance Correlation in Deep Learning

Adversarial Learning-Based Semantic Correlation Representation for Cross-Modal Retrieval

Reusing Pretrained Models by Multi-linear Operators for Efficient Training

Continual Multi-Objective Reinforcement Learning Via Reward Model Rehearsal

The reusability prior: comparing deep learning models without training

UnLearning from Experience to Avoid Spurious Correlations