Abstract:Constrained multi-objective optimization problems involve the optimization of multiple conflicting objectives simultaneously subject to a number of constraints, which pose a great challenge for the existing algorithms. When utilizing evolutionary algorithms to solve them, the constraint handling technique (CHT) plays a pivotal role in the environmental selection. Several CHTs, such as penalty functions, superiority of feasible solutions, and ϵ-constraint methods, have been developed. However, there are still some issues with the existing methods. On the one hand, different CHTs are typically better suited to specific problem and selecting the most appropriate CHT for a given problem is crucial. On the other hand, the suitability of CHTs may vary throughout different stages of the optimization process. Regrettably, limited attention has been given to the adaptive selection of CHTs. In order to address this research gap, we develop an adaptive CHT selection method based on deep reinforcement learning, allowing for the selection of CHTs that are tailored to different evolutionary states. In the proposed method, we adopt the deep Q-learning network to evaluate the impact of various CHTs and operators on the population state during evolution. Through a dynamic evaluation, the network adaptively outputs the most appropriate CHT and operator portfolio based on the current state of the population. Specifically, we propose novel state representation and reward calculation methods to accurately capture the performance of diverse actions across varying evolutionary states. Furthermore, to enhance network training, we introduce a two-stage training method that facilitates the collection of diverse samples. Moreover, this adaptive selection method can be easily integrated into the existing methods. The proposed algorithm is tested on 37 test problems, the optimal results can be achieved on 19 instances in terms of the inverted generational distance metric. Experimental results verify the proposed method generalizes well to different types of problems.

A Competitive and Cooperative Evolutionary Framework for Ensemble of Constraint Handling Techniques

On the Cooperation Between Evolutionary Algorithms and Constraint Handling Techniques.

Evolutionary Constrained Optimization with Hybrid Constraint-Handling Technique

A Combined Constraint Handling Framework: an Empirical Study

Adaptive Constraint Handling Technique Selection for Constrained Multi-Objective Optimization

A Voting-Mechanism-Based Ensemble Framework for Constraint Handling Techniques

Voting Enabled Dynamic Constraint Portfolios for Evolutionary Multi-Objective Optimization

Dynamic Ε-Multilevel Hierarchy Constraint Optimization with Adaptive Boundary Constraint Handling Technology

An Effective Ensemble Framework for Multiobjective Optimization

Competitive-Cooperative Coevolution for Large Scale Optimization with Computation Resource Allocation Pool

An Ensemble Framework of Evolutionary Algorithm for Constrained Multi-Objective Optimization.

Ensemble-based constraint handling in multiobjective optimization

A Coevolutionary Algorithm Based on Constraints Decomposition for Constrained Multi-Objective Optimization Problems

A Multiobjective Differential Evolution Algorithm for Constrained Optimization

Constrained Optimization Evolutionary Algorithms

A Coevolutionary Framework for Constrained Multiobjective Optimization Problems

Two-stage bidirectional coevolutionary algorithm for constrained multi-objective optimization

Comparison of Two Constraint Handling Techniques: an Empirical Study

A Multi-Optimizer Cooperative Coevolution Method For Large Scale Optimization

An Adaptive Two-Population Evolutionary Algorithm for Constrained Multi-Objective Optimization Problems

Constraint-handling Techniques Based on Evolutionary Algorithms