A Multi-operator Ensemble LSHADE with Restart and Local Search Mechanisms for Single-objective Optimization

Dikshit Chauhan,Anupam Trivedi,Shivani
2024-09-24
Abstract:In recent years, multi-operator and multi-method algorithms have succeeded, encouraging their combination within single frameworks. Despite promising results, there remains room for improvement as only some evolutionary algorithms (EAs) consistently excel across all optimization problems. This paper proposes mLSHADE-RL, an enhanced version of LSHADE-cnEpSin, which is one of the winners of the CEC 2017 competition in real-parameter single-objective optimization. mLSHADE-RL integrates multiple EAs and search operators to improve performance further. Three mutation strategies such as DE/current-to-pbest-weight/1 with archive, DE/current-to-pbest/1 without archive, and DE/current-to-ordpbest-weight/1 are integrated in the original LSHADE-cnEpSin. A restart mechanism is also proposed to overcome the local optima tendency. Additionally, a local search method is applied in the later phase of the evolutionary procedure to enhance the exploitation capability of mLSHADE-RL. mLSHADE-RL is tested on 30 dimensions in the CEC 2024 competition on single objective bound constrained optimization, demonstrating superior performance over other state-of-the-art algorithms in producing high-quality solutions across various optimization scenarios.
Neural and Evolutionary Computing
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: although existing evolutionary algorithms (EAs) perform well on certain optimization problems, no single algorithm can maintain superior performance in all types of optimization problems. In particular, in single - objective optimization problems, the differential evolution (DE) algorithm, although it performs well in continuous optimization problems, its performance is restricted by multiple factors, such as being prone to getting trapped in local optimal solutions and lacking diversity. To solve these problems, this paper proposes an improved multi - operator integrated algorithm, mLSHADE - RL, which aims to improve the optimization performance by combining multiple evolutionary algorithms and search strategies. Specifically, mLSHADE - RL makes the following improvements based on LSHADE - cnEpSin: 1. **Three mutation strategies are introduced**: - DE/current - to - pbest - weight/1 with archive - DE/current - to - pbest/1 without archive - DE/current - to - ordpbest - weight/1 2. **A restart mechanism is added**: It is used to overcome the problem that the algorithm gets trapped in local optimal solutions during the evolution process. The restart mechanism includes two methods, horizontal crossover and vertical crossover, to enhance the global search ability and reduce blind spots. 3. **A local search method is applied in the later stage**: The sequential quadratic programming (SQP) method is applied in the later stage of evolution to enhance the exploitation ability of the algorithm and find higher - quality solutions. 4. **Parameter adaptive adjustment**: The normal distribution and Cauchy distribution are used to dynamically adjust the scaling factor \( F \) and the crossover probability \( CR \), ensuring that the algorithm can maintain good performance at different evolution stages. Through these improvements, mLSHADE - RL can show better performance than other advanced algorithms in single - objective bound - constrained optimization problems in the CEC 2024 competition, especially when dealing with high - dimensional and complex optimization problems, and can produce high - quality solutions. In summary, the main purpose of this paper is to solve the limitations encountered by existing differential evolution algorithms in single - objective optimization problems by designing a more robust and effective multi - operator integrated algorithm, and to verify its superior performance in actual tests.