Abstract:The particle swarm optimization (PSO) algorithm has been one of the most effective methods for solving various engineering optimization problems. Most existing PSO variants frequently use fixed operators, the adoption of a fixed operator learning mode may restrict the intelligence level of each particle, thus reducing the performance of PSO in solving optimization issues with complicated fitness landscapes. To address single goal real-parameter numerical optimization while overcoming the above shortcoming, this paper proposes a reinforcement learning-based particle swarm optimization with neighborhood differential mutation strategy (NRLPSO). In NRLPSO, a dynamic oscillation inertial weight (DOW) strategy that provides particles with dynamic adjustment ability in different situations is designed. To resolve the operator selection conundrum of exploration and exploitation, a reinforcement learning-based velocity vector generation (VRL) strategy is developed. At each iteration, particles select the velocity update model based on reinforcement learning, and VRL helps to thoroughly search the problem space. A velocity updating mechanism based on cosine similarity (VCS) is applied to control the velocity learning mode to determine more promising solutions. Furthermore, to alleviate the problem of premature convergence, a local update strategy with neighborhood differential mutation (NDM) is employed to increase the diversity of the algorithm. To verify the efficiency of the proposed algorithm, the CEC2017 and CEC2022 test suites are implemented, and nine classic or state-of-the-art PSO variants are comprehensively tested.The experimental results show that NRLPSO outperforms the popular PSO variants in terms of convergence speed and accuracy. Since NRLPSO utilizes the DE mutations, it is compared with the representative LSHADE variant algorithm - LSHADE_SPACMA. Although LSHADE_SPACMA is better than NRLPSO concerning algorithm stability and convergence accuracy, we will refine our work in the future to enhance the performance in all aspects.

Neighborhood-based particle swarm optimization with discrete crossover for nonlinear equation systems

Solving nonlinear equation systems based on evolutionary multitasking with neighborhood-based speciation differential evolution

A Hybrid Non-Linear Time-Varying Double-Weighted Particle Swarm Optimization for Solving Non-Convex Combined Environmental Economic Dispatch Problem

Fuzzy Neighborhood-Based Differential Evolution with Orientation for Nonlinear Equation Systems.

Chaotic Noise-Based Particle Swarm Optimization Algorithm for Solving System of Nonlinear Equations

Solving Nonlinear Equations System With Dynamic Repulsion-Based Evolutionary Algorithms

A neighborhood information-based adaptive differential evolution for solving complex nonlinear equation system model

Evolutionary multitasking for solving nonlinear equation systems

Multi-population cooperative teaching–learning-based optimization for nonlinear equation systems

Historical knowledge transfer driven self-adaptive evolutionary multitasking algorithm with hybrid resource release for solving nonlinear equation systems

A knowledge transfer-based adaptive differential evolution for solving nonlinear equation systems

A decomposition-based differential evolution with reinitialization for nonlinear equations systems

Finding Multiple Roots of Nonlinear Equation Systems Via a Repulsion-Based Adaptive Differential Evolution

A Co-Evolutionary Dual Niching Differential Evolution Algorithm for Nonlinear Equation Systems Optimization

Reinforcement learning-based particle swarm optimization with neighborhood differential mutation strategy

A Clustering-Based Differential Evolution with Different Crowding Factors for Nonlinear Equations System.

Neural Network Algorithm for Solving Nonlinear Equation Systems.

Exploratory Study of Sorting Particle Swarm Optimizer for Multiobjective Design Optimization

An Improved Particle Swarm Optimization Method for Nonlinear Optimization

Solving nonlinear equation systems via clustering-based adaptive speciation differential evolution

An Adaptive Dynamic Multi-Swarm Particle Swarm Optimization with Stagnation Detection and Spatial Exclusion for Solving Continuous Optimization Problems