Abstract:This paper introduces a novel Particle Swarm Optimization (RLPSO) algorithm based on reinforcement learning, embodying a fundamental symmetry between global and local search processes. This symmetry aims at addressing the trade-off issue between convergence speed and diversity in traditional algorithms. Traditional Particle Swarm Optimization (PSO) algorithms often struggle to maintain good convergence speed and particle diversity when solving multi-modal function problems. To tackle this challenge, we propose a new algorithm that incorporates the principles of reinforcement learning, enabling particles to intelligently learn and adjust their behavior for better convergence speed and richer exploration of the search space. This algorithm guides particle learning behavior through online updating of a Q-table, allowing particles to selectively learn effective information from other particles and dynamically adjust their strategies during the learning process, thus finding a better balance between convergence speed and diversity. The results demonstrate the superior performance of this algorithm on 16 benchmark functions of the CEC2005 test suite compared to three other algorithms. The RLPSO algorithm can find all global optimum solutions within a certain error range on all 16 benchmark functions, exhibiting outstanding performance and better robustness. Additionally, the algorithm's performance was tested on 13 benchmark functions from CEC2017, where it outperformed six other algorithms by achieving the minimum value on 11 benchmark functions. Overall, the RLPSO algorithm shows significant improvements and advantages over traditional PSO algorithms in aspects such as local search strategy, parameter adaptive adjustment, convergence speed, and multi-modal problem handling, resulting in better performance and robustness in solving optimization problems. This study provides new insights and methods for the further development of Particle Swarm Optimization algorithms.

Particle Swarm Optimization Based on a Novel Evaluation of Diversity

A Modified Particle Swarm Optimizer With A Novel Operator

Multi-technique diversity-based particle-swarm optimization

Enhancing Particle Swarm Optimization via probabilistic models

A Fast Multi-Objective Particle Swarm Optimization Based on Dynamic Exchange Strategy

A stochastic scattering particle swarm optimizer

AMPSO: Artificial Multi-Swarm Particle Swarm Optimization

A Dual-Competition-Based Particle Swarm Optimizer for Large-Scale Optimization

Analyzing and controlling diversity in quantum-behaved particle swarm optimization

Improving the Diversity of PSO for an Engineering Inverse Problem Using Adaptive Inertia Weight

A New Approach To Improve Particle Swarm Optimization

Improved Novel Particle Swarm Optimization Algorithm

A New Fuzzy Particle Swarm Optimization Based on Population Diversity.

Exploratory Study of Sorting Particle Swarm Optimizer for Multiobjective Design Optimization

A Quantum-Based Particle Swarm Optimization Algorithm Applied to Inverse Problems

A Particle Swarm Optimization-Based Method For Multiobjective Design Optimizations

Research on hybrid strategy Particle Swarm Optimization algorithm and its applications

[Pleural metastasis (2003 update)].

A Novel Reinforcement Learning-Based Particle Swarm Optimization Algorithm for Better Symmetry between Convergence Speed and Diversity

Pyramid particle swarm optimization with novel strategies of competition and cooperation

Quantum particle swarm optimization algorithm based on diversity migration strategy