Abstract:In large-scale optimization problems, the PSO algorithm based on population information interaction performs well. However, the algorithm typically only uses population information for updating, neglecting potentially useful information during evolution. Furthermore, the pressure of computing resources and complex evolution processes pose challenges to search and balancing strategy. In this paper, an agent-assisted heterogeneous learning swarm optimizer is proposed. First, a global and local search collaborative particle learning structure is proposed, called a heterogeneous learning structure. The population distribution in the decision and objective spaces are used to select global and local search examples, respectively. Secondly, an agent-assisted evolutionary search is proposed, which evaluates the individual's state in decision space and objective space and controls the global and local search structures to adapt to the evolutionary requirements of individuals in different evolutionary states. Finally, hierarchical resource allocation and level-based global search example selection mechanisms are proposed on the local and global search structures to maintain the balance between diversity and convergence. To evaluate the performance of the proposed algorithm, comprehensive and extensive experiments were conducted on a commonly used large-scale benchmark suite. Experiments show that compared with ten state-of-the-art large-scale optimization algorithms, the proposed algorithm demonstrates superior performance in most cases.

Optimizing parameters in swarm intelligence using reinforcement learning: An application of Proximal Policy Optimization to the iSOMA algorithm

Proximal Policy Optimization Smoothed Algorithm

Proximal Policy Optimization Algorithms

Proximal policy optimization via enhanced exploration efficiency

Self-organizing migrating algorithm: review, improvements and comparison

Hybrid Particle Swarm Optimization Algorithm Based on the Theory of Reinforcement Learning in Psychology

Beyond the Boundaries of Proximal Policy Optimization

A multi-swarm optimizer with a reinforcement learning mechanism for large-scale optimization

Migration & Competition-Based Particle Swarm Optimization for Parameter Estimation

Policy Optimization with Model-based Explorations

A Competitive Swarm Optimizer for Large Scale Optimization

An agent-assisted heterogeneous learning swarm optimizer for large-scale optimization

Parameter Optimization Via Reinforcement Learning for the Regulation of Swarms

Soft Actor-Critic Approach to Self-Adaptive Particle Swarm Optimisation

Reinforcement-learning-based parameter adaptation method for particle swarm optimization

An Adaptive Online Parameter Control Algorithm For Particle Swarm Optimization Based On Reinforcement Learning

PPO-CMA: Proximal Policy Optimization with Covariance Matrix Adaptation

Solving a Real-World Optimization Problem Using Proximal Policy Optimization with Curriculum Learning and Reward Engineering

Truly Proximal Policy Optimization

A modified competitive swarm optimizer guided by space sampling for large-scale multi-objective optimization

Model-Based Reinforcement Learning via Proximal Policy Optimization