Abstract:This paper proposes a multi-objective reinforcement learning algorithm (MORLA) and uses simultaneous perturbation stochastic approximation (SPSA) to improve the convergence of it. Usually, reinforcement learning (RL) is used to design neurocontroller for control system with single objective. When facing multi-objective system, it is necessary to design the neurocontroller according to the personal preference. The MORLA can transform the multi-objective into synthetical objective and applies parallel genetic algorithm (PGA) to evolve the neurocontroller according to the synthetical objective. To establish the synthetical objective, the objective weight which represents the personal preference is calculated by solving the constrained optimization problem (COP) at the end of each generation. The COP requires not only the biggest variance of the synthetical objective in the population, but also requires the weight to fit the designer's preference. After acquiring the weights, the PGA can select the elitists from the population according to the designer's preference and design a satisfying neurocontroller by evolutionary operations. In addition, although GA has good global search ability, it descends slowly at local area. This paper applies SPSA algorithm to search optimal solution when GA is vibrating at local area. The SPSA converges fast by efficient gradient approximation that relies on measurements of the objective function. The hybrid algorithm accelerates the learning speed of reinforcement learning. At last, the MORLA is used to design neurocontroller for a speed-controlled induction motor drive with indirect vector control. With different personal preferences for the drive system, the simulation results show the feasibility and validity of the MORLA. © 2011 IEEE.

Multi-objective Reinforcement Learning Algorithm and Its Application in Drive System

Multi-objective reinforcement learning algorithm and its improved convergency method

Multiobjective Optimization for Controller Design

Human-in-the-Loop Policy Optimization for Preference-Based Multi-Objective Reinforcement Learning

Enhancing Robotic Navigation: An Evaluation of Single and Multi-Objective Reinforcement Learning Strategies

Multiobjective Reinforcement Learning: A Comprehensive Overview

Online Nash-optimization tracking control of multi-motor driven load system with simplified RL scheme

Design and Implementation of Reinforcement Learning for Automated Driving Compared to Classical MPC Control

"Notice of Violation of IEEE Publication Principles" Multiobjective Reinforcement Learning: A Comprehensive Overview.

Prediction Guided Meta-Learning for Multi-Objective Reinforcement Learning

A Two-Stage Multi-Objective Deep Reinforcement Learning Framework.

An Improved Genetic Algorithm in Multi-objective Optimization and Its Application

Multi-objective Longitudinal Decision-making for Autonomous Electric Vehicle: A Entropy-constrained Reinforcement Learning Approach.

Path Planning Algorithm for Multi-Locomotion Robot Based on Multi-Objective Genetic Algorithm with Elitist Strategy

Research on a Personalized Decision Control Algorithm for Autonomous Vehicles Based on the Reinforcement Learning from Human Feedback Strategy

Hybridization of evolutionary algorithm and deep reinforcement learning for multi-objective orienteering optimization

Multi-Kernel Online Reinforcement Learning for Path Tracking Control of Intelligent Vehicles

Multi-objective reinforcement learning for fed-batch fermentation process control

A Novel Multi-State Reinforcement Learning-Based Multi-Objective Evolutionary Algorithm

C-MORL: Multi-Objective Reinforcement Learning through Efficient Discovery of Pareto Front

A Multi-Objective Bat Algorithm with a Novel Competitive Mechanism and Its Application in Controller Tuning.