Abstract:Aimed at the lack of self-tuning PID parameters in conventional PID controllers, the structure and learning algorithm of an adaptive PID controller based on reinforcement learning were proposed. Actor-Critic learning was used to tune PID parameters in an adaptive way by taking advantage of the model-free and on-line learning properties of re-inforcement learning effectively. In order to reduce the demand of storage space and to improve the learning efficiency, a single RBF neural network was used to approximate the policy function of Actor and the value function of Critic si-multaneously. The inputs of RBF network are the system error, as well as the first and the second-order differences of error. The Actor can realize the mapping from the system state to PID parameters, while the Critic evaluates the outputs of the Actor and produces TD error. Based on TD error performance index and gradient descent method, the updating rules of RBF kernel function and network weights were given. Simulation results show that the proposed controller is efficient for complex nonlinear systems and it is perfectly adaptable and strongly robust, which is better than that of a conventional PID controller.

PID parameter self-tuning and robust control based on neural networks

A multivariable nonlinear self-tuning PID controller

PID Parameters Auto-Tuning Method for Industrial Temperature Adjustment

Single neuron predictive pid control

Load Testing System Based on BP Neural Networks Self-adaptive PID Controller

An Optimal Self-Tuning PID Controller Considering Parameter Estimation Uncertainty

Self-learning Fuzzy PID Controller Based on Neural Networks

A Pid Controller With Neuron Tuning Parameters For Multi-Model Plants

An Intelligent Adaptive Robust Controller Based on Neural Network for a Pneumatic System

A multivariable on-line adaptive PID controller using auto-tuning neurons

Robust Pid Controller Design Using Particle Swarm Optimizer

A Novel Auto-Tuning Robust Pid Controller for Networked Control System

A New PID Neural Network Controller Design for Nonlinear Processes

Relay Auto-Tuning Control Technique of PID Based on IAE for a General System with Large Time-Varying Time Delay

Neuron Model-Free Pid Control

PID Adaptive Feedback Motor System Based on Neural Network

Intelligent PID Controller Design with Adaptive Criterion Adjustment Via Least Squares Support Vector Machine

A Proposal of Adaptive PID Controller Based on Reinforcement Learning

PID Algorithm Based on Fuzzy Neural Network Control of PLC System

Adaptive Neural Network PID Control for a Aeroengine

An Intelligent PID Control using Neural Networks for Pneumatic Servo Systems