Abstract:In this paper an efficient Q-learning paradigm implemented on a fuzzy CMAC network is proposed. The fuzzy CMAC network topological architecture is described. First, the continuous states of the system are partitioned into a number of fuzzy boxes. Second, the proposed fuzzy CMAC evaluates the Q-values of agents in the fired fuzzy boxes and chooses control actions with maximum Q-values. Then a critic generates an external reinforcement signal according to the outcome or the effect of the control at every time-step, which is used later for further improving the estimation of these Q-values. To speed up the convergence of reinforcement learning, the traditional PID controller with several groups of different parameters is adopted so as to collect a number of taught-lessons. These taught-lessons together with the experienced lessons generated automatically, are sequentially replayed and learned, respectively, under the guidance of different reinforcement mechanisms. The hybrid adaptive and learning control system is applied to the control of a pH-neutralization process. Simulation investigations show that the fuzzy connectionist Q-learning control system has more adaptative, higher intelligence, and stronger generalization ability compared to present neural network or fuzzy neural network control techniques using supervised learning.

A Learning Algorithm for Feedforward Neural Networks Based on Fuzzy Controller

A nonlinear predictive control algorithm based on fuzzy online modeling and discrete optimization

Fuzzy Neural Network Based on Hybrid Learning Algorithm and Its Application to Soft Sensor

A Nonlinear Adaptive Controller Based on RBF Networks

Nonlinear adaptive control based on RBF networks and multi-model method

Neural Controller Based on Fuzzy Expert Model and Research on Its Application

A Direct Adaptive Predictive Functional Control Based on T-S Fuzzy Model

Self-learning Fuzzy PID Controller Based on Neural Networks

A Nonlinear Predictive Control Algorithm Based on Wiener Model

Improved Satisfactory Predictive Control Algorithm with Fuzzy Setpoint Constraints

Multivariable predictive control algorithm based on fuzzy model

Fuzzy NN Based Predictive Control and Its Application to Green Liquor System

State estimation and adaptive control of multivariable systems via neural networks and fuzzy logic

A fuzzy logic controller designed based on CPN and its application

A fuzzy-neural network for adaptive control of nonlinear dynamic systems

Algorithmic Research on Neural Integrated Fuzzy Controller of Ball & Plate Apparatus

Optimal parameters selection of back propagation algorithm in the feedforward neural network

A L-BFGS Based Learning Algorithm for Complex-Valued Feedforward Neural Networks

Nonlinear dynamical system approximation and adaptive control based on hybrid‐feed‐forward recurrent neural network: Simulation and stability analysis

Learning Algorithm for Neural Networks Based upon Continuous-time System Simulation

Dynamic neural network control through fuzzy Q-learning algorithms