Abstract:In this paper, the issue of human behavior learning (HBL) is addressed for a class of nonlinear human-in-the-loop (HiTL) systems where the human operator is viewed as a nonlinear optimal controller. Owing to its outstanding interpretability and strong nonlinear representation capability, the Takagi-Sugeno (T-S) fuzzy model is employed to represent the nonlinear HiTL control system and approximate the unknown human control law based on the parallel distributed compensation (PDC) scheme. A quadratic-like cost function with fuzzy weighting matrices is built to depict the human behavior, which conforms to human thinking and is unknown to the machine. The aim of the HBL is to retrieve the fuzzy weighting matrices such that the human control law will be optimal in the sense of minimizing the retrieved cost function. In the proposed HBL scheme, the state-dependent Riccati equation (SDRE) based nonlinear optimal control technique plays an important role, which has a similar structure to the linear quadratic regulator (LQR) theory and thus is of low computational complexity. With the help of the PDC based fuzzy approximator for the unknown human control law, a two-step procedure is proposed for the HBL. First, a filter-based adaptive law is developed to learn the gain matrices of the fuzzy approximator using the system state data only. The convergence analysis of the adaptive estimator is also given. Then, a semidefinite programming (SDP) problem with the quadratic objective function can be set up for determining the fuzzy weighting matrices of the cost function. The simulation study on a steering control system of the intelligent vehicle is given to show the effectiveness and applicability of the developed approach.

A Reinforcement Learning Fuzzy Controller For Set-Point Regulator Problems

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

An Equilibrium-Based Learning Approach with Application to Robotic Fish

Self-learning Fuzzy PID Controller Based on Neural Networks

Robust nonlinear set-point control with reinforcement learning

Predictive Control of Voltage Source Inverter: an Online Reinforcement Learning Solution

Finite Control-Set Learning Predictive Control for Power Converters

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

A fuzzy logic controller designed based on CPN and its application

A Takagi-Sugeno Fuzzy Controller With Reinforcement Learning Part

Aiding reinforcement learning for set point control

Model-Based Reinforcement Learning Control of Electrohydraulic Position Servo Systems

Learning and Tuning Fuzzy Logic Controllers Through Genetic Algorithm

Human Behavior Learning for a Class of Nonlinear Human-in-the-loop Systems via Takagi-Sugeno Fuzzy Model

Reinforcement Learning Control of Constrained Dynamic Systems with Uniformly Ultimate Boundedness Stability Guarantee

Performance-Guaranteed Adaptive Optimized Control of Intelligent Surface Vehicle Using Reinforcement Learning

Data-Driven Design of Two-Degree-Of-Freedom Controllers Using Reinforcement Learning Techniques

A Pi Type Self-Tuning Fuzzy Controller With Receding Horizon Optimization

Incremental Learning and State-Space Evolving Fuzzy Control of Nonlinear Time-Varying Systems with Unknown Model