Online Adaptive Optimal Tracking Control of Nonholonomic Mobile Robot

Kai Wang,Yingmin Jia,Jialu Du,Jun Zhang
2012-01-01
Abstract:A velocity control law is developed for the kinematic steering system of nonholonomic mobile robot to track a reference trajectory not only to make the posture error asymptotically stable but also considered optimality based on a pre-defined cost function. In order to make the cost function finite, we transformed the tracking problem into a regulation problem by redefining system states and inputs. The proposed online and forward-in-time policy iteration (PI) algorithm based on approximate dynamic programming (ADP) to solve the continuous-time(CT) optimal control problem with infinite horizon cost by solving of Hamilton-Jacobi-Bellman (HJB) equation. This method learns online in real-time to approximate the cost function by using a single neural networks (NNs), and then the near optimal control policy can be computed directly according to the cost function, which removes the action network appearing in the ordinary ADP methods. Simulation results are provided to demonstrate the effectiveness of the proposed approach.
What problem does this paper attempt to address?