Abstract:Highlights • Reducing the interaction time with the real systems, ultra-fast tuning of deep neural network (NN) controller is achieved under the framework of probabilistic model-based reinforcement learning (MBRL). • The deep NN controller is applied to the path tracking of a real autonomous vehicle by adding layer normalization into neural networks and incorporating state estimator and filters into controller optimization. • The effectiveness of the proposed probabilistic MBRL algorithm for calibrating the deep NN controller is validated through various simulation and field tests. Neural network (NN) controllers have shown great potential in solving complex control or decision-making tasks. However, most of the NN controllers either rely on the availability of large datasets or require dense interactions with the environment, which hinders their application in real systems. In this paper, we introduce a model-based reinforcement learning (MBRL) algorithm, aimed at realizing ultra-fast tuning of deep NN controller from a small sample set of real-world data. The algorithm uses Gaussian processes (GPs) to model the unknown dynamics of real system and updates controller parameters through stochastic gradient descent. By using particle-based method for long-term predictions, the algorithm can easily incorporate online state estimators and filters into controller learning, which is conductive to learning from systems with partially measurable states and stochastic control delay. We apply the algorithm to calibrate a deep NN controller for the path tracking of a full-size autonomous vehicle (AV). Simulation and field test results show that the deep NN controller can be well calibrated after only one interaction with the environment and can achieve similar tracking performance to optimization-based methods such as nonlinear model prediction control (NMPC) in various test scenarios by combining with a feed-forward pure pursuit (PP) controller.

Neural Network Based Model Predictive Control for an Autonomous Vehicle

A Shared Control Approach for Autonomous Vehicles via Driver Behaviors Learning

Autonomous driving using GA-optimized neural network based adaptive LPV-MPC controller

Neural-Network-Based Predictive Control for PMSM Drives

A Learning-Based Nonlinear Model Predictive Control Approach for Autonomous Driving

Event-triggered Model Predictive Controller with Neural Network for Autonomous Rendezvous and Proximity on Elliptical Orbits

Learning-Based Neural Dynamic Surface Predictive Control for MMC

ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehicles

A Longitudinal/Lateral Coupled Neural Network Model Predictive Controller for Path Tracking of Self-Driving Vehicle

Neural Network Model Predictive Motion Control Applied to Automated Driving With Unknown Friction

Neural-Network Based MPC for Enhanced Lateral Stability in Electric Vehicles

PlanNetX: Learning an Efficient Neural Network Planner from MPC for Longitudinal Control

LVD-NMPC: A Learning-based Vision Dynamics Approach to Nonlinear Model Predictive Control for Autonomous Vehicles

Neural Lyapunov Model Predictive Control: Learning Safe Global Controllers from Sub-optimal Examples

Incorporating Recurrent Reinforcement Learning into Model Predictive Control for Adaptive Control in Autonomous Driving

Learning-Based Predictive Control for Vehicle Following Problems

Ultra-Fast Tuning of Neural Network Controllers with Application in Path Tracking of Autonomous Vehicle

Model Predictive Inferential Control of Neural State-Space Models for Autonomous Vehicle Motion Planning

Learning-Based Control of Autonomous Vehicles Using an Adaptive Neuro-Fuzzy Inference System and the Linear Matrix Inequality Approach

Neural network-based robust predictive control for visual servoing of autonomous vehicles with friction compensation

Neural Networks for Fast Optimisation in Model Predictive Control: A Review