Abstract:This paper presents a parameterized batch reinforcement learning algorithm for near-optimal longitudinal control of autonomous land vehicles (ALVs). The proposed approach uses an actor-critic architecture, where parameterized feature vectors based on kernels are learned from collected samples for approximating the value functions and policies. One difference between the parameterized batch actor-critic (PBAC) algorithm and previous actor-critic learning approaches is that the critic and actor in PBAC share the same linear features, which has been theoretically proved to be a beneficial property for the convergence of actor-critic learning approaches. In order to obtain better learning efficiency, least-squares-based batch updating rules are designed for the critic and actor, respectively. Based on the PBAC learning algorithm, a data-driven longitudinal control method is presented for ALVs to obtain near-optimal control policies which adaptively tune the fuel/brake control signals to track different speeds. A multiobjective reward function is designed so that both tracking precision and driving smoothness are considered. Extensive experiments were conducted on a real ALV platform while driving on flat, slippery, sloping, and bumpy roads. The experimental results illustrate the superiority of the PBAC-based self-learning controller over conventional longitudinal control methods such as proportional-integral (PI) control and learning-based PI control.

The Control of Two-Wheeled Self-Balancing Vehicle Based on Reinforcement Learning in a Continuous Domain

Balance Control of Two-Wheeled Robot Based on Reinforcement Learning.

Learning to Control Two-Wheeled Self-Balancing Robot Using Reinforcement Learning Rules

Learning to Control Two-Wheeled Self-Balancing Robot Using Reinforcement Learning Rules and Fuzzy Neural Networks

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Combined control algorithm based on synchronous reinforcement learning for a self-balancing bicycle robot

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Model Learning for Two-Wheeled Robot Self-Balance Control

High Maneuverability Control of Single-track Two-wheeled Robot in Narrow Terrain Based on Reinforcement Learning.

Performance-Guaranteed Adaptive Optimized Control of Intelligent Surface Vehicle Using Reinforcement Learning

Deep Reinforcement Learning-Based Control of Bicycle Robots on Rough Terrain

On-line NNAC for Two-Wheeled Self-Balancing Robot Based on Feedback-Error-Learning

Continuous control with deep reinforcement learning

Self-balance Learning of Two-wheeled Robot Based on Autonomous Operant Conditioning Automata

Online Series-Parallel Reinforcement-Learning-Based Balancing Control for Reaction Wheel Bicycle Robots on a Curved Pavement

Continual Reinforcement Learning for Autonomous Driving with Application on Velocity Control under Various Environment

Parameterized Batch Reinforcement Learning for Longitudinal Control of Autonomous Land Vehicles

Continuous Control with Deep Reinforcement Learning for Mobile Robot Navigation

Application of Self-learning Algorithm Based on Parameter Optimization in Control of Two Wheeled Robot

Balance Control Of Robot With Cmac Based Q-Learning

Continuous Reinforcement Learning Based Ramp Jump Control for Single-Track Two-Wheeled Robots