Abstract:Most existing model-based cooperative tracking control approaches heavily rely on precise dynamic models and overlook the transient performance, ultimately resulting in the designed controller falling far short of optimal control effectiveness. To address this issue, this paper proposes a novel switching learning algorithm to optimize the optimal formation tracking control in unknown heterogeneous multi-agent systems. Firstly, a distributed observer-based decentralized formation control protocol is proposed to provide the state estimation of the leader, where the estimated leader's state facilitates that each agent maintains formation distance between the leader and the formation process. Secondly, a decentralized control policy is considered and learned by the iterative solution of the Bellman equation to achieve the optimal formation tracking control for each agent. However, the aforementioned obtained results heavily rely on the system dynamics and an initial stabilizing control policy. To relax these limitations, a data-based switching learning algorithm is proposed, and it consists of a model-free matrix updating learning algorithm and a data-based policy iteration algorithm. In contrast to existing algorithms for similar studies, the proposed algorithms eliminate the system model and initial stabilizing requirements, but also ensure the formation control in an optimal control way. Finally, a practical connected automated vehicles example is given to verify the theoretical analysis.

Self-learning control for coordinated collision avoidance of automated vehicles

Longitudinal Predictive Control for Vehicle-Following Collision Avoidance in Autonomous Driving Considering Distance and Acceleration Compensation

Switching Learning-Based Cooperative Control with Its Application to Connected Automated Vehicles

Adaptive Coordinated Collision Avoidance Control of Autonomous Ground Vehicles

Adaptive robust control algorithm for enhanced path-tracking performance of automated driving in critical scenarios

Self-learning Drift Control of Automated Vehicles Beyond Handling Limit after Rear-End Collision

Spatial-based Predictive Control for Vehicle Collision Avoidance by Steering Maneuvers

Active steering control for autonomous vehicles based on a driver-in-the-loop platform: A case study of collision avoidance

A Combined Reinforcement Learning and Model Predictive Control for Car-Following Maneuver of Autonomous Vehicles

Deep Reinforcement Learning for Advanced Longitudinal Control and Collision Avoidance in High-Risk Driving Scenarios

Nonlinear Coordinated Steering and Braking Control of Vision-Based Autonomous Vehicles in Emergency Obstacle Avoidance

Safe and efficient collision avoidance control for autonomous vehicles

Driver-automation Collaborative Steering Control for Intelligent Vehicles under Unexpected Emergency Conditions.

Adaptive Drift Control of Autonomous Electric Vehicles after Brake System Failures

An Active Safety Control Method of Collision Avoidance for Intelligent Connected Vehicle Based on Driving Risk Perception

Data-Driven Predictive Control for Connected and Autonomous Vehicles in Mixed Traffic

Path Tracking and Handling Stability Control Strategy With Collision Avoidance for the Autonomous Vehicle Under Extreme Conditions

Comprehensive Predictive Control Method for Automated Vehicles in Dynamic Traffic Circumstances

Longitudinal Collision Avoidance and Lateral Stability Adaptive Control System Based on MPC of Autonomous Vehicles

Coordination Control Strategy for Human-Machine Cooperative Steering of Intelligent Vehicles: A Reinforcement Learning Approach