Abstract:Model-free learning-based control methods have recently shown significant advantages over traditional control methods in avoiding complex vehicle characteristic estimation and parameter tuning. As a primary policy learning method, imitation learning (IL) is capable of learning control policies directly from expert demonstrations. However, the performance of IL policies is highly dependent on the data sufficiency and quality of the demonstrations. To alleviate the above problems of IL-based policies, a lifelong policy learning (LLPL) framework is proposed in this paper, which extends the IL scheme with lifelong learning (LLL). First, a novel IL-based model-free control policy learning method for path tracking is introduced. Even with imperfect demonstration, the optimal control policy can be learned directly from historical driving data. Second, by using the LLL method, the pre-trained IL policy can be safely updated and fine-tuned with incremental execution knowledge. Third, a knowledge evaluation method for policy learning is introduced to avoid learning redundant or inferior knowledge, thus ensuring the performance improvement of online policy learning. Experiments are conducted using a high-fidelity vehicle dynamic model in various scenarios to evaluate the performance of the proposed method. The results show that the proposed LLPL framework can continuously improve the policy performance with collected incremental driving data, and achieves the best accuracy and control smoothness compared to other baseline methods after evolving on a 7 km curved road. Through learning and evaluation with noisy real-life data collected in an off-road environment, the proposed LLPL framework also demonstrates its applicability in learning and evolving in real-life scenarios.

Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

A Hierarchical Imitation Learning-based Decision Framework for Autonomous Driving

Hierarchical Interpretable Imitation Learning for End-to-End Autonomous Driving

Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learning

Model-Based Imitation Learning for Urban Driving

Learning to Drive Like Human Beings: A Method Based on Deep Reinforcement Learning

Joint Imitation Learning of Behavior Decision and Control for Autonomous Intersection Navigation

End-to-end Driving via Conditional Imitation Learning

DeepGoal: Learning to drive with driving intention from human control demonstration

Exploring Imitation Learning for Autonomous Driving with Feedback Synthesizer and Differentiable Rasterization

Hierarchical Learned Risk-Aware Planning Framework for Human Driving Modeling

Learning a Decision Module by Imitating Driver's Control Behaviors

Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Driving

Human-Like Autonomous Driving on Dense Traffic

A Learning-Based Controller for Trajectory Tracking of Autonomous Vehicles in Complex and Uncertain Scenarios

Less is More: Efficient Brain-Inspired Learning for Autonomous Driving Trajectory Prediction

Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving

A Hierarchical LSTM-Based Vehicle Trajectory Prediction Method Considering Interaction Information

A Hierarchical Intention Inference Model for Connected and Automated Vehicles

Beyond Imitation: A Life-long Policy Learning Framework for Path Tracking Control of Autonomous Driving