Abstract:Model-free learning-based control methods have recently shown significant advantages over traditional control methods in avoiding complex vehicle characteristic estimation and parameter tuning. As a primary policy learning method, imitation learning (IL) is capable of learning control policies directly from expert demonstrations. However, the performance of IL policies is highly dependent on the data sufficiency and quality of the demonstrations. To alleviate the above problems of IL-based policies, a lifelong policy learning (LLPL) framework is proposed in this paper, which extends the IL scheme with lifelong learning (LLL). First, a novel IL-based model-free control policy learning method for path tracking is introduced. Even with imperfect demonstration, the optimal control policy can be learned directly from historical driving data. Second, by using the LLL method, the pre-trained IL policy can be safely updated and fine-tuned with incremental execution knowledge. Third, a knowledge evaluation method for policy learning is introduced to avoid learning redundant or inferior knowledge, thus ensuring the performance improvement of online policy learning. Experiments are conducted using a high-fidelity vehicle dynamic model in various scenarios to evaluate the performance of the proposed method. The results show that the proposed LLPL framework can continuously improve the policy performance with collected incremental driving data, and achieves the best accuracy and control smoothness compared to other baseline methods after evolving on a 7 km curved road. Through learning and evaluation with noisy real-life data collected in an off-road environment, the proposed LLPL framework also demonstrates its applicability in learning and evolving in real-life scenarios.

Improving the Environmental Adaptability of Conditional Imitation Learning Driving Model

Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

End-to-end Driving via Conditional Imitation Learning

Iterative Imitation Policy Improvement for Interactive Autonomous Driving

Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarios

CCIL: Context-conditioned imitation learning for urban driving

Deep Imitation Learning for Autonomous Driving in Generic Urban Scenarios with Enhanced Safety

End-to-end Driving Deploying Through Uncertainty-Aware Imitation Learning and Stochastic Visual Domain Adaptation.

Addressing Limitations of State-Aware Imitation Learning for Autonomous Driving

Using External Attention in Vision-based Autonomous Driving

Enhancing scene understanding based on deep learning for end-to-end autonomous driving

Conditional Affordance Learning for Driving in Urban Environments

Beyond Imitation: A Life-long Policy Learning Framework for Path Tracking Control of Autonomous Driving

Self-Adaptive Driving in Nonstationary Environments through Conjectural Online Lookahead Adaptation

Learning to Drive Anywhere

Adapt the Driving Policy to Local Traffic before Entering the New Area

SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environments

A Lightweight and Style-Robust Neural Network for Autonomous Driving in End Side Devices

Learning from Not All Vehicles Via Influence Function

Learning-on-the-Drive: Self-supervised Adaptation of Visual Offroad Traversability Models

Stochastic Navigation Command Matching for Imitation Learning of a Driving Policy.