Abstract:Inappropriate lane following and changing behaviors of connected and autonomous vehicles (CAVs) can result in accidents, such as rear-end collision and side collision. To remedy that, the use of deep reinforcement learning (DRL) for autonomous driving decisions is currently a widely used promising solution. In this case, the accuracy and effectiveness of such a machine learning (ML) model is quite essential for this artificial intelligence (AI)-enabled CAVs. This article proposes a blockchain-based collective learning (BCL) framework for autonomous lane-changing systems. Four key issues, namely, learning efficiency, data security, users' privacy, as well as communication burden, are addressed by applying collective learning, vehicular blockchain, and knowledge transfer. First, we model the lane-changing problem as a DRL process and learn the autonomous lane-changing strategy through the deep deterministic policy gradient (DDPG) algorithm. Second, a single CAV involves a limited number of driving scenarios, and the independent learning method has the problem of inefficiency. Therefore, we propose a collective learning framework to utilize the "collective intelligence" shared by CAVs. Third, a vehicular blockchain is then applied to ensure the security and privacy of the user and data. In addition, the introduction of the blockchain can incentivize more users to participate in collective learning. Finally, in order to accelerate the learning process and achieve higher level performance while further reducing the communication burden, we use the corresponding knowledge extracted from the ML model such as human learning, as privileged information for sharing instead of directly sharing local ML models. Extensive simulation results validate the effectiveness and efficiency of our proposal in terms of learning efficiency, driving safety, as well as system security and robustness.

Continual Driver Behaviour Learning for Connected Vehicles and Intelligent Transportation Systems: Framework, Survey and Challenges

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

Driving Behaviour Style Study with a Hybrid Deep Learning Framework Based on GPS Data

Enhancing Transportation Systems Via Deep Learning: A Survey

Continual Interactive Behavior Learning With Traffic Divergence Measurement: A Dynamic Gradient Scenario Memory Approach

Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions

A Survey of Recent Advances in Driving Behavior Analysis

Involvement of Deep Learning for Vision Sensor-Based Autonomous Driving Control: A Review

Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Review

Continual Learning for Adaptable Car-Following in Dynamic Traffic Environments

An Integrated New Deep Learning Framework for Reliable CSI Acquisition in Connected and Autonomous Vehicles

Federated Learning for Connected and Automated Vehicles: A Survey of Existing Approaches and Challenges

Learning driving behavior for autonomous vehicles using deep learning based methods*

A Survey on Theories and Applications for Self-Driving Cars Based on Deep Learning Methods

Evaluating the Efficacy of Real-Time Connected Vehicle Basic Safety Messages in Mitigating Aberrant Driving Behaviour and Risk of Vehicle Crashes: Preliminary Insights from Highway Scenarios

A Survey of Federated Learning for Connected and Automated Vehicles

Deep Learning Serves Traffic Safety Analysis: A Forward-looking Review

AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learning

Continuous Improvement of Self-Driving Cars Using Dynamic Confidence-Aware Reinforcement Learning

A Survey of Deep Learning Techniques for Autonomous Driving

An Autonomous Lane-Changing System With Knowledge Accumulation and Transfer Assisted by Vehicular Blockchain