Abstract:Significant challenges in perception, prediction, and decision-making within self-driving systems remain inadequately addressed. Concurrently, the advancement of autonomous driving technologies reduces driver engagement, inadvertently eroding their proficiency. Integrating human cognitive flexibility and experiential insight with the machine's precision and reliability offers a promising approach for the transitional phase towards fully automated driving. This study presents a human-machine collaboration approach to enhance the highly automated vehicles' high-level flexibility and personalization attribute without the need for passengers' prior driving experience. Firstly, we propose a tactical human–vehicle collaboration framework leveraging the hand-landmark extraction algorithm and augmented visual feedback. The proposed vision-based interface projects the gesture onto the ground and feeds it back to the driver through the augmented reality head-up display (AR-HUD) for intuitive interaction. The projection offers strategic decision-making guidance and planning recommendations for the vehicle. Utilizing these suggestions, the automation algorithm efficiently manages the remaining tasks, including collision avoidance and adherence to traffic regulations. This approach minimizes the driver's engagement in routine driving tasks and negates the need for driving skills. Incorporating cooperative game theory, the methodology optimally balances personalization with system robustness. Finally, we compare our approach with conventional manual driving schemes that both can assist the self-driving car in avoiding unknown obstacles and reaching the personalized goal. Results demonstrate that the proposed decision-making and planning collaboration scheme significantly reduces human physical burdens without compromising driving performance and driver mental workloads.

Zone-of-Interaction Prioritization for Personalized Automated Driving by Considering Visual Attention Preferences

Personalized Highway Pilot Assist Considering Leading Vehicle's Lateral Behaviours

Brain-Inspired Modeling and Decision-Making for Human-Like Autonomous Driving in Mixed Traffic Environment

Brain-Inspired Modelling and Decision-making for Human-Like Autonomous Driving in Mixed Traffic Environment

Personalized Lane Change Decision Algorithm Using Deep Reinforcement Learning Approach.

Personalized Trajectory Planning and Control of Lane-Change Maneuvers for Autonomous Driving.

Real-time Learning of Driving Gap Preference for Personalized Adaptive Cruise Control

Investigating Personalized Driving Behaviors in Dilemma Zones: Analysis and Prediction of Stop-or-Go Decisions

Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identification

Human-Like Decision-Making of Autonomous Vehicles in Dynamic Traffic Scenarios

Safe, Efficient and Socially-Compatible Decision of Automated Vehicles: a Case Study of Unsignalized Intersection Driving

Parameterized Decision-Making with Multi-Modality Perception for Autonomous Driving

Personalized driving behavior oriented autonomous vehicle control for typical traffic situations

An Intention-aware and Online Driving Style Estimation Based Personalized Autonomous Driving Strategy

Human–machine cooperative decision-making and planning for automated vehicles using spatial projection of hand gestures

Game-based Decision Algorithm for Socially Compatible Automated Driving: a Case Study of Unsignalized Intersection Driving

Analysis of Naturalistic Driving Behavior for Personalized Autonomous Vehicle

Parameterized Decision-making with Multi-modal Perception for Autonomous Driving

Decision-Making for Autonomous Vehicles with Interaction-Aware Behavioral Prediction and Social-Attention Neural Network

Toward Safe and Personalized Autonomous Driving: Decision-Making and Motion Control With DPF and CDT Techniques