Abstract:In this paper, a novel approach is presented for modeling the interaction dynamics between an ego car and a bicycle in a traffic scenario using a hybrid reinforcement learning framework combined with a social value orientation (SVO) model. The proposed framework leverages the SARSA algorithm to learn the optimal policy for the ego vehicle while incorporating risk cost as the negative log-likelihood of collision. Additionally, a customized SVO model is introduced to capture the social preferences of the ego car and the bicycle, defining the SVO of each agent as a continuous variable between egoistic and cooperative orientations. Furthermore, a weight parameter is incorporated in the framework to regulate the influence of the SVO model on the learning process. We demonstrate the effectiveness of our approach through extensive simulations, showing that the ego car can balance between maximizing its reward and avoiding collisions while considering the social preferences of the agents. The obtained results are compared to other models in the literature, and it is shown that the proposed method contributes to the development of safe and efficient autonomous driving systems that interact with human-driven vehicles in a socially intelligent manner Note to Practitioners—This proposed framework is motivated by the pressing challenge of navigation for autonomous cars in complex urban driving scenarios and mixed traffic situations. With the increasing prevalence of autonomous vehicles on roads, developing intelligent navigation systems that can effectively interact with other road users has become essential. Our novel framework addresses this need by leveraging the SARSA algorithm to learn the optimal policy for the ego vehicle while incorporating risk cost as the negative log-likelihood of collision. Additionally, a customized SVO model is introduced to capture the social preferences of the ego car and the bicycle, defining the SVO of each agent as a continuous variable between egoistic and cooperative orientations. This enables autonomous vehicles to make informed decisions and navigate safely and efficiently. Our framework can enormously help the field of autonomous vehicle navigation and contribute significantly to developing safe, human-centric, and reliable transportation systems. The versatility of our approach is evident in its potential to support a network of autonomous vehicles interacting with multiple road users, thereby enhancing scalability. By leveraging the power of machine learning, our solution provides a robust and adaptable approach that can handle the diverse and ever-changing conditions of urban driving scenarios.

Socially Compatible Control Design of Automated Vehicle in Mixed Traffic

Socially Compliant Control of Autonomous Vehicles with Application to Eco-Driving

An Optimal Control Framework for Influencing Human Driving Behavior in Mixed-Autonomy Traffic

Social Coordination and Altruism in Autonomous Driving

Socially-Compatible Behavior Design of Autonomous Vehicles with Verification on Real Human Data.

Navigating the Impact of Connected and Automated Vehicles on Mixed Traffic Efficiency: A Driving Behavior Perspective

Human-centric Autonomous Driving in an AV-Pedestrian Interactive Environment Using SVO

Energy and Environmental Implications of Automated Vehicles under Mixed Autonomy Traffic Environment

Socially Intelligent Reinforcement Learning for Optimal Automated Vehicle Control in Traffic Scenarios

Personalized Adaptive Cruise Control and Impacts on Mixed Traffic

On Multi-Class Automated Vehicles: Car-following Behavior and Its Implications for Traffic Dynamics

Safe, Efficient and Socially-Compatible Decision of Automated Vehicles: a Case Study of Unsignalized Intersection Driving

An Adaptive Control Framework for Mixed Autonomy Traffic Platoon

Achieving Driving Comfort of AVs by Combined Longitudinal and Lateral Motion Control

Platoon Control and External Human–machine Interfaces: Innovations in Pedestrian–autonomous Vehicle Interactions

Smoothing traffic flow through automated vehicle control with optimal parameter selection

How Do Humanlike Behaviors of Connected Autonomous Vehicles Affect Traffic Conditions in Mixed Traffic?

Trust-Aware Control of Automated Vehicles in Car-Following Interactions with Human Drivers

Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness

Modeling Autonomous Vehicles’ Altruistic Behavior to Human-Driven Vehicles in the Car following Events and Impact Analysis

Impact of Automated Vehicle Eco-Approach on Human-Driven Vehicles