Abstract:As urban centers evolve into smart cities, sustainable mobility emerges as a cornerstone for ensuring environmental integrity and enhancing quality of life. Autonomous vehicles (AVs) play a pivotal role in this transformation, with the potential to significantly improve efficiency and safety, and reduce environmental impacts. This study introduces a novel Multi-Agent Actor–Critic (MA2C) algorithm tailored for multi-AV lane-changing in mixed-traffic scenarios, a critical component of intelligent transportation systems in smart cities. By incorporating a local reward system that values efficiency, safety, and passenger comfort, and a parameter-sharing scheme that encourages inter-agent collaboration, our MA2C algorithm presents a comprehensive approach to urban traffic management. The MA2C algorithm leverages reinforcement learning to optimize lane-changing decisions, ensuring optimal traffic flow and enhancing both environmental sustainability and urban living standards. The actor–critic architecture is refined to minimize variances in urban traffic conditions, enhancing predictability and safety. The study extends to simulating realistic human-driven vehicle (HDV) behavior using the Intelligent Driver Model (IDM) and the model of Minimizing Overall Braking Induced by Lane changes (MOBIL), contributing to more accurate and effective traffic management strategies. Empirical results indicate that the MA2C algorithm outperforms existing state-of-the-art models in managing lane changes, passenger comfort, and inter-vehicle cooperation, essential for the dynamic environment of smart cities. The success of the MA2C algorithm in facilitating seamless interaction between AVs and HDVs holds promise for more fluid urban traffic conditions, reduced congestion, and lower emissions. This research contributes to the growing body of knowledge on autonomous driving within the framework of sustainable smart cities, focusing on the integration of AVs into the urban fabric. It underscores the potential of machine learning and artificial intelligence in developing transportation systems that are not only efficient and safe but also sustainable, supporting the broader goals of creating resilient, adaptive, and environmentally friendly urban spaces.

Agent-Based Approach for Connected Vehicles and Smart Road Signs Collaboration

Autonomous Traffic Control System Using Agent Based Technology

Multi-Agent System for Intelligent Urban Traffic Management Using Wireless Sensor Networks Data

An Information Fusion Approach to Intelligent Traffic Signal Control Using the Joint Methods of Multiagent Reinforcement Learning and Artificial Intelligence of Things

A multi-agent reinforcement learning based approach for intelligent traffic signal control

Smart Roads for Autonomous Accident Detection and Warnings

Agent-Based Modeling and Simulation of Connected and Automated Vehicles Using Game Engine: A Cooperative On-Ramp Merging Study

Sustainable Smart Cities through Multi-Agent Reinforcement Learning-Based Cooperative Autonomous Vehicles

Efficient Strategy to Exchange Road Messages Between Smart Vehicles and Wireless Sensor Networks in Hybrid Sensor and Vehicular Networks

Reinforcement Learning-Based Control of Signalized Intersections Having Platoons

Real-time signal-vehicle coupled control: An application of connected vehicle data to improve intersection safety

Multi-Agent Iot-Based System For Intelligent Vehicle Traffic Management Using Wireless Sensor Networks

A conceptual model of communication for intelligent agents in the infrastructure of smart transportation systems

Towards Multi-agent Reinforcement Learning based Traffic Signal Control through Spatio-temporal Hypergraphs

AN EFFICIENT INTELLIGENT TRAFFIC LIGHT CONTROL AND DEVIATION SYSTEM FOR TRAFFIC CONGESTION AVOIDANCE USING MULTI-AGENT SYSTEM

Accident Management System Based on Vehicular Network for an Intelligent Transportation System in Urban Environments

Smart Urban Mobility: When Mobility Systems Meet Smart Data

Cooperative Ramp Merging System: Agent-Based Modeling and Simulation Using Game Engine

A Survey of Adaptive Multi-Agent Networks and Their Applications in Smart Cities

An Agent-based Modelling Framework for Driving Policy Learning in Connected and Autonomous Vehicles

Enhancing Traffic Efficiency and Sustainability through Strategic Placement of Roadside Units and Variable Speed Limits in a Connected Vehicle Environment