Abstract:The integration of autonomous vehicles into urban traffic has great potential to improve efficiency by reducing congestion and optimizing traffic flow systematically. In this paper, we introduce CoMAL (Collaborative Multi-Agent LLMs), a framework designed to address the mixed-autonomy traffic problem by collaboration among autonomous vehicles to optimize traffic flow. CoMAL is built upon large language models, operating in an interactive traffic simulation environment. It utilizes a Perception Module to observe surrounding agents and a Memory Module to store strategies for each agent. The overall workflow includes a Collaboration Module that encourages autonomous vehicles to discuss the effective strategy and allocate roles, a reasoning engine to determine optimal behaviors based on assigned roles, and an Execution Module that controls vehicle actions using a hybrid approach combining rule-based models. Experimental results demonstrate that CoMAL achieves superior performance on the Flow benchmark. Additionally, we evaluate the impact of different language models and compare our framework with reinforcement learning approaches. It highlights the strong cooperative capability of LLM agents and presents a promising solution to the mixed-autonomy traffic challenge. The code is available at <a class="link-external link-https" href="https://github.com/Hyan-Yao/CoMAL" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

This paper attempts to solve the traffic flow optimization problem in the mixed - autonomy traffic system. Specifically, the researchers introduced a framework named CoMAL (Collaborative Multi - Agent Large Language Models), aiming to optimize traffic flow through the collaboration among multiple autonomous vehicles. The following are the main problems and solutions in this paper: ### Research Background and Problems 1. **Challenges in the Mixed - Autonomy Traffic System**: - Mixed - Autonomy Traffic refers to the co - existence of connected and autonomous vehicles (CAVs) and human - driven vehicles in the same traffic network. This complex traffic environment brings many challenges, such as how to optimize the overall traffic flow and reduce congestion. 2. **Limitations of Existing Methods**: - Traditional rule - based methods can achieve certain specific stable motion patterns, but it is difficult to handle complex and changeable traffic scenarios. - Deep Reinforcement Learning (Deep RL) performs well in specific scenarios, but has poor generalization ability between different scenarios, and its decision - making process is difficult to interpret. ### Proposal of the CoMAL Framework To address the above challenges, the paper proposes the CoMAL framework, which utilizes the capabilities of large language models (LLMs) to enhance the collaboration among autonomous vehicles. Specifically, CoMAL solves the problem through the following aspects: 1. **Perception Module**: - This module is responsible for observing other vehicles in the surrounding environment and converting this information into text descriptions for the LLM to understand and reason. 2. **Memory Module**: - The memory module stores past driving experiences, enabling the LLM to make more reasonable decisions based on historical data. 3. **Collaboration Module**: - The collaboration module allows multiple autonomous vehicles to discuss and assign tasks in a shared message pool, ensuring that each vehicle is clear about its role and task. 4. **Reason Engine**: - The reason engine generates specific driving plans according to the assigned tasks. It uses the Intelligent Driver Model (IDM) to generate regularized driving strategies to ensure the consistency and safety of vehicle behavior. 5. **Execution Module**: - The execution module is responsible for implementing the driving plans generated by the reason engine and controlling the actual actions of the vehicles. ### Experimental Results The experimental results show that CoMAL outperforms existing deep reinforcement learning methods in the Flow benchmark test, especially with significant improvements in average vehicle speed and driving stability. In addition, the paper also evaluates the impact of different LLM models on performance, demonstrating the adaptability and superiority of CoMAL in different scenarios. ### Main Contributions 1. **For the first time, apply the collaborative ability of multi - agent language models to the field of autonomous driving**. 2. **Propose the CoMAL framework, which combines a regularized planner to enhance the control mechanism**. 3. **Verify the superior performance of CoMAL in classical traffic scenarios through experiments**. 4. **Demonstrate the adaptability and superiority of CoMAL on different LLM models**. In conclusion, by introducing the CoMAL framework, this paper solves the traffic flow optimization problem in the mixed - autonomy traffic system and provides new ideas and methods for future autonomous driving technology.

CoMAL: Collaborative Multi-Agent Large Language Models for Mixed-Autonomy Traffic

TraCo: Learning Virtual Traffic Coordinator for Cooperation with Multi-Agent Reinforcement Learning.

AgentsCoMerge: Large Language Model Empowered Collaborative Decision Making for Ramp Merging

LMMCoDrive: Cooperative Driving with Large Multimodal Model

KoMA: Knowledge-driven Multi-agent Framework for Autonomous Driving with Large Language Models

AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learning

DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving

Large Models for Cooperative Control of Connected and Autonomous Vehicles

Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework

A Flexible Cooperative MARL Method for Efficient Passage of an Emergency CAV in Mixed Traffic

Large Language Model as Parking Planning Agent in the Context of Mixed Period of Autonomous Vehicles and Human-Driven Vehicles

Deep Multi-agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic

LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving

Building Cooperative Embodied Agents Modularly with Large Language Models

CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversations

LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environments

A Language Agent for Autonomous Driving

Cooperative Multi-Agent Actor–critic Control of Traffic Network Flow Based on Edge Computing

Multi-agent reinforcement learning for cooperative lane changing of connected and autonomous vehicles in mixed traffic

Autonomous Intersection Management with Heterogeneous Vehicles: A Multi-Agent Reinforcement Learning Approach

Traffic Co-Simulation Framework Empowered by Infrastructure Camera Sensing and Reinforcement Learning