CBLab: Supporting the Training of Large-scale Traffic Control Policies with Scalable Traffic Simulation

Chumeng Liang,Zherui Huang,Yicheng Liu,Zhanyu Liu,Guanjie Zheng,Hanyuan Shi,Kan Wu,Yuhao Du,Fuliang Li,Zhenhui Li

2023-06-05

Abstract:Traffic simulation provides interactive data for the optimization of traffic control policies. However, existing traffic simulators are limited by their lack of scalability and shortage in input data, which prevents them from generating interactive data from traffic simulation in the scenarios of real large-scale city road networks. In this paper, we present \textbf{C}ity \textbf{B}rain \textbf{Lab}, a toolkit for scalable traffic simulation. CBLab consists of three components: CBEngine, CBData, and CBScenario. CBEngine is a highly efficient simulator supporting large-scale traffic simulation. CBData includes a traffic dataset with road network data of 100 cities all around the world. We also develop a pipeline to conduct a one-click transformation from raw road networks to input data of our traffic simulation. Combining CBEngine and CBData allows researchers to run scalable traffic simulations in the road network of real large-scale cities. Based on that, CBScenario implements an interactive environment and a benchmark for two scenarios of traffic control policies respectively, with which traffic control policies adaptable for large-scale urban traffic can be trained and tuned. To the best of our knowledge, CBLab is the first infrastructure supporting traffic control policy optimization in large-scale urban scenarios. CBLab has supported the City Brain Challenge @ KDD CUP 2021. The project is available on GitHub:~\url{<a class="link-external link-https" href="https://github.com/CityBrainLab/CityBrainLab.git" rel="external noopener nofollow">this https URL</a>}.

Physics and Society,Artificial Intelligence,Computers and Society,Distributed, Parallel, and Cluster Computing,Software Engineering

What problem does this paper attempt to address?

### Problems Addressed by the Paper The paper primarily addresses the following two key issues: 1. **Limitations of Existing Traffic Simulators**: Existing traffic simulators are limited in their application to large-scale urban road networks, mainly due to their lack of scalability and insufficient input data. Specifically, current simulators can only handle smaller road networks (fewer than 100 intersections) and cannot scale to city-level traffic simulations that include thousands of intersections. Additionally, due to limitations in efficiency and scalability, these simulators cannot perform city-level simulations within a reasonable time frame or prevent a large number of vehicles from entering the simulation environment. 2. **Data Shortage for Large-Scale Traffic Simulation**: Although map data for major cities around the world is available, there is a lack of effective tools and processes to convert this data into simulation inputs. As a result, the input data currently used for traffic simulations mostly comes from manual work and is limited to small-scale road networks with only dozens of intersections, far smaller than the actual urban road network scale. To address the above issues, the researchers proposed **CityBrainLab (CBLab)**, a novel and scalable traffic simulation toolkit. CBLab consists of three components: CBEngine, CBData, and CBScenario. Specifically: - **CBEngine**: An efficient microscopic traffic simulator that supports large-scale urban traffic simulations with up to 10,000 intersections and 100,000 vehicles. - **CBData**: A dataset containing raw road network data for 100 major cities worldwide, providing a pipeline to automatically convert raw data into simulation input data. - **CBScenario**: An interactive environment for training and tuning two types of traffic control strategies (traffic signal control and congestion pricing). With these three components, users can easily initiate large-scale traffic simulations on real city-level road networks and design, develop, and train traffic control strategies based on them. To the best of the authors' knowledge, CBLab is the first infrastructure to support the optimization of large-scale urban traffic control strategies.

CBLab: Supporting the Training of Large-scale Traffic Control Policies with Scalable Traffic Simulation

CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenario

LCSim: A Large-Scale Controllable Traffic Simulator

Towards a Very Large Scale Traffic Simulator for Multi-Agent Reinforcement Learning Testbeds

OpenCity: A Scalable Platform to Simulate Urban Activities with Massive LLM Agents

Network Clustering-Based Multi-Agent Reinforcement Learning for Large-Scale Traffic Signal Control

A GPU-accelerated Large-scale Simulator for Transportation System Optimization Benchmarking

Urban traffic modelling and prediction using large scale taxi GPS traces

Data Augmented Deep Behavioral Cloning for Urban Traffic Control Operations Under a Parallel Learning Framework

LibCity: An Open Library for Traffic Prediction

Adaptive Traffic Signal Control for Large-Scale Scenario with Cooperative Group-based Multi-agent Reinforcement Learning

CrossLight: Offline-to-Online Reinforcement Learning for Cross-City Traffic Signal Control

City brain: practice of large‐scale artificial intelligence in the real world

Multi-scale Traffic Pattern Bank for Cross-city Few-shot Traffic Forecasting

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

Large Language Model-Driven Urban Traffic Signal Control

CityLight: A Universal Model for Coordinated Traffic Signal Control in City-scale Heterogeneous Intersections

CityTraffic: Modeling Citywide Traffic via Neural Memorization and Generalization Approach

DenseLight: Efficient Control for Large-scale Traffic Signals with Dense Feedback.

LimSim: A Long-term Interactive Multi-scenario Traffic Simulator

LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environments