Abstract:Urban planners, authorities, and numerous additional players have to deal with challenges related to the rapid urbanization process and its effect on human mobility and transport dynamics. Hence, optimize transportation systems represents a unique occasion for municipalities. Indeed, the quality of transport is linked to economic growth, and by decreasing traffic congestion, the life quality of the inhabitants is drastically enhanced. Most state-of-the-art solutions optimize traffic in specific and small zones of cities (e.g., single intersections) and cannot be used to gather insights for an entire city. Moreover, evaluating such optimized policies in a realistic way that is convincing for policy-makers can be extremely expensive. In our work, we propose a reinforcement learning frameworks to overtake these two limitations. In particular, we use human mobility data to optimize the transport dynamics of three real-world cities (i.e., Berlin, Santiago de Chile, Dakar) and a synthesized one (i.e., SynthTown). To this end, we transform the transportation dynamics' simulator MATSim into a realistic reinforcement learning environment able to optimize and evaluate transportation policies using agents that perform realistic daily activities and trips. In this way, we can assess transportation policies in a manner that is convincing for policy-makers. Finally, we develop a model-based reinforcement learning algorithm that approximates MATSim dynamics with a Partially Observable Discrete Event Decision Process (PODEDP) and, with respect to other state-of-art policy optimization techniques, can scale on big transportation data and find optimal policies also on a city-scale.

Analyzing Transport Policies in Developing Countries with ABM

Modeling Urban Transport Choices: Incorporating Sociocultural Aspects

Agent-Based Microsimulation Approach for Design and Evaluation of Flexible Work Schedules

Integrating Mesoscopic Dynamic Traffic Assignment with Agent-Based Travel Behavior Models for Cumulative Land Development Impact Analysis

Uncovering physical activity trade-offs in transportation policy: A spatial agent-based model of Bogotá, Colombia

Simulating the social influence in transport mode choices

Multi-Agent Simulation for Multi-Mode Travel Policy to Improve Park and Ride Efficiency

Optimal Travel Information Provision Strategies: an Agent-Based Approach under Uncertainty

Integrated Agent-based Microsimulation Framework for Examining Impacts of Mobility-oriented Policies

Policy-Combination Oriented Optimization for Public Transportation Based on the Game Theory

An Agent-Based Choice Model for Travel Mode and Departure Time and Its Case Study in Beijing

An Analytical Approach for Intermodal Urban Transportation Network Equilibrium including Shared Mobility Services

Optimizing Transportation Dynamics at a City-Scale Using a Reinforcement Learning Framework

Transportation Interventions Reshaping NYC Commute: the Probabilistic Simulation Framework Assessing the Impacts of Ridesharing and Manhattan Congestion Surcharge

Multi-agent urban transport simulations using OD matrices from mobile phone data

An integrated approach based on system dynamics and ANP for evaluating sustainable transportation policies

Similar Outcomes, Different Paths: Tracing the Relationship Between Neighborhood-Scale Built Environment and Travel Behavior Using Activity-Based Modelling

Modeling Pedestrian Flows: Agent-Based Simulations of Pedestrian Activity for Land Use Distributions in Urban Developments

Agent-based digital traffic model generation for regions facing data scarcity using aggregated cellphone data: a case study for Brussels

Integrating agent-based modeling, serious gaming, and co-design for planning transport infrastructure and public spaces

A system dynamics based simulation model to evaluate regulatory policies for sustainable transportation planning