MetroGNN: Metro Network Expansion with Reinforcement Learning

Hongyuan Su,Yu Zheng,Jingtao Ding,Depeng Jin,Yong Li
DOI: https://doi.org/10.1145/3589335.3651536
2024-03-14
Abstract:Selecting urban regions for metro network expansion to meet maximal transportation demands is crucial for urban development, while computationally challenging to solve. The expansion process relies not only on complicated features like urban demographics and origin-destination (OD) flow but is also constrained by the existing metro network and urban geography. In this paper, we introduce a reinforcement learning framework to address a Markov decision process within an urban heterogeneous multi-graph. Our approach employs an attentive policy network that intelligently selects nodes based on information captured by a graph neural network. Experiments on real-world urban data demonstrate that our proposed methodology substantially improve the satisfied transportation demands by over 30\% when compared with state-of-the-art methods. Codes are published at
Computers and Society
What problem does this paper attempt to address?
This paper proposes to solve the problem of urban metro network expansion in order to meet the maximum transportation demand. This problem is computationally challenging because the expansion process depends not only on complex features such as urban demographics and origin-destination (OD) flow, but also on the constraints of existing metro networks and urban geography. The paper introduces a reinforcement learning framework to solve this problem in city heterogenous multigraphs using Markov decision process. They design an attention policy network that intelligently selects nodes based on information captured by graph neural network. Experimental results demonstrate that this approach improves transportation demand satisfaction by more than 30% compared to state-of-the-art methods on real-world city data. In addition, the paper proposes a graph neural network to learn representations of city regions, and an attention policy network with action masks to efficiently explore the solution space of NP-hard problems, ensuring the feasibility of solutions. In summary, the main contributions of the paper include: 1. Proposing a graph-based reinforcement learning framework for solving the complex Markov decision process, suitable for the geometric optimization problem of metro network expansion. 2. Designing a novel graph neural network and attention policy network for learning representations of city regions and selecting new metro stations. 3. Experimental results show that the proposed MetroGNN method improves OD flow satisfaction by over 30% compared to state-of-the-art methods on real city data.