Cooperating Graph Neural Networks with Deep Reinforcement Learning for Vaccine Prioritization

Lu Ling,Washim Uddin Mondal,Satish V,Ukkusuri

2023-05-09

Abstract:This study explores the vaccine prioritization strategy to reduce the overall burden of the pandemic when the supply is limited. Existing methods conduct macro-level or simplified micro-level vaccine distribution by assuming the homogeneous behavior within subgroup populations and lacking mobility dynamics integration. Directly applying these models for micro-level vaccine allocation leads to sub-optimal solutions due to the lack of behavioral-related details. To address the issue, we first incorporate the mobility heterogeneity in disease dynamics modeling and mimic the disease evolution process using a Trans-vaccine-SEIR model. Then we develop a novel deep reinforcement learning to seek the optimal vaccine allocation strategy for the high-degree spatial-temporal disease evolution system. The graph neural network is used to effectively capture the structural properties of the mobility contact network and extract the dynamic disease features. In our evaluation, the proposed framework reduces 7% - 10% of infections and deaths than the baseline strategies. Extensive evaluation shows that the proposed framework is robust to seek the optimal vaccine allocation with diverse mobility patterns in the micro-level disease evolution system. In particular, we find the optimal vaccine allocation strategy in the transit usage restriction scenario is significantly more effective than restricting cross-zone mobility for the top 10% age-based and income-based zones. These results provide valuable insights for areas with limited vaccines and low logistic efficacy.

Populations and Evolution,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to reduce the overall burden of the epidemic by optimizing the vaccine distribution strategy in the case of limited vaccine supply. Existing methods assume that the behaviors within sub - groups are homogeneous when conducting macro - or simplified micro - level vaccine distribution, and lack the integration of mobility dynamics. Directly applying these models to micro - level vaccine distribution will lead to sub - optimal solutions due to the lack of behavior - related details. To solve this problem, the paper first introduces mobility heterogeneity in disease - dynamic modeling and uses the Trans - vaccine - SEIR model to simulate the evolution process of the disease. Then, a new deep reinforcement learning method is developed to seek the optimal vaccine distribution strategy for the high - dimensional spatio - temporal disease - evolution system. Graph neural networks are used to effectively capture the structural characteristics of the mobility contact network and extract dynamic disease features. The evaluation results show that the proposed framework reduces 7% - 10% of infection and death cases compared with the baseline strategy. Extensive evaluations indicate that the proposed framework can find the optimal vaccine distribution strategy for micro - level disease - evolution systems under different mobility patterns. In particular, in the scenario of restricting public transportation use, the optimal vaccine distribution strategy for the top 10% age and income areas is significantly better than the strategy of restricting cross - district movement. These results provide valuable insights for areas with limited vaccine resources and low logistical efficiency.