Abstract:Infectious disease outbreaks can have a disruptive impact on public health and societal processes. As decision-making in the context of epidemic mitigation is multi-dimensional hence complex, reinforcement learning in combination with complex epidemic models provides a methodology to design refined prevention strategies. Current research focuses on optimizing policies with respect to a single objective, such as the pathogen's attack rate. However, as the mitigation of epidemics involves distinct, and possibly conflicting, criteria (i.a., mortality, morbidity, economic cost, well-being), a multi-objective decision approach is warranted to obtain balanced policies. To enhance future decision-making, we propose a deep multi-objective reinforcement learning approach by building upon a state-of-the-art algorithm called Pareto Conditioned Networks (PCN) to obtain a set of solutions for distinct outcomes of the decision problem. We consider different deconfinement strategies after the first Belgian lockdown within the COVID-19 pandemic and aim to minimize both COVID-19 cases (i.e., infections and hospitalizations) and the societal burden induced by the mitigation measures. As such, we connected a multi-objective Markov decision process with a stochastic compartment model designed to approximate the Belgian COVID-19 waves and explore reactive strategies. As these social mitigation measures are implemented in a continuous action space that modulates the contact matrix of the age-structured epidemic model, we extend PCN to this setting. We evaluate the solution set that PCN returns, and observe that it explored the whole range of possible social restrictions, leading to high-quality trade-offs, as it captured the problem dynamics. In this work, we demonstrate that multi-objective reinforcement learning adds value to epidemiological modeling and provides essential insights to balance mitigation policies.

Reduced modelling and optimal control of epidemiological individual-based models with contact heterogeneity

Predicting epidemics on weighted networks

Competing control scenarios in probabilistic SIR epidemics on social-contact networks

On the optimal control of kinetic epidemic models with uncertain social features

Modeling Epidemics Spreading on Social Contact Networks

Optimal control of a kinetic model describing social interactions on a graph

Model-free based control of a HIV/AIDS prevention model

A spatial epidemic model with contact and mobility restrictions

Dynamic control of modern, network-based epidemic models

Optimal control of epidemic spreading in presence of social heterogeneity

Modelling strong control measures for epidemic propagation with networks -- A COVID-19 case study

Renormalisation Group Methods for Effective Epidemiological Models

Reliable optimal controls for SEIR models in epidemiology

Nonlinear random walks optimize the trade-off between cost and prevention in epidemics lockdown measures : the ESIR model

Exploring the Pareto front of multi-objective COVID-19 mitigation policies using reinforcement learning

Optimal policy for control of epidemics with constrained time intervals and region-based interactions

Modeling adaptive forward-looking behavior in epidemics on networks

Modelling disease outbreaks in realistic urban social networks

Mitigating biological epidemic on heterogeneous social networks

Modeling and Optimization of Epidemiological Control Policies Through Reinforcement Learning