Bias in Reinforcement Learning: A Review in Healthcare Applications

Benjamin Smith,Anahita Khojandi,Rama Vasudevan
DOI: https://doi.org/10.1145/3609502
IF: 16.6
2023-07-18
ACM Computing Surveys
Abstract:Reinforcement learning (RL) can assist in medical decision making using patient data collected in electronic health record (EHR) systems. RL, a type of machine learning, can use these data to develop treatment policies. However, RL models are typically trained using imperfect retrospective EHR data. Therefore, if care is not taken in training, RL policies can propagate existing bias in healthcare. Literature that considers and addresses the issues of bias and fairness in sequential decision making are reviewed. The major themes to mitigate bias that emerge relate to (1) data management; (2) algorithmic design; and (3) clinical understanding of the resulting policies.
computer science, theory & methods
What problem does this paper attempt to address?