Tackling Structural Injustices: On the Entanglement of Visibility and Justice in Emerging Technologies

Matthias Braun,Hannah Bleher,Eva Maria Hille,Jenny Krutzinna

DOI: https://doi.org/10.1080/15265161.2023.2207514

2023-06-21

Abstract:In today's world, Artificial Intelligence plays a central role in many decision-making processes. However, its use can lead to structural and epistemic injustices—especially in the context of health. In 2019, for example, an algorithm used millions of times in American hospitals favored White patients over Black patients. The algorithm was used to predict the likelihood that patients would need additional medical care. Skin color itself was not considered as a variable. What was taken into account was rather the development of costs in the health sector. This correlated negatively with the level of health care costs in the underlying data sets. For a variety of reasons, Black patients had, on average, lower health care costs than White patients with the same medical conditions (Vartan Citation 2019 ). In another case, it was observed that newborns with a positive screening result for rare diseases were diagnosed and treated later if they were patients of color (Zavala et al. Citation 2021 ). What becomes evident in both cases with respect to different technologies is that there is a link between the use of new technologies and experiences of injustice for (different) marginalized groups that has not been sufficiently considered so far (Wachter Citation 2022 ).

ethics,medical ethics,social issues,social sciences, biomedical