Mitigating Gender Bias in Machine Learning Data Sets

Susan Leavy,Gerardine Meaney,Karen Wade,Derek Greene

DOI: https://doi.org/10.48550/arXiv.2005.06898

2020-05-18

Abstract:Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due to their reliance on underlying language processing and recommendation algorithms. Attempts to address such issues have involved testing learned associations, integrating concepts of fairness to machine learning and performing more rigorous analysis of training data. Mitigating bias when algorithms are trained on textual data is particularly challenging given the complex way gender ideology is embedded in language. This paper proposes a framework for the identification of gender bias in training data for machine <a class="link-external link-http" href="http://learning.The" rel="external noopener nofollow">this http URL</a> work draws upon gender theory and sociolinguistics to systematically indicate levels of bias in textual training data and associated neural word embedding models, thus highlighting pathways for both removing bias from training data and critically assessing its impact.

Computation and Language,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the gender bias in machine - learning datasets. Specifically, the authors focus on how to identify and mitigate gender bias in text data, because this bias can be amplified by algorithms and persist in society, especially in employment advertisements and recruitment tools, which rely on underlying language processing and recommendation algorithms. The paper proposes a framework for identifying gender bias in text data for training machine - learning models. This framework combines knowledge of gender theory and sociolinguistics to systematically point out the level of bias in text training data and its associated neural word - embedding models, thus providing a way to remove bias from training data and evaluate its impact in search and recommendation systems.