Towards affective computing that works for everyone

Tessa Verhoef,Eduard Fosch-Villaronga

2023-09-20

Abstract:Missing diversity, equity, and inclusion elements in affective computing datasets directly affect the accuracy and fairness of emotion recognition algorithms across different groups. A literature review reveals how affective computing systems may work differently for different groups due to, for instance, mental health conditions impacting facial expressions and speech or age-related changes in facial appearance and health. Our work analyzes existing affective computing datasets and highlights a disconcerting lack of diversity in current affective computing datasets regarding race, sex/gender, age, and (mental) health representation. By emphasizing the need for more inclusive sampling strategies and standardized documentation of demographic factors in datasets, this paper provides recommendations and calls for greater attention to inclusivity and consideration of societal consequences in affective computing research to promote ethical and accurate outcomes in this emerging field.

Human-Computer Interaction,Computers and Society

What problem does this paper attempt to address?

The paper attempts to address the issue of lack of diversity, equity, and inclusion (DEI) in datasets within the field of affective computing. Specifically, existing emotion recognition algorithms exhibit significant performance differences across different groups, which may be caused by factors such as health status, age, and gender. For example, mental health conditions like depression or schizophrenia can affect facial expressions and voice, making emotion recognition difficult; older adults may have changes in facial features that make their emotions harder to accurately recognize. Additionally, the lack of representation of demographic factors such as race, gender, and age in datasets leads to systems that may perform poorly for certain groups, potentially resulting in bias and discrimination.

To address these issues, the authors analyzed existing affective computing datasets and pointed out the severe lack of representation in terms of race, gender, age, and (mental) health. They emphasize the need for more inclusive sampling strategies and the standardization of recording demographic information in datasets to promote ethics and accuracy in affective computing research. Through this study, the authors hope to raise awareness in academia and industry about the potential social consequences of affective computing technologies, and to drive more responsible, fair, and inclusive research and development in this field.