Technology acceptance and transparency demands for toxic language classification – interviews with moderators of public online discussion fora
Lena Katharina Wilms,Katharina Gerl,Anke Stoll,Marc Ziegele,Lena Katharina WilmsKatharina GerlAnke StollMarc Ziegelea Faculty of Arts and Humanities,Department of Social Sciences,Heinrich Heine University Düsseldorf,Düsseldorf,Germanyb Social Sciences Institute,Heinrich-Heine-University,Duesseldorf,Germanyc Department of Computational Communication Science,Ilmenau University of Technology,Ilmenau,Germanyd Düsseldorf Institute for Internet and Democracy,Heinrich Heine University,Düsseldorf,GermanyLena Katharina Wilms is a doctoral researcher at the Department of Social Sciences at Heinrich Heine University Duesseldorf. She develops and evaluates design and software features to improve online participation processes using AI-assisted moderation. She is particularly interested in designing inclusive and transparent democratic online environments.Katharina Gerl is a postdoctoral researcher at the Düsseldorf Institute for Internet and Democracy (DIID). Her research focuses on the implications of digital technologies for political institutions,political communication and participation. She conducted several studies evaluating the usage of online-based tools by political organizations at Heinrich Heine University.Anke Stoll is a research associate at the Institute of Media and Communication Science at the Ilmenau University of Technology,Germany. Her research focusses on fairness and transparency of AI systems in democratic processes and includes the development and evaluation of machine learning-based methods for online discussions,software for moderation systems,and participation platforms.Marc Ziegele is an Assistant Professor for Political Online Communication at the Department of Social Sciences at Heinrich Heine University Düsseldorf,Germany. In his research,he studies online incivility,deliberation,journalistic moderation,and media trust in the digital age.
DOI: https://doi.org/10.1080/07370024.2024.2307610
IF: 6.4588
2024-02-19
Human-Computer Interaction
Abstract:Many online discussion providers consider using algorithm-based moderation software to support their employees in moderating toxic communication. Such technology is also attractive for public discussion providers, including public administration and public service media. To ensure successful implementation, however, it is crucial that moderators can correctly understand and use the software according to context-specific workplace requirements. This exploratory case study sheds light on the technology acceptance of algorithm-based moderation software by moderators in German public administration and public service media. Specifically, we focus on the moderators' user characteristics and workplace requirement perceptions as preconditions for technology acceptance. We combined twelve structured qualitative interviews with moderators with an enhanced cognitive walkthrough (ECW) of an algorithm-based moderation dashboard. Additionally, stimuli of two different transparency mechanisms were added to the interview. Our findings suggest that transparency is one of the most requested characteristics of algorithm-based moderation software and, when met, transparency is beneficial for the acceptance of automated content classification in these systems. However, the findings suggest that different AI perceptions and technology commitment among moderators corresponded with different transparency motives related to the moderation system. We assume that addressing those differing motives by different transparency mechanisms may positively affect technology acceptance.
computer science, theory & methods, cybernetics