Exploiting Explainability to Design Adversarial Attacks and Evaluate Attack Resilience in Hate-Speech Detection Models

Pranath Reddy Kumbam,Sohaib Uddin Syed,Prashanth Thamminedi,Suhas Harish,Ian Perera,Bonnie J. Dorr

2023-05-30

Abstract:The advent of social media has given rise to numerous ethical challenges, with hate speech among the most significant concerns. Researchers are attempting to tackle this problem by leveraging hate-speech detection and employing language models to automatically moderate content and promote civil discourse. Unfortunately, recent studies have revealed that hate-speech detection systems can be misled by adversarial attacks, raising concerns about their resilience. While previous research has separately addressed the robustness of these models under adversarial attacks and their interpretability, there has been no comprehensive study exploring their intersection. The novelty of our work lies in combining these two critical aspects, leveraging interpretability to identify potential vulnerabilities and enabling the design of targeted adversarial attacks. We present a comprehensive and comparative analysis of adversarial robustness exhibited by various hate-speech detection models. Our study evaluates the resilience of these models against adversarial attacks using explainability techniques. To gain insights into the models' decision-making processes, we employ the Local Interpretable Model-agnostic Explanations (LIME) framework. Based on the explainability results obtained by LIME, we devise and execute targeted attacks on the text by leveraging the TextAttack tool. Our findings enhance the understanding of the vulnerabilities and strengths exhibited by state-of-the-art hate-speech detection models. This work underscores the importance of incorporating explainability in the development and evaluation of such models to enhance their resilience against adversarial attacks. Ultimately, this work paves the way for creating more robust and reliable hate-speech detection systems, fostering safer online environments and promoting ethical discourse on social media platforms.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The problem this paper attempts to address is:

With the rise of social media, hate speech online has become a significant ethical challenge. Researchers have developed hate speech detection models to automatically regulate content and promote civil discourse. However, recent studies have found that these hate speech detection systems are vulnerable to adversarial attacks, raising concerns about their robustness. Although previous research has separately explored the robustness and interpretability of these models under adversarial attacks, there has not been a comprehensive study combining these two aspects.

The innovation of this paper lies in combining these two critical aspects, using interpretability to identify potential vulnerabilities and designing targeted adversarial attacks. Specifically, the authors propose a comprehensive comparative analysis to evaluate the robustness of different hate speech detection models under adversarial attacks. To gain a deeper understanding of the models' decision-making processes, the authors employ the Local Interpretable Model-agnostic Explanations (LIME) framework. Based on the interpretability results obtained from LIME, the authors use the TextAttack tool to conduct targeted attacks on the text.

The research aims to enhance the understanding of the vulnerabilities and strengths of current state-of-the-art hate speech detection models, emphasizing the importance of incorporating interpretability in the development and evaluation of these models to improve their robustness against adversarial attacks. Ultimately, this work paves the way for creating more robust and reliable hate speech detection systems, contributing to a safer online environment and promoting ethical discussions on social media platforms.