Multilingual Hate Speech Detection: A Semi-Supervised Generative Adversarial Approach

Khouloud Mnassri,Reza Farahbakhsh,Noel Crespi

DOI: https://doi.org/10.3390/e26040344

IF: 2.738

2024-04-19

Entropy

Abstract:Social media platforms have surpassed cultural and linguistic boundaries, thus enabling online communication worldwide. However, the expanded use of various languages has intensified the challenge of online detection of hate speech content. Despite the release of multiple Natural Language Processing (NLP) solutions implementing cutting-edge machine learning techniques, the scarcity of data, especially labeled data, remains a considerable obstacle, which further requires the use of semisupervised approaches along with Generative Artificial Intelligence (Generative AI) techniques. This paper introduces an innovative approach, a multilingual semisupervised model combining Generative Adversarial Networks (GANs) and Pretrained Language Models (PLMs), more precisely mBERT and XLM-RoBERTa. Our approach proves its effectiveness in the detection of hate speech and offensive language in Indo-European languages (in English, German, and Hindi) when employing only 20% annotated data from the HASOC2019 dataset, thereby presenting significantly high performances in each of multilingual, zero-shot crosslingual, and monolingual training scenarios. Our study provides a robust mBERT-based semisupervised GAN model (SS-GAN-mBERT) that outperformed the XLM-RoBERTa-based model (SS-GAN-XLM) and reached an average F1 score boost of 9.23% and an accuracy increase of 5.75% over the baseline semisupervised mBERT model.

physics, multidisciplinary

What problem does this paper attempt to address?

The paper attempts to address the challenge of detecting hate speech and offensive language in multilingual environments. Despite numerous solutions proposed in the field of Natural Language Processing (NLP), the scarcity of annotated data remains a major obstacle. This paper proposes a novel semi-supervised Generative Adversarial Network (GAN) approach, combined with pre-trained language models (such as mBERT and XLM-RoBERTa), to improve the detection of hate speech in multilingual settings.

Specifically, the study addresses the following key issues:
1. **Scarcity of annotated data**: In multilingual environments, obtaining a large amount of high-quality annotated data is very expensive and time-consuming. By introducing a semi-supervised learning framework, the model is trained using a small amount of annotated data and a large amount of unannotated data.
2. **Cross-language detection**: Sharing language features between different languages to improve the ability to detect hate speech across languages. Experiments show that significant results can be achieved using only 20% of the annotated data in English, German, and Hindi.
3. **Model performance improvement**: The proposed SS-GAN-mBERT model improves the F1 score and accuracy by 9.23% and 5.75%, respectively, compared to the baseline mBERT model, demonstrating its effectiveness in multilingual, zero-shot cross-language, and single-language training scenarios.

In summary, this paper aims to overcome the issue of insufficient annotated data through innovative methods and improve the accuracy of hate speech detection in multilingual environments.