Abstract:The rise of emergence of social media platforms has fundamentally altered how people communicate, and among the results of these developments is an increase in online use of abusive content. Therefore, automatically detecting this content is essential for banning inappropriate information, and reducing toxicity and violence on social media platforms. The existing works on hate speech and offensive language detection produce promising results based on pre-trained transformer models, however, they considered only the analysis of abusive content features generated through annotated datasets. This paper addresses a multi-task joint learning approach which combines external emotional features extracted from another corpora in dealing with the imbalanced and scarcity of labeled datasets. Our analysis are using two well-known Transformer-based models, BERT and mBERT, where the later is used to address abusive content detection in multi-lingual scenarios. Our model jointly learns abusive content detection with emotional features by sharing representations through transformers' shared encoder. This approach increases data efficiency, reduce overfitting via shared representations, and ensure fast learning by leveraging auxiliary information. Our findings demonstrate that emotional knowledge helps to more reliably identify hate speech and offensive language across datasets. Our hate speech detection Multi-task model exhibited 3% performance improvement over baseline models, but the performance of multi-task models were not significant for offensive language detection task. More interestingly, in both tasks, multi-task models exhibits less false positive errors compared to single task scenario.

Task Adaptive Pretraining of Transformers for Hostility Detection

Hostility Detection in Hindi leveraging Pre-Trained Language Models

Coarse and Fine-Grained Hostility Detection in Hindi Posts using Fine Tuned Multilingual Embeddings

Divide and Conquer: An Ensemble Approach for Hostile Post Detection in Hindi

Fine-tuning of Pre-trained Transformers for Hate, Offensive, and Profane Content Detection in English and Marathi

Evaluation of Deep Learning Models for Hostility Detection in Hindi Text

Walk in Wild: An Ensemble Approach for Hostility Detection in Hindi Posts

Hate Speech and Offensive Language Detection using an Emotion-aware Shared Encoder

Combating Hostility: Covid-19 Fake News and Hostile Post Detection in Social Media

Hostility Detection and Covid-19 Fake News Detection in Social Media

Pretrained Transformers for Offensive Language Identification in Tanglish

Harnessing Pre-Trained Sentence Transformers for Offensive Language Detection in Indian Languages

Analysis and Detection of Multilingual Hate Speech Using Transformer Based Deep Learning

One to rule them all: Towards Joint Indic Language Hate Speech Detection

Understanding Transformers for Bot Detection in Twitter

Contextual Hate Speech Detection in Code Mixed Text using Transformer Based Approaches

A Unified Multi-Task Learning Architecture for Hate Detection Leveraging User-Based Information

MHS-STMA: Multimodal Hate Speech Detection via Scalable Transformer-Based Multilevel Attention Framework

problemConquero at SemEval-2020 Task 12: Transformer and Soft label-based approaches

HateGPT: Unleashing GPT-3.5 Turbo to Combat Hate Speech on X

Breaking the Silence Detecting and Mitigating Gendered Abuse in Hindi, Tamil, and Indian English Online Spaces