Abstract:Over the years, social media has emerged as one of the most popular platforms where people express their views and share thoughts about various aspects. The social media content now includes a variety of components such as text, images, videos etc. One type of interest is memes, which often combine text and images. It is relevant to mention here that, social media being an unregulated platform, sometimes also has instances of discriminatory, offensive and hateful content being posted. Such content adversely affects the online well-being of the users. Therefore, it is very important to develop computational models to automatically detect such content so that appropriate corrective action can be taken. Accordingly, there have been research efforts on automatic detection of such content focused mainly on the texts. However, the fusion of multimodal data (as in memes) creates various challenges in developing computational models that can handle such data, more so in the case of low-resource languages. Among such challenges, the lack of suitable datasets for developing computational models for handling memes in low-resource languages is a major problem. This work attempts to bridge the research gap by providing a large-sized curated dataset comprising 5,054 memes in Hindi-English code-mixed language, which are manually annotated by three independent annotators. It comprises two subtasks: (i) Subtask-1 (Binary classification involving tagging a meme as misogynous or non-misogynous), and (ii) Subtask-2 (multi-label classification of memes into different categories). The data quality is evaluated by computing Krippendorff's alpha. Different computational models are then applied on the data in three settings: text-only, image-only, and multimodal models using fusion techniques. The results show that the proposed multimodal method using the fusion technique may be the preferred choice for the identification of misogyny in multimodal Internet content and that the dataset is suitable for advancing research and development in the area.

Overview of the 2023 ICON Shared Task on Gendered Abuse Detection in Indic Languages

Breaking the Silence Detecting and Mitigating Gendered Abuse in Hindi, Tamil, and Indian English Online Spaces

The Uli Dataset: An Exercise in Experience Led Annotation of oGBV

Hypers at ComMA@ICON: Modelling Aggressiveness, Gender Bias and Communal Bias Identification

Overview of the HASOC Subtrack at FIRE 2022: Offensive Language Identification in Marathi

Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages

Overview of Abusive and Threatening Language Detection in Urdu at FIRE 2021

MIMIC: Misogyny Identification in Multimodal Internet Content in Hindi-English Code-Mixed Language

Abusive and Threatening Language Detection in Urdu using Boosting based and BERT based models: A Comparative Approach

Divide and Conquer: An Ensemble Approach for Hostile Post Detection in Hindi

Abusive Speech Detection in Indic Languages Using Acoustic Features

Data Bootstrapping Approaches to Improve Low Resource Abusive Language Detection for Indic Languages

The ComMA Dataset V0.2: Annotating Aggression and Bias in Multilingual Social Media Discourse

One to rule them all: Towards Joint Indic Language Hate Speech Detection

ADIMA: Abuse Detection In Multilingual Audio

User-Aware Multilingual Abusive Content Detection in Social Media

AbuseAnalyzer: Abuse Detection, Severity and Target Prediction for Gab Posts

Efficient Gender Debiasing of Pre-trained Indic Language Models

A deep-learning approach to early identification of suggested sexual harassment from videos

Developing a Multilingual Annotated Corpus of Misogyny and Aggression

Multilingual Abusiveness Identification on Code-Mixed Social Media Text