Abstract:This paper attempt to study the effectiveness of text representation schemes on two tasks namely: User Aggression and Fact Detection from the social media contents. In User Aggression detection, The aim is to identify the level of aggression from the contents generated in the Social media and written in the English, Devanagari Hindi and Romanized Hindi. Aggression levels are categorized into three predefined classes namely: `Non-aggressive`, `Overtly Aggressive`, and `Covertly Aggressive`. During the disaster-related incident, Social media like, Twitter is flooded with millions of posts. In such emergency situations, identification of factual posts is important for organizations involved in the relief operation. We anticipated this problem as a combination of classification and Ranking problem. This paper presents a comparison of various text representation scheme based on BoW techniques, distributed word/sentence representation, transfer learning on classifiers. Weighted $F_1$ score is used as a primary evaluation metric. Results show that text representation using BoW performs better than word embedding on machine learning classifiers. While pre-trained Word embedding techniques perform better on classifiers based on deep neural net. Recent transfer learning model like ELMO, ULMFiT are fine-tuned for the Aggression classification task. However, results are not at par with pre-trained word embedding model. Overall, word embedding using fastText produce best weighted $F_1$-score than Word2Vec and Glove. Results are further improved using pre-trained vector model. Statistical significance tests are employed to ensure the significance of the classification results. In the case of lexically different test Dataset, other than training Dataset, deep neural models are more robust and perform substantially better than machine learning classifiers.

Vandalism Detection in Wikipedia: a Bag-of-Words Classifier Approach

Fair multilingual vandalism detection system for Wikipedia

Large-Scale Vandalism Detection with Linear Classifiers - The Conkerberry Vandalism Detector at WSDM Cup 2017

The Class Imbalance Problem in the Machine Learning Based Detection of Vandalism in Wikipedia across Languages

Automatically Labeling Low Quality Content on Wikipedia by Leveraging Patterns in Editing Behaviors

Proceedings of the WSDM Cup 2017: Vandalism Detection and Triple Scoring

Language-Agnostic Modeling of Source Reliability on Wikipedia

Feature Analysis for Assessing the Quality of Wikipedia Articles through Supervised Classification

Language-Agnostic Modeling of Wikipedia Articles for Content Quality Assessment across Languages

Detecting Hallucination and Coverage Errors in Retrieval Augmented Generation for Controversial Topics

Automated Software Vulnerability Assessment with Concept Drift

Wiki-Reliability: A Large Scale Dataset for Content Reliability on Wikipedia

Ex Machina: Personal Attacks Seen at Scale

Automatic Word Sense Disambiguation Method Based on Wikipedia

Towards Improving Wikipedia As An Image-Rich Encyclopaedia Through Analyzing Appropriateness Of Images For An Article

Neural Word Decomposition Models for Abusive Language Detection

An Empirical Evaluation of Text Representation Schemes on Multilingual Social Web to Filter the Textual Aggression

A Modified Word Saliency-Based Adversarial Attack on Text Classification Models

Simulation, Modelling and Classification of Wiki Contributors: Spotting The Good, The Bad, and The Ugly

BordIRlines: A Dataset for Evaluating Cross-lingual Retrieval-Augmented Generation

Is cross-linguistic advert flaw detection in Wikipedia feasible? A multilingual-BERT-based transfer learning approach