Abstract:Qualitative research provides methodological guidelines for observing and studying communities and cultures on online social media platforms. However, such methods demand considerable manual effort from researchers and can be overly focused and narrowed to certain online groups. This work proposes a complete solution to accelerate the qualitative analysis of problematic online speech, focusing on opinions emerging from online communities by leveraging machine learning algorithms. First, we employ qualitative methods of deep observation for understanding problematic online speech. This initial qualitative study constructs an ontology of problematic speech, which contains social media postings annotated with their underlying opinions. The qualitative study dynamically constructs the set of opinions, simultaneous with labeling the postings. Next, we use keywords to collect a large dataset from three online social media platforms (Facebook, Twitter, and Youtube). Finally, we introduce an iterative data exploration procedure to augment the dataset. It alternates between a data sampler -- which balances exploration and exploitation of unlabeled data -- the automatic labeling of the sampled data, the manual inspection by the qualitative mapping team, and, finally, the retraining of the automatic opinion classifiers. We present both qualitative and quantitative results. First, we show that our human-in-the-loop method successfully augments the initial qualitatively labeled and narrowly focused dataset and constructs a more encompassing dataset. Next, we present detailed case studies of the dynamics of problematic speech in a far-right Facebook group, exemplifying its mutation from conservative to extreme. Finally, we examine the dynamics of opinion emergence and co-occurrence, and we hint at some pathways through which extreme opinions creep into the mainstream online discourse.

Social Media Analytics for Radical Opinion Mining in Hate Group Web Forums

Social Media Sentiment Analysis Using Twitter Dataset

Developing an online hate classifier for multiple social media platforms

Understanding the Radical Mind: Identifying Signals to Detect Extremist Content on Twitter

Incorporating Background Checks with Sentiment Analysis to Identify Violence Risky Chinese Microblogs

Hate speech against women and immigrants: A comparative analysis of machine learning and text embedding techniques

Meta heuristic approaches for sentiment analysis

Whose Opinions Matter? Perspective-aware Models to Identify Opinions of Hate Speech Victims in Abusive Language Detection

Automated Sentiment and Hate Speech Analysis of Facebook Data by Employing Multilingual Transformer Models

Detecting Hate Speech and Offensive Language on Twitter using Machine Learning: An N-gram and TFIDF based Approach

Using Social Media to Understand Cyber Attack Behavior

Transfer Learning for Hate Speech Detection in Social Media

DeepHate: Hate Speech Detection via Multi-Faceted Text Representations

Real Time Big Data Sentiment Analysis and Classification of Facebook

Enhancing hate speech detection with user characteristics

Social media content classification and community detection using deep learning and graph analytics

Slipping to the Extreme: A Mixed Method to Explain How Extreme Opinions Infiltrate Online Discussions

Sentiment-driven Community Profiling and Detection on Social Media

AggregHate: An Efficient Aggregative Approach for the Detection of Hatemongers on Social Platforms

HATE SPEECH DETECTION USING MACHINE LEARNING AND N-GRAM TECHNIQUES

Hate speech and hate crimes: a data-driven study of evolving discourse around marginalized groups