Abstract:In recent years, microblogging sites like Twitter have become an important and popular source for real-time information and news dissemination, and they have become a prime target of spammers inevitably. A series of incidents have shown that the security threats caused by Twitter spam can reach far beyond the social media platform to impact the real world. To mitigate the threat, a lot of recent studies apply machine learning techniques to classify Twitter spam and promising results are reported. However, most of these studies overlook the class imbalance problem in real-world Twitter data. In this paper, we experimentally demonstrate that the unequal distribution between spam and non-spam classes has a great impact on spam detection rate. To address the problem, we propose FOS, a fuzzy-based oversampling method that generates synthetic data samples from limited observed samples based on the idea of fuzzy-based information decomposition. Moreover, we develop an ensemble learning approach that learns more accurate classifiers from imbalanced data in three steps. In the first step, the class distribution in the imbalanced data set is adjusted by using various strategies, including random oversampling, random undersampling and FOS. In the second step, a classification model is built upon each of the redistributed data sets. In the final step, a majority voting scheme is introduced to combine the predictions from all the classification models. We conduct experiments on real-world Twitter data for the purpose of evaluation. The results indicate that the proposed learning approach can significantly improve the spam detection rate in data sets with imbalanced class distribution.

An Adaptive Method for Organization Name Disambiguation with Feature Reinforcing.

Semi-supervised Classification of Twitter Messages for Organization Name Disambiguation.

Two stages based organization name disambiguity

Emotion Detection in Online Social Networks: A Multilabel Learning Approach

Learning a Probabilistic Semantic Model from Heterogeneous Social Networks for Relationship Identification

An Ensemble Learning Approach for Addressing the Class Imbalance Problem in Twitter Spam Detection.

Discovering Organizational Correlations from Twitter

Microblog Sentiment Classification with Heterogeneous Sentiment Knowledge

Name Disambiguation in AMiner: Clustering, Maintenance, and Human in the Loop.

A Hybrid Model for Role-related User Classification on Twitter

A Unified Semi-supervised Framework for Author Disambiguation in Academic Social Network.

Chinese organization name translation via web mining

Social-Correlation Based Mutual Reinforcement for Short Text Classification and User Interest Tagging

A Classification Framework For Disambiguating Web People Search Result Using Feedback

Addressing the Class Imbalance Problem in Twitter Spam Detection Using Ensemble Learning.

CONNA: Addressing Name Disambiguation on the Fly

Word-Representation-Based Method for Extracting Organizational Events from Online Media

Finding Web Appearances of Social Network Users Via Latent Factor Model

Robust hybrid name disambiguation framework for large databases

MSA - Jointly Detecting Drug Name and Adverse Drug Reaction Mentioning Tweets with Multi-Head Self-Attention.

ECNU: Expression- and Message-level Sentiment Orientation Classification in Twitter Using Multiple Effective Features