Abstract:With the explosive growth of microblogging service, Twitter has become a leading platform consisting of real-time world wide information. Users tend to explore breaking news or general topics in Twitter according to their interests. However, the explosive amount of incoming tweets leads users to information overload. Therefore, filtering interesting tweets based on users' interest profiles from real-time stream can be helpful for users to easily access the relevant and key information hidden among the tweets. On the other hand, real-time twitter stream contains enormous amount of noisy and redundant tweets, which are not expected to be seen for users. Hence, the filtering process should consider previously pushed interesting tweets to provide users with diverse tweets. What's more, different from traditional document summarization methods which focus on static dataset, the twitter stream is dynamic, fast-arriving and large-scale, which means we have to decide whether to filter the coming tweet for users from the real-time stream as early as possible. In this paper, we propose a novel adaptive evolutionary filtering framework to push interesting tweets for users from real-time twitter stream. First, we propose an adaptive evolutionary filtering algorithm to filter interesting tweets from the twitter stream with respect to user interest profiles. And then we utilize the maximal marginal relevance model in fixed time window to estimate the relevance and diversity of potential tweets. Besides, to overcome the enormous number of redundant tweets and characterize the diversity of potential tweets, we propose a hierarchical tweet representation learning model (HTM) to learn the tweet representations dynamically over time. Experiments on large scale real-time twitter stream datasets demonstrate the efficiency and effectiveness of our framework.

How to merge three different methods for information filtering ?

Real-time Filtering on Interest Profiles in Twitter Stream

A comparative evaluation of pre-processing techniques and their interactions for twitter sentiment analysis

Filtering of Brand-Related Microblogs Using Social-Smooth Multiview Embedding

Information Filtering on Coupled Social Networks.

A Frequent Named Entities-Based Approach for Interpreting Reputation in Twitter

Finding the True Crowds: User Filtering in Microblogs

A Comparative Study of Collaborative Filtering Algorithms

Single-Pass, Adaptive Natural Language Filtering: Measuring Value in User Generated Comments on Large-Scale, Social Media News Forums

Unified Representation of Twitter and Online News Using Graph and Entities

A review of features for the discrimination of twitter users: application to the prediction of offline influence

A Comparison of Pre-processing Techniques for Twitter Sentiment Analysis

Adaptive Evolutionary Filtering in Real-Time Twitter Stream

Thread Cleaning and Merging for Microblog Topic Detection.

Meta heuristic approaches for sentiment analysis

Big Data Analysis in Commercial Social Networks: Analysis of Twitter Reviews for Marketing Decision Making

A Multimodel Fusion Engine for Filtering Webpages.

Follow Spam Detection based on Cascaded Social Information

A Collaborative Filtering Model For Personalized Retweeting Prediction

The collaborative search by tag-based user profile in social media

MSR KMG at TREC 2014 KBA track vital filtering task