Abstract:Most previous email spam filtering techniques rely on traditional classification learning which assumes the data from training and test sets are drawn from the same underlying distribution. However, in practice, this identical-distribution assumption often violates. In general, email service providers collect training data from various public available resources, while the tasks focus on users' individual inboxes. Topics in the mail-boxes vary among different users, and distributions shift as a result. In this paper, we propose an adaptive email spam filtering algorithm based on information theory which relaxes the identical-distribution assumption and adapts the knowledge learned from one distribution to another. Our work focuses on the content analysis which minimizes the loss in mutual information between email instances and word features, before and after classification. We present theoretical and empirical analyses to show that our algorithm is able to solve the adaptive email spam filtering problem well. The experimental results show that our algorithm greatly improves the accuracy of email filtering, against the traditional classification algorithms, while scaling very well.

Research on Advanced Filtering Algorithm for Spam Email Based on Bayes Parameter Estimation

Research On Advanced Filtering Algorithm For Anti-Spam Based On A Bayesian Classification Model

Research of a Hybrid Spam Filtering Algorithm

The Optimization Analysis of Phishing Email Filtering in Network Fraud based on Improved Bayesian Algorithm

Complex Network Based SMS Filtering Algorithm

Implementing Spare Filter by Improving Naive Bayesian Algorithm

A Spam Filtering Method Based on Bayesian Neural Network

SELF-ADAPTABLE SPAM FILTERING BASED ON BAYESIAN ALGORITHM

An Improved Bayesian with Application to Anti-Spam Email

An Anti-Spam E-mail Filtering Method Based on Bayesian

WEIGHTED NAIVE BAYES SPAM FILTERING METHOD BASED ON FEATURE TERM DISCRIMINATION

Spam Filtering by Stages

A Two-Stage Spam Email Filtering Method Based on Naive Bayes and Hierarchical Clustering

Advanced Filtering Technology for Spam E-mail Based on Multilevel Attributes Set

ANTI-SPAM TECHNOLOGY BASED ON BAYESIAN THEORY

CONTINUOUS BAYESIAN SPAM FILTERING BASED ON CONTENT

Adaptive Email Spam Filtering Based on Information Theory

An optimized spam filtering method based on AODE

Approach of improving incremental Bayes based spam filter by data amoothing

Implementation and Evaluation of Chinese Spam Filtering System

Spam filtering with several novel bayesian classifiers