Abstract:This paper evaluates five supervised learning methods in the context of statistical spam filtering. We study the impact of different feature pruning methods and feature set sizes on each learner's performance using cost-sensitive measures. It is observed that the significance of feature selection varies greatly from classifier to classifier. In particular, we found support vector machine, AdaBoost, and maximum entropy model are top performers in this evaluation, sharing similar characteristics: not sensitive to feature selection strategy, easily scalable to very high feature dimension, and good performances across different datasets. In contrast, naive Bayes, a commonly used classifier in spam filtering, is found to be sensitive to feature selection methods on small feature set, and fails to function well in scenarios where false positives are penalized heavily. The experiments also suggest that aggressive feature pruning should be avoided when building filters to be used in applications where legitimate mails are assigned a cost much higher than spams (such as λ = 999), so as to maintain a better-than-baseline performance. An interesting finding is the effect of mail headers on spam filtering, which is often ignored in previous studies. Experiments show that classifiers using features from message header alone can achieve comparable or better performance than filters utilizing body features only. This implies that message headers can be reliable and powerfully discriminative feature sources for spam filtering.

Spam Filtering Method Based on Fuzzy Relevancy of Multiple Features

A New Fuzzy Adaptive Multi-Population Genetic Algorithm Based Spam Filtering Method

An Improved Multiple Features Fusion Method for Image Spam Filtering

Spam Filtering by Stages

"Word Frequency-Filtering"Hybrid Feature Selection Method Applied to Spam Identification

A Two-Stage Spam Email Filtering Method Based on Naive Bayes and Hierarchical Clustering

Bayesian Spam Detection System Using Hybrid Feature Selection Method

Two-step Based Hybrid Feature Selection Method for Spam Filtering

An Evaluation of Statistical Spam Filtering Techniques

A Spam Filtering Method Based on Multi-Modal Fusion

Utilizing Multi-Field Text Features for Efficient Email Spam Filtering.

Spam Filter Based on Term Co-Occurrence Model

Term Frequency Combined Hybrid Feature Selection Method for Spam Filtering

Multi-Layer Features Based Personalized Spam Filtering

WEIGHTED NAIVE BAYES SPAM FILTERING METHOD BASED ON FEATURE TERM DISCRIMINATION

An Imbalanced Spam Mail Filtering Method

Effective spam filter based on a hybrid method of header checking and content parsing

A Composite Intelligent Method For Spam Filtering

A Cross-Field Deep Learning-based Fuzzy Spamming Detection Approach Via Collaboration of Behavior Modeling and Sentiment Analysis

Feature Selection in E-mail Classification

Adaptive Email Spam Filtering Based on Information Theory