Abstract:The battle between email service providers and senders of mass unsolicited emails (Spam) continues to gain traction. Vast numbers of Spam emails are sent mainly from automatic botnets distributed over the world. One method for mitigating Spam in a computationally efficient manner is fast and accurate blacklisting of the senders. In this work we propose a new sender reputation mechanism that is based on an aggregated historical data-set which encodes the behavior of mail transfer agents over time. A historical data-set is created from labeled logs of received emails. We use machine learning algorithms to build a model that predicts the \emph{spammingness} of mail transfer agents in the near future. The proposed mechanism is targeted mainly at large enterprises and email service providers and can be used for updating both the black and the white lists. We evaluate the proposed mechanism using 9.5M anonymized log entries obtained from the biggest Internet service provider in Europe. Experiments show that proposed method detects more than 94% of the Spam emails that escaped the blacklist (i.e., TPR), while having less than 0.5% false-alarms. Therefore, the effectiveness of the proposed method is much higher than of previously reported reputation mechanisms, which rely on emails logs. In addition, the proposed method, when used for updating both the black and white lists, eliminated the need in automatic content inspection of 4 out of 5 incoming emails, which resulted in dramatic reduction in the filtering computational load.

Research on Behavior Statistic Based Spam Filter

Worm Intrusion Alarm Modeling Based on Network Traffic Character

Complex Network Based SMS Filtering Algorithm

Email Classification Using Behavior and Time Features

Fuzzy Decision Tree Based Inference Technology for Spam Behavior Recognition.

Analyzing and Detecting Adversarial Spam on a Large-scale Online APP Review System.

Implementation and Evaluation of Chinese Spam Filtering System

Filtering Spam In Social Tagging System With Dynamic Behavior Analysis

User behavior oriented web spam detection.

A Game Model for Adversarial Classification in Spam Filtering

Detecting Spammers via Aggregated Historical Data Set

Behavior-based Junk Mail Detection

Advances in anti-spam techniques

A Composite Intelligent Method For Spam Filtering

Filtering and Detection of Real-Time Spam Mail Based on a Bayesian Approach in University Networks

A Spam Filtering Method Based on Bayesian Neural Network

Content-based Spam Email Detection Using N-gram Machine Learning Approach

Detecting Spam on Sina Weibo

Classify E-mails by Support Vector Machine

Real-Time Statistical Rules for Spam Detection

Novel method for Chinese spam detection based on one-class support vector machines