Abstract:In recent years, spammers are now trying to obfuscate their intents by introducing hybrid spam e-mail combining both image and text parts, which is more challenging to detect in comparison to e-mails containing text or image only. The motivation behind this research is to design an effective approach filtering out hybrid spam e-mails to avoid situations where traditional text-based or image-baesd only filters fail to detect hybrid spam e-mails. To the best of our knowledge, a few studies have been conducted with the goal of detecting hybrid spam e-mails. Ordinarily, Optical Character Recognition (OCR) technology is used to eliminate the image parts of spam by transforming images into text. However, the research questions are that although OCR scanning is a very successful technique in processing text-and-image hybrid spam, it is not an effective solution for dealing with huge quantities due to the CPU power required and the execution time it takes to scan e-mail files. And the OCR techniques are not always reliable in the transformation processes. To address such problems, we propose new late multi-modal fusion training frameworks for a text-and-image hybrid spam e-mail filtering system compared to the classical early fusion detection frameworks based on the OCR method. Convolutional Neural Network (CNN) and Continuous Bag of Words were implemented to extract features from image and text parts of hybrid spam respectively, whereas generated features were fed to sigmoid layer and Machine Learning based classifiers including Random Forest (RF), Decision Tree (DT), Naive Bayes (NB) and Support Vector Machine (SVM) to determine the e-mail ham or spam.

Efficient Modeling of Spam Images

Largemargin Classification for Combating Disguise Attacks on Spam Filters

On Robust Image Spam Filtering Via Comprehensive Visual Modeling

Feature Selection for Image Spam Classification

Fusion of text and image features: A new approach to image spam filtering

A Comprehensive Approach to Image Spam Detection: From Server to Client Solution

Spam Image Classification Model Based on Kolmogorov Complexity

Noise analysis for text-based spam images

Image Spam Identifying Algorithm Based on Color and Corner Feature

Method of Image-Based Spam Filtering of E-Mails Based on Image Similarity Detection

Text Localization In Spam Image Using Edge Features

A Late Multi-Modal Fusion Model for Detecting Hybrid Spam E-mail

A comprehensive approach to image spam detection

Image Spam Classification Based on Low-Level Image Features

Feature Point Analysis for Image Spam E-Mail Detection

Image Spam Filtering Using Fourier-Mellin Invariant Features

A Detection Method for Social Network Images with Spam, Based on Deep Neural Network and Frequency Domain Pre-Processing

Image Spam Classification Model Based on Color and Edge Histogram Statistics

A Spam Filtering Method Based on Multi-Modal Fusion

Spam image discrimination using support vector machine based on higher-order local autocorrelation feature extraction

Attention Mechanism and Support Vector Machine for Image-Based E-Mail Spam Filtering