Abstract:In recent years, spammers are now trying to obfuscate their intents by introducing hybrid spam e-mail combining both image and text parts, which is more challenging to detect in comparison to e-mails containing text or image only. The motivation behind this research is to design an effective approach filtering out hybrid spam e-mails to avoid situations where traditional text-based or image-baesd only filters fail to detect hybrid spam e-mails. To the best of our knowledge, a few studies have been conducted with the goal of detecting hybrid spam e-mails. Ordinarily, Optical Character Recognition (OCR) technology is used to eliminate the image parts of spam by transforming images into text. However, the research questions are that although OCR scanning is a very successful technique in processing text-and-image hybrid spam, it is not an effective solution for dealing with huge quantities due to the CPU power required and the execution time it takes to scan e-mail files. And the OCR techniques are not always reliable in the transformation processes. To address such problems, we propose new late multi-modal fusion training frameworks for a text-and-image hybrid spam e-mail filtering system compared to the classical early fusion detection frameworks based on the OCR method. Convolutional Neural Network (CNN) and Continuous Bag of Words were implemented to extract features from image and text parts of hybrid spam respectively, whereas generated features were fed to sigmoid layer and Machine Learning based classifiers including Random Forest (RF), Decision Tree (DT), Naive Bayes (NB) and Support Vector Machine (SVM) to determine the e-mail ham or spam.

Attention Mechanism and Support Vector Machine for Image-Based E-Mail Spam Filtering

A Late Multi-Modal Fusion Model for Detecting Hybrid Spam E-mail

Development of a Machine Learning Model for Image-based Email Spam Detection

Semantic Graph Based Convolutional Neural Network for Spam e-mail Classification in Cybercrime Applications

A Spam Filtering Method Based on Multi-Modal Fusion

Efficient Modeling of Spam Images

Robust multimedia spam filtering based on visual, textual, and audio deep features and random forest

Image Spam Classification Based on Convolutional Neural Network

DeepImageSpam: Deep Learning based Image Spam Detection

A Comprehensive Approach to Image Spam Detection: From Server to Client Solution

Analysis of e-Mail Spam Detection Using a Novel Machine Learning-Based Hybrid Bagging Technique

Email Spam Detection Using Hierarchical Attention Hybrid Deep Learning Method

DeepCapture: Image Spam Detection Using Deep Learning and Data Augmentation

A Detection Method for Social Network Images with Spam, Based on Deep Neural Network and Frequency Domain Pre-Processing

Spam image discrimination using support vector machine based on higher-order local autocorrelation feature extraction

Content-based Spam Email Detection Using N-gram Machine Learning Approach

Method of Image-Based Spam Filtering of E-Mails Based on Image Similarity Detection

Spam review detection using self attention based CNN and bi-directional LSTM

A Fast Image Retrieval Method Based on Svm and Imbalanced Samples in Filtering Multimedia Message Spam

Image Spam Filtering Using Fourier-Mellin Invariant Features

Application of Natural Language Processing and Machine Learning Boosted with Swarm Intelligence for Spam Email Filtering