ANTI-SPAM TECHNOLOGY BASED ON BAYESIAN THEORY

Bai Yingcai

DOI: https://doi.org/10.3969/j.issn.1000-386X.2006.01.041

2006-01-01

Abstract:Spare has become wastage of productivity.Along with this,more and more antispam technology appear,Bayesian Filtering has some advantages among them.It is useful to do research on Bayesian Filtering for Chinese.

What problem does this paper attempt to address?

An Improved Bayesian with Application to Anti-Spam Email

詹川,卢显良,周旭,侯孟书

2005-01-01

Journal of Electronic Science and Technology

Abstract:Along with the wide application of e-mail nowadays, many spam e-mails flood into people's email-boxes and cause catastrophes to their study and life. In anti-spam e-mails campaign, we depend on not only legal measures but also technological approaches. The Bayesian classifier provides a simple and effective approach to discriminate classification. This paper presents a new improved Bayesian-based anti-spam e-mail filter. We adopt a way of attribute selection based on word entropy, use vector weights which are represented by word frequency, and deduce its corresponding formula. It is proved that our filter improves total performances apparently in our experiment.
An Anti-Spam E-mail Filtering Method Based on Bayesian

ZHAN Chuan,LU Xian-Liang,ZHOU Xu,HOU Meng-Shu,YUAN Lian-Hai

2005-01-01

Computer Science

Abstract:Along with wide application of e-mail nowadays,a large number of spam e-mails flood into people's life and bring catastrophe to their study and life. This paper presents a new Bayesian-based anti-spam e-mail filtering method. We adopt a way of attribute selection based on word entropy,use vectors which are represented by word frequency, and deduce its corresponding Bayesian formula. It is proved that our filter improves total performances apparently in our experiment.
Research On Advanced Filtering Algorithm For Anti-Spam Based On A Bayesian Classification Model

L Zhen,T Liang,S Kun,Mt Zhou

DOI: https://doi.org/10.1142/9789812701695_0012

2005-01-01

Abstract:Currently, naive Bayesian algorithm for Email filtering has been accepted widely and been applied in many commercial Email systems. However, facing with the still severe situation of spam Email, people are realizing gradually that depending on such a simple algorithm can't meet the practical needs for anti-spam. On the other hand, Bayesian network, as an important branch in the knowledge discovery area, has been researched and explored for a long period. The question of Email filter can be projected to a Bayesian network model. By doing so and utilizing Bayesian parameter estimation for some key nodes in the model, we can accomplish Email classification and discrimination based on probabilistic conditions. According to the experimental results, new algorithm has much higher rate to converge and more stable than the naive Bayesian one.
Implementation and Evaluation of Chinese Spam Filtering System

LI Xing,TIAN Ying,DUAN Hai-xin

DOI: https://doi.org/10.3321/j.issn:1000-8608.2005.z1.045

2005-01-01

Abstract:Spam has been a serious problem to email users for a long time.Anti-spam technique can be used to block not only spam but also unsolicited commercial mobile messages and VoIP phones.Here the authors give a survey of bayes filtering,introduce a Chinese spam filtering system and show the evaluation.It is shown that there are certain optimized values for the size of the training aggregate and the token numbers that are calculated to the final probability.If the size of the training aggregate exceeds the optimum value,the filtering effect will decrease a little and go to a constant as the aggregate size increases.
Research on Advanced Filtering Algorithm for Spam Email Based on Bayes Parameter Estimation

LIU Zhen,SHE Kun,ZHOU Ming-Tian

DOI: https://doi.org/10.3969/j.issn.1002-137X.2005.09.012

2005-01-01

Computer Science

Abstract:Presently, naive Bayes algorithm for Email filtering has been accepted widely for its simplicity and plainness. At the same time, the algorithm has also been applied in many commercial Email system However, facing with the persisted severe situation of spam Email, people are realizing gradually that depending on such a simple algorithm can' t meet the practical needs for anti-spam. On the other hand, Bayes network, as an important branch in knowledge dis- covery area, has been researched and explored for a long time. The question of Email filter can be projected to a Bayes network model too. By doing so and utilizing Bayes parameter estimation for key node in the model, we can accomplish Email classification and discrimination on probabilistic condition. According to the testing results, new algorithm has much higher rate to converge and stabilization than the naive Bayes one.
SELF-ADAPTABLE SPAM FILTERING BASED ON BAYESIAN ALGORITHM

Ning Shaojun,Zou Hengming

DOI: https://doi.org/10.3969/j.issn.1000-386X.2007.11.070

2007-01-01

Abstract:Naive Bayesian algorithm has widely been applied to spam filtering for its simpleness.But when the attributes of spams change,effectiveness of this algorithm falls greatly.A self-adaptable spam filtering method based on bayesian algorithm is presented,which adopts a way of attribute selection based on word entropy and has ability of continuous learning.
Simplified Chinese spam mail filter:design and performance evaluation

Xu Yong

DOI: https://doi.org/10.3321/j.issn:1002-8331.2007.25.039

2007-01-01

Abstract:Paths to solving and methods of filtering unsolicited bulk e-mails,also known as spam,have been analyzed.And the method based on keyword and the statistical learning have been analyzed.Then a new method which is a combination of the two methods have been proposed.The method to filter spam using the na ve Bayesian decision theory,the nearest-neighbor classification,and the linear classification based the perceptron criterion function which is used in pattern classification has been introduced.The feature set used in the three theories have been gotten by mutual information.By comparied the three decision theories,the advantages and disadvantages of them has been presented.At same time,a good idea to filtering spam using mutual information has been pointed out in the paper.
Research of a Hybrid Spam Filtering Algorithm

QIN Zhi-guang,LUO Qin,ZHANG Feng-li

DOI: https://doi.org/10.3969/j.issn.1001-0548.2007.03.001

2007-01-01

Abstract:Bayes filtering has a dominant place in the area of spam filtering for its strong categorization and high precision. Artificial immune system has become a new embranchment in computing intelligence for its good self-learning, self-adaptability, and robusticity. This paper analyzes the basic principle of Bayes and artificial immune systems, proposes a hybrid spam filtering algorithm based on Bayes and artificial immune system, and then designs and develops the spam filtering system based on this algorithm. It is proved that this system is effective to filter spam in English and Chinese e-mail corpus.
An optimized spam filtering method based on AODE

Bin Chen,Shoubin Dong

2009-01-01

Journal of Information and Computational Science

Abstract:With the development of spam filtering techniques, many machine-learning methods are introduced to solve spam problems. Among all these methods, Naive Bayes is widely used in Spam detecting due to its simplicity and efficiency. However Naive Bayes is based on the assumption of attribute independence and this assumption is not fit for the reality and may constrain the accuracy. This paper firstly introduced the state-of-arts of the improvement techniques to weaken this assumption, and then proposed a method based on ADOE (Averaged One-Dependence Estimators). This method has been implemented on our developed filter by making some training optimization. The experimental results on standard data set show that this improvement can enhance the performance of the Naive Bayes filter. Copyright ©2009 Binary Information Press.
CONTINUOUS BAYESIAN SPAM FILTERING BASED ON CONTENT

Yin Haibo,Ning Shaojun,Wang Dong

DOI: https://doi.org/10.3969/j.issn.1000-386X.2007.01.061

2007-01-01

Abstract:Naive Bayesian algorithm has widely been applied to field of spam filtering.Under such methods,probability of each word's occurrence in a training sample set is computed,and emails with matching probabilities of the same words are then marked as spam.However,such conventional Bayesian algorithms suffer two drawbacks that limit their effectiveness.First,when its attributes changed,its effectiveness falls greatly.Second,these conventional Bayesian algorithms do not consider the interrelations that might exist among words.This paper presents a Continuous Bayesian Spam Filtering Based on Content that takes into consideration of the interrelations existing among words has ability of continuous learning.
PRIS Kidult Anti-SPAM Solution at the TREC 2005 Spam Track: Improving the Performance of Naive Bayes for Spam Detection.

Zhen Yang,Weiran Xu,Bo Chen,Jiani Hu,Jun Guo

2005-01-01

Abstract:Technical Report KidSPAM xxxx Abstract. Recently, the spam already constituted a serious problem for both e-mail users and Internet Service Providers (ISP). Solutions to the abuse of spam would be both technical and legal regulatory. This paper reports our solution for the TREC 2005 spam track, in which we consider the use of Naive Bayes spam filter for its desirable properties (simplicity, low time and memory requirements, etc.). Then the approaches to modify the Naive Bayes by simply introducing weight and classifier assemble based on dynamic threshold are proposed, which can help to improve the accuracy of a Naive Bayes spam classifier dramatically. Additionally, we discuss some steps that must be adopted naturally thought before, such as stop list, word stemming, feature selection, class prior probabilities. The theory analysis implies these steps are not necessarily the best way to extend the Bayesian classifier, and these were also verified empirically. Many of these techniques appear to be counterintuitive but can be explained by the statistical properties of e-mail itself. Experiment results of TREC 2005 spam track demonstrate the effectiveness of the proposed method.
Implementing Spare Filter by Improving Naive Bayesian Algorithm

Wei Zheng,Wen Shen,Yingpeng Zhang

DOI: https://doi.org/10.3969/j.issn.1000-2758.2010.04.027

2010-01-01

Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University

Abstract:Our aim is to decrease the probability under which the spam filter misjudges legal e-mail as spam by adjusting the k value of the naive Bayesian algorithm, thus minimizing Internet users' economic loss. Section 1 of the full paper analyzes the classification deficiencies of the naive Bayesian algorithm. Section 2 implements the spam filter by improving the naive Bayesian algorithm through obtaining the k value as shown in eq. (8). Section 3 tested the spam filter by adjusting the k value of our improved Bayesian algorithm; the test results, presented in Table 2, and their comparison, given in Figs. 1, 2 and 3, show preliminarily that the spam filter that uses our improved Bayesian algorithm can increase the recall rate by 10% and the accuracy by 5%, thus effectively decreasing the probability of misjudging legal e-mails as spams.
Spam message online filtering system based on hash function and naive Bayes

XU Cong-fu

2008-01-01

Journal of Computer Applications

Abstract:A spam message online filtering system was proposed,integrating the black-white list filtering module and synthesis value function module.A two-layer hash method and a probability computing method based on naive Bayes were used to analyze the suspect spam message in depth in terms of content,length,frequency and others.Excellent real-time and features in filtering the great many of short messages were achieved,and the problems of traditional spam message filtering system was resolved efficiently.
A Spam Filtering Method Based on Bayesian Neural Network

LI Hui-juan,GAO Feng,GUAN Xiao-hong,HUANG Liang

DOI: https://doi.org/10.3969/j.issn.1000-7180.2005.04.029

2005-01-01

Abstract:Spam filtering is an important task in the application of Internet, which receives increasing emphasis. In this paper a method of spam filtering based on the Bayesian Neural Network (BNN) algorithm is presented. The Bayesian approach is used for neural network to learn from the user given training spam/normal e-mail set. And the number of features needed as the input of the BNN model is reduced effectively through the proposed feature selection approach, where information gain is chosen as a criterion. The result of the experiment shows that the method in this paper can filter spam effectively.
The Optimization Analysis of Phishing Email Filtering in Network Fraud based on Improved Bayesian Algorithm

Yahao Zhang,Jin Pang,Hongshan Yin

DOI: https://doi.org/10.46300/9106.2022.16.62

2022-01-13

Abstract:Mail transmission was not only the main function of information system, but also the main way of network virus and Trojan horse transmission, which has a key impact on the running state of information. In order to deal with the threats of network viruses and Trojans and improve the level of e-mail management, this paper studies the filtering of information system, and proposes a phishing e-mail filtering method based on Improved Bayesian model. MATLAB simulation results show that the consistency p between the amount of data sent by e-mail and the amount received is good, the consistency rate reached 92.3%. the data security level is 95%, encryption proportion / data proportion ratio under Bayesian optimization are higher than those of unfiltered method,which up to 97.2%. Therefore, the Bayesian optimization model constructed in this paper can meet the needs of phishing email filtering in information communication at this stage.
Filtering and Detection of Real-Time Spam Mail Based on a Bayesian Approach in University Networks

Maksim Sharabov,Georgi Tsochev,Veska Gancheva,Antoniya Tasheva

DOI: https://doi.org/10.3390/electronics13020374

IF: 2.9

2024-01-17

Electronics

Abstract:With the advent of digital technologies as an integral part of today's everyday life, the risk of information security breaches is increasing. Email spam, commonly known as junk email, continues to pose a significant challenge in the digital realm, inundating inboxes with unsolicited and often irrelevant messages. This relentless influx of spam not only disrupts user productivity but also raises security concerns, as it frequently serves as a vehicle for phishing attempts, malware distribution, and other cyber threats. The prevalence of spam is fueled by its low-cost dissemination and its ability to reach a wide audience, exploiting vulnerabilities in email systems. This paper marks the inception of an in-depth investigation into the viability and potential implementation of a robust spam filtering and prevention system tailored explicitly to university networks. With the escalating threat of email-based hacking attacks and the incessant deluge of spam, the need for a comprehensive and effective defense mechanism within academic institutions becomes increasingly imperative. In exploring potential solutions, this study delves into the applicability and efficacy of Bayesian filters, a class of probabilistic classifiers renowned for their aptitude in distinguishing between legitimate emails and spam messages. Bayesian filters utilize statistical algorithms to analyze email content, learning patterns and features to accurately categorize incoming emails.

engineering, electrical & electronic,computer science, information systems,physics, applied
Approach of improving incremental Bayes based spam filter by data amoothing

WANG Zuhui,JIANG Wei

DOI: https://doi.org/10.3778/j.issn.1002-8331.2012.16.005

2012-01-01

Abstract:When applied to deal with Spam Filter task, Nave Bayes almost suffers from the sparse data problem.Moreover, this problem is hardly to be solved by expanding the corpora, since the distribution of features in the corpora complies with the Zipf’s law. Three aspects of work are done to alleviate the above problem in this paper. Firstly,a smoothing algorithm is adopted and embedded into Nave Bayes to estimate the compensation probability of unseen feature. Secondly, domain term extraction and semantic knowledge are introduced in the Spam Filter model to enhance the performance of semantic process. Thirdly, an incremental learning method is introduced to perform the iterative learning. The experimental corpora comes from the Ling-Spam, and the result of open test shows that this method increases the precision by 2.51%. In addition, the experiment in National 863 Evaluation on Text Classification shows that the Nave Bayes performance with Good-Turing algorithm is 3.05% higher than that with Laplace.
Spam filtering with several novel bayesian classifiers

Chuanliang Chen,Yingjie Tian,Chunhua Zhang

DOI: https://doi.org/10.1109/ICPR.2008.4761531

2008-01-01

Abstract:In this paper, we report our work on spam filtering with three novel Bayesian classification methods: aggregating one-dependence estimators (AODE), hidden Naive Bayes (HNB), locally weighted learning with Naive Bayes (LWNB). Other four traditional classifiers: Naive Bayes, k nearest neighbor (kNN), support vector machine (SVM), C4.5 are also performed for comparison. Four feature selection methods: gain ratio, information gain, symmetrical uncertainty and ReliefF, are used to select relevant words for spam filtering. Results of experiments on two corpora show the promising capabilities of Bayesian classifiers for spam filtering, especial for that of AODE.
A Spam Filter Approach with the Improved Machine Learning Technology

Xiu-Li Pang,Yu-Qiang Feng,Wei Jiang

DOI: https://doi.org/10.1109/icnc.2007.143

2007-01-01

Abstract:This paper presents an improved machine learning technology to automatically filter out spam. Two kinds of work are done by us. Firstly, in order to overcome the sparse data problem, which is almost suffered from by all the corpus based supervised learning classifiers, we propose to incorporate the smoothing algorithm into the Naive Bayes (NB) model. Secondly, support vector machine (SVM) is good at the classification task with the high dimension feature space, and has the good generalization in small-scale samples. A high-efficient SVM is presented to reduce the storage requirement and decrease the time computing complexity. Thirdly, a specialty word extraction algorithm based on information entropy is presented in this paper, which can improve the performance of Chinese word segmentation, accordingly, improve the spam filter task in English and in Chinese. Experiments show that the improvement in NB acquires by 1.38% precision, and it is 0.69% higher precision than the SVM.
Advances in anti-spam techniques

TAN Ying,ZHU Yuan-chun

DOI: https://doi.org/10.3969/j.issn.1673-4785.2010.03.001

2010-01-01

Abstract:As the threat of spam on the Internet grows increasingly severe,anti-spam techniques have become a hotspot for researchers.The authors reviewed the history,current situation,and latest advances in research on spam control.First,we introduced and analyzed three different types of feature extraction methods for email.These were text-based,image-based,and behavior-based approaches.Then,current anti-spam techniques were described and discussed.These included laws,simple methods,and intelligent approaches.After that,performance evalua-tion methods and standard data sets were discussed.Finally,we summarized the current research on anti-spam techniques and pointed out directions for future research,including improvements to e-mail feature extraction tech-niques,improvements to laws,and new intelligent anti-spam approaches.

ANTI-SPAM TECHNOLOGY BASED ON BAYESIAN THEORY

An Improved Bayesian with Application to Anti-Spam Email

An Anti-Spam E-mail Filtering Method Based on Bayesian

Research On Advanced Filtering Algorithm For Anti-Spam Based On A Bayesian Classification Model

Implementation and Evaluation of Chinese Spam Filtering System

Research on Advanced Filtering Algorithm for Spam Email Based on Bayes Parameter Estimation

SELF-ADAPTABLE SPAM FILTERING BASED ON BAYESIAN ALGORITHM

Simplified Chinese spam mail filter:design and performance evaluation

Research of a Hybrid Spam Filtering Algorithm

An optimized spam filtering method based on AODE

CONTINUOUS BAYESIAN SPAM FILTERING BASED ON CONTENT

PRIS Kidult Anti-SPAM Solution at the TREC 2005 Spam Track: Improving the Performance of Naive Bayes for Spam Detection.

Implementing Spare Filter by Improving Naive Bayesian Algorithm

Spam message online filtering system based on hash function and naive Bayes

A Spam Filtering Method Based on Bayesian Neural Network

The Optimization Analysis of Phishing Email Filtering in Network Fraud based on Improved Bayesian Algorithm

Filtering and Detection of Real-Time Spam Mail Based on a Bayesian Approach in University Networks

Approach of improving incremental Bayes based spam filter by data amoothing

Spam filtering with several novel bayesian classifiers

A Spam Filter Approach with the Improved Machine Learning Technology

Advances in anti-spam techniques