Abstract:Despite its unrealistic independence assumption, the Naive Bayes classifier is remarkably successful in practice. In the Naive Bayes classifier, all variables are assumed to be nominal variables, it means that each variable has a finite number of values. But in large databases, the variables (or fields) often take continuous values or have a large number of numerical values. So many researchers discussed the discretization (or crisp partitioning) of the domain of the continuous variables. We generalize the Naive Bayes classifier to the situation in which the fuzzy partition of the variable domains instead of discretization is taken. Therefore each variable in the Fuzzy Naive Bayes classifier can take a linguistic value or fuzzy set. From the observed data set one method of estimating the conditional probabilities in the Fuzzy Naive Bayes classifier is proposed in this paper. For each numeric input the method to predict its class label using the fuzzy Naive Bayes classifier is presented. In the training phase of the classifier, the training data (just including the feature variables without class labels) is first clustered in an unsupervised way by fuzzy c-means or a similar algorithm. Then the optimal cluster centers of training data are used to determine the fuzzy partition of the feature variables space. This generalization can decrease the complexity of learning optimal discretization which the classical Naive Bayes Classifier often faces, reduce the loss of information because of the discretization and increase the power of dealing with imprecise data and the large databases. Some well-known classification problems in the machine learning field have been tested in this paper, the results show that the Fuzzy Naive Bayes classifier is an alternative and effective tool to deal with the classification problem which has continuous variables.

Naive Bayes Text Classifiers: a Locally Weighted Learning Approach

A Technique For Improving The Performance Of Naive Bayes Text Classification

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Naive Bayes Based Criminal Text Classification of Unbalanced Classes

Locally Weighted Learning for Naive Bayes Classifier

Evolutionary Lazy Learning for Naive Bayes Classification

Fuzzy Naive Bayes Classifier Based on Fuzzy Clustering

A Novel Text Classification Algorithm Based on Naïve Bayes and KL-Divergence

Adapting Hidden Naive Bayes for Text Classification

Semi-Supervised Multinomial Naive Bayes for Text Classification by Leveraging Word-Level Statistical Constraint

Attribute weighted Naive Bayes classification based on a Space Search Optimization algorithm

SNNB: A Selective Neighborhood Based Naïve Bayes for Lazy Learning.

Enhancing SNNB with Local Accuracy Estimation and Ensemble Techniques

Improved text classification methods based on weighted adjustments

Varying Naive Bayes Models with Applications to Classification of Chinese Text Documents

A Double Layer Bayesian Classifier Using Conditional Mutual Information

IMPROVING MULTI-LABEL TEXT CLASSIFICATION USING WEIGHTED INFORMATION GAIN AND CO-TRAINED MULTINOMIAL NAÏVE BAYES CLASSIFIER

Finding The Optimal Feature Representations For Bayesian Network Learning

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Text Classification Using Self-Structure Extended Multinomial Naive Bayes

Improving Text Classification Using Local Latent Semantic Indexing