Abstract:Despite its unrealistic independence assumption, the Naive Bayes classifier is remarkably successful in practice. In the Naive Bayes classifier, all variables are assumed to be nominal variables, it means that each variable has a finite number of values. But in large databases, the variables (or fields) often take continuous values or have a large number of numerical values. So many researchers discussed the discretization (or crisp partitioning) of the domain of the continuous variables. We generalize the Naive Bayes classifier to the situation in which the fuzzy partition of the variable domains instead of discretization is taken. Therefore each variable in the Fuzzy Naive Bayes classifier can take a linguistic value or fuzzy set. From the observed data set one method of estimating the conditional probabilities in the Fuzzy Naive Bayes classifier is proposed in this paper. For each numeric input the method to predict its class label using the fuzzy Naive Bayes classifier is presented. In the training phase of the classifier, the training data (just including the feature variables without class labels) is first clustered in an unsupervised way by fuzzy c-means or a similar algorithm. Then the optimal cluster centers of training data are used to determine the fuzzy partition of the feature variables space. This generalization can decrease the complexity of learning optimal discretization which the classical Naive Bayes Classifier often faces, reduce the loss of information because of the discretization and increase the power of dealing with imprecise data and the large databases. Some well-known classification problems in the machine learning field have been tested in this paper, the results show that the Fuzzy Naive Bayes classifier is an alternative and effective tool to deal with the classification problem which has continuous variables.

SubTree Augmented Naïve Bayesian classifier based on the fuzzy equivalence partition of attribute variables

Tree Augmented Naïve possibilistic network classifier.

Structure Extension of Tree-Augmented Naive Bayes

Learning Robust Bayesian Network Classifiers in the Space of Markov Equivalent Classes

A Selective Tree-Augmented Bayesian Network Classifier Based on Rough Set Theory

Selective Augmented Bayesian Network Classifiers Based on Rough Set Theory

A Smart Design for the TAN Classifier

Improving Tree Augmented Naive Bayes for Class Probability Estimation

A NEW BAYESIAN TREE CLASSIFIER AND ITS APPLICATION

Hierarchical Dependency Constrained Tree Augmented Naive Bayes Classifiers for Hierarchical Feature Spaces

Fuzzy Naive Bayes Classifier Based on Fuzzy Clustering

Generalized tree augmented naive bayes

Directed Tree Algorithm Based on TAN Classifiers

Learning Tree-Augmented Naive Bayesian Network by Reduced Space Requirements

Tree-Augmented Naive Bayes Ensembles

Adjusting Dependence Relations for Semi-Lazy TAN Classifiers

Structure Extension Of Tan Through Greedy Search

Learning High-Dependence Bayesian Network Classifier with Robust Topology

Learning hybrid Bayesian network based on divide and conquer strategy

Equivalent Classes of TAN Classifier Structure and Their Application on Learning Algorithm

Comparison of Two Learning Methods of the Tree Augmented Nave Bayesian Network Classifier