Abstract:Despite its unrealistic independence assumption, the Naive Bayes classifier is remarkably successful in practice. In the Naive Bayes classifier, all variables are assumed to be nominal variables, it means that each variable has a finite number of values. But in large databases, the variables (or fields) often take continuous values or have a large number of numerical values. So many researchers discussed the discretization (or crisp partitioning) of the domain of the continuous variables. We generalize the Naive Bayes classifier to the situation in which the fuzzy partition of the variable domains instead of discretization is taken. Therefore each variable in the Fuzzy Naive Bayes classifier can take a linguistic value or fuzzy set. From the observed data set one method of estimating the conditional probabilities in the Fuzzy Naive Bayes classifier is proposed in this paper. For each numeric input the method to predict its class label using the fuzzy Naive Bayes classifier is presented. In the training phase of the classifier, the training data (just including the feature variables without class labels) is first clustered in an unsupervised way by fuzzy c-means or a similar algorithm. Then the optimal cluster centers of training data are used to determine the fuzzy partition of the feature variables space. This generalization can decrease the complexity of learning optimal discretization which the classical Naive Bayes Classifier often faces, reduce the loss of information because of the discretization and increase the power of dealing with imprecise data and the large databases. Some well-known classification problems in the machine learning field have been tested in this paper, the results show that the Fuzzy Naive Bayes classifier is an alternative and effective tool to deal with the classification problem which has continuous variables.

Bayesian Clustering for Ordinal Data Based on Finite Mixture Models of Latent Variables

Bayesian Mixture Models With Focused Clustering for Mixed Ordinal and Nominal Data

Without Pain -- Clustering Categorical Data Using a Bayesian Mixture of Finite Mixtures of Latent Class Analysis Models

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Clustering Sparse Binary Data with Hierarchical Bayesian Bernoulli Mixture Model

Clustering longitudinal ordinal data via finite mixture of matrix-variate distributions

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Bayesian mixture modeling for multivariate conditional distributions

Rank-based Bayesian clustering via covariate-informed Mallows mixtures

A mixture distribution for modelling bivariate ordinal data

Bayesian clustering of mixed-type data with relevant variable identification

Optimal Bayesian estimators for latent variable cluster models

Bayesian Rank-Clustering

A Bayesian Approach to Restricted Latent Class Models for Scientifically-Structured Clustering of Multivariate Binary Outcomes

Mixture of Latent Trait Analyzers for Model-Based Clustering of Categorical Data

A Bayesian approach for clustering and exact finite-sample model selection in longitudinal data mixtures

Hierarchical Mixture of Finite Mixtures

A Bayesian approach for clustering skewed data using mixtures of multivariate normal-inverse Gaussian distributions

Structured Mixture of Continuation-ratio Logits Models for Ordinal Regression

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Fuzzy Naive Bayes Classifier Based on Fuzzy Clustering