Abstract:Self-adaptive attribute weighting for Naive Bayes classification.Using Artificial Immune Systems (AIS) for attribute weighting.Seamlessly integrating learning objective and AIS affinity function for attribute weighting.Experiments on 42 real-world datasets demonstrating superb performance gain. Naive Bayes (NB) is a popular machine learning tool for classification, due to its simplicity, high computational efficiency, and good classification accuracy, especially for high dimensional data such as texts. In reality, the pronounced advantage of NB is often challenged by the strong conditional independence assumption between attributes, which may deteriorate the classification performance. Accordingly, numerous efforts have been made to improve NB, by using approaches such as structure extension, attribute selection, attribute weighting, instance weighting, local learning and so on. In this paper, we propose a new Artificial Immune System (AIS) based self-adaptive attribute weighting method for Naive Bayes classification. The proposed method, namely AISWNB, uses immunity theory in Artificial Immune Systems to search optimal attribute weight values, where self-adjusted weight values will alleviate the conditional independence assumption and help calculate the conditional probability in an accurate way. One noticeable advantage of AISWNB is that the unique immune system based evolutionary computation process, including initialization, clone, section, and mutation, ensures that AISWNB can adjust itself to the data without explicit specification of functional or distributional forms of the underlying model. As a result, AISWNB can obtain good attribute weight values during the learning process. Experiments and comparisons on 36 machine learning benchmark data sets and six image classification data sets demonstrate that AISWNB significantly outperforms its peers in classification accuracy, class probability estimation, and class ranking performance.

Weighted naive Bayesian classification based on attribute correlation

Weighted Naive Bayes Classification Algorithm Based on Correlation Coefficients

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Attribute Weighted Naive Bayesian Classification Algorithm

An Improved Weighted Naive Bayes Classification Algorithm Using Feature Correlation

Improved Weighted Naive Bayes Classification Algorithm Based on Attribute Selection

Naive Bayesian Classification Algorithm Based on Attribute Clustering under Different Classification

A Locally Attribute Weighted Naive Bayes Classifier

Dual instance and attribute weighting for Naive Bayes classification

Attribute weighting: How and when does it work for Bayesian Network Classification

Artificial Immune System For Attribute Weighted Naive Bayes Classification

Improve the Accuracy of One Dependence Augmented Naive Bayes by Weighted Attribute

An attributes weighted Naïve Bayesian Classifier

Dynamic k-nearest-neighbor naive bayes with attribute weighted

A Attribute Weighted Naive Bayes Algorithm Based on the Dimension Reduction

Naive Bayes Text Classifiers: a Locally Weighted Learning Approach

A Double Layer Bayesian Classifier Using Conditional Mutual Information

Attribute Weighting Via Differential Evolution Algorithm for Attribute Weighted Naive Bayes (WNB)

Attribute weighted Naive Bayes classification based on a Space Search Optimization algorithm

Self-adaptive attribute weighting for Naive Bayes classification

Attribute weighted Naεve Bayes classification