A Comparative Study of PCA, ICA and Class-Conditional ICA for Naïve Bayes Classifier

Liwei Fan,Kim Leng Poh
DOI: https://doi.org/10.1007/978-3-540-73007-1_3
2007-01-01
Abstract:The performance of the Naïve Bayes classifier can be improved by appropriate preprocessing procedures. This paper presents a comparative study of three preprocessing procedures, namely Principle Component Analysis (PCA), Independent Component Analysis (ICA) and class-conditional ICA, for Naïve Bayes classifier. It is found that all the three procedures keep improving the performance of the Naïve Bayes classifier with the increase of the number of attributes. Although class-conditional ICA has been found to be superior to PCA and ICA in most cases, it may not be suitable for the case where the sample size for each class is not large enough.
What problem does this paper attempt to address?