Neural-Based Learning Classifier Systems

Dam Hai H.,Abbass Hussein A.,Lokan Chris,Yao Xin
DOI: https://doi.org/10.1109/TKDE.2007.190671
IF: 9.235
2008-01-01
IEEE Transactions on Knowledge and Data Engineering
Abstract:UCS, a sUpervised Classifier System, is an accuracy-based evolutionary learning classifier system for data mining classification tasks. UCS works through two stages: exploration and exploitation. During the exploration phase, a population of rules is evolved in order to represent a complete solution of the target problem. The exploitation phase is responsible for applying the rule-based knowledge obtained in the first phase when the system is exposed to unseen data. The representation of a rule in UCS as a univariate classification rule can be easily seen in a symbolic form, which is easy for a human to understand and comprehend (i.e. expressive power). However, the system may generate a large number of rules to cover the input space. Artificial neural networks normally provide a more compact and accurate representation. However, it is not a straightforward task to understand the network. In this paper, we propose a novel way to incorporate neural networks into UCS. The approach offers a good compromise between compactness, expressiveness, and accuracy. By using a simple artificial neural network as the classifier's action, we obtain smaller/compact population size, better generalization, while maintaining a reasonable level of expressiveness. We also apply negative correlation learning (NCL) during the training of the resultant neural network ensemble. NCL is shown to improve the generalization of the ensemble.
What problem does this paper attempt to address?