Abstract:Rule learning is one of the most popular areas in machine learning research, because the outcome of learning is to produce a set of rules, which not only provides accurate predictions but also shows a transparent process of mapping inputs to outputs. In general, rule learning approaches can be divided into two main types, namely, ‘divide and conquer’ and ‘separate and conquer’. The former type of rule learning is also known as Top-Down Induction of Decision Trees, which means to learn a set of rules represented in the form of a decision tree. This approach results in the production of a large number of complex rules (usually due to the replicated sub-tree problem), which lowers the computational efficiency in both the training and testing stages, and leads to the overfitting of training data. Due to this problem, researchers have been gradually motivated to develop ‘separate and conquer’ rule learning approaches, also known as covering approaches, by learning a set of rules on a sequential basis. In particular, a rule is learned and the instances covered by this rule are deleted from the training set, such that the learning of the next rule is based on a smaller training set. In this paper, we propose a new algorithm, GIBRG, which employs Gini-index to measure the quality of each rule being learned, in the context of ‘separate and conquer’ rule learning. Our experiments show that the proposed algorithm outperforms both decision tree learning algorithms (C4.5 and CART) and ‘separate and conquer’ approaches (Prism). In addition, it also leads to a smaller number of rules and rule terms, thus being more computationally efficient and less prone to overfitting.

Recursive and Incremental Learning Ga Featuring Problem-Dependent Rule-Set

Recursive Learning of Genetic Algorithms with Task Decomposition and Varied Rule Set

An Incremental Learning Algorithm Based on Support Vector Domain Classifier

RLGA: A Reinforcement Learning Based Genetic Algorithm

Recursive Reinforcement Learning

An Improved Population-Based Incremental Learning Method For Inverse Problems

Learning Interpretable Rules for Scalable Data Representation and Classification

RRL: A Scalable Classifier for Interpretable Rule-Based Representation Learning

Deep Reinforcement Learning using Genetic Algorithm for Parameter Optimization

Incremental Versus Non-incremental: Data and Algorithms Based on Ordering Relations.

Continual Learning with Recursive Gradient Optimization

An Incremental Rule Induction Algorithm Based on Ordering Relations

Learning Classifier System Ensemble and Compact Rule Set

Learning Lazy Rules to Improve

HGR 2.0: A New Rule Induction Algorithm

RL-GEP: Symbolic Regression Via Gene Expression Programming and Reinforcement Learning.

SCGA: Controlling Genetic Algorithms with Sarsa(0)

A Robust Incremental Learning Algorithm Based on Growing and Pruning Strategy

Multi-Layer Incremental Induction

Parallelized Reverse Curriculum Generation

Induction of classification rules by Gini-index based rule generation