Abstract:We study the problem of balancing effectiveness and efficiency in automated feature selection. Feature selection is to find an optimal feature subset from large feature space. After exploring many feature selection methods, we observe a computational dilemma: 1) traditional feature selection (e.g., mRMR) is mostly efficient, but difficult to identify the best subset; 2) the emerging reinforced feature selection automatically navigates feature space to search the best subset, but is usually inefficient. Are automation and efficiency always apart from each other? Can we bridge the gap between effectiveness and efficiency under automation? Motivated by this dilemma, we aim to develop a novel feature space navigation method. In our preliminary work, we leveraged interactive reinforcement learning to accelerate feature selection by external trainer-agent interaction. Our preliminary work can be significantly improved by modeling the structured knowledge of its downstream task (e.g., decision tree) as learning feedback. In this journal version, we propose a novel interactive and closed-loop architecture to simultaneously model interactive reinforcement learning (IRL) and decision tree feedback (DTF). Specifically, IRL is to create an interactive feature selection loop and DTF is to feed structured feature knowledge back to the loop. The DTF improves IRL from two aspects. First, the tree-structured feature hierarchy generated by decision tree is leveraged to improve state representation. In particular, we represent the selected feature subset as an undirected graph of feature-feature correlations and a directed tree of decision features. We propose a new embedding method capable of empowering Graph Convolutional Network (GCN) to jointly learn state representation from both the graph and the tree. Second, the tree-structured feature hierarchy is exploited to develop a new reward scheme. In particular, we personalize reward assignment of agents based on decision tree feature importance. In addition, observing agents’ actions can also be a feedback, we devise another new reward scheme, to weigh and assign reward based on the selected frequency ratio of each agent in historical action records. Finally, we present extensive experiments with real-world datasets to demonstrate the improved performances of our method.

RangeTree: A Feature Selection Algorithm for C4.5 Decision Tree

FROD: an Efficient Framework for Optimizing Decision Trees in Packet Classification

DTRadar: Accelerating Search Process of Decision Trees in Packet Classification.

An Improved Network Traffic Classification Algorithm Based on Hadoop Decision Tree

A cost sensitive decision tree algorithm with two adaptive mechanisms

Taiga: Performance Optimization of the C4.5 Decision Tree Construction Algorithm

Feature selection for optimizing traffic classification

Application of a Decision Tree Model for Predicting Diabetic Retinopathy

A New Feature Selection Method For Internet Traffic Classification Using Ml

Cost-sensitive feature selection using random forest: Selecting low-cost subsets of informative features

Community-Based Dandelion Algorithm-Enabled Feature Selection and Broad Learning System for Traffic Flow Prediction

Heuristic Mode Research and Application of Decision Tree Algorithm

Feature Selection Methods for Cost-Constrained Classification in Random Forests

Interactive Reinforcement Learning for Feature Selection with Decision Tree in the Loop

Research on Network Traffic Intrusion Detection Based on CFS-S Feature Selection Algorithm

Decision Variants for the Automatic Determination of Optimal Feature Subset in RF-RFE

CBFS: A Clustering-Based Feature Selection Mechanism for Network Anomaly Detection

Feature selection based on run covering

Optimizing Traffic Classification Using Hybrid Feature Selection

Superfast Selection for Decision Tree Algorithms

Feature Selection and Classification Using Flexible Neural Tree