Abstract:In this paper, we initiate study of the computational power of adaptive and non-adaptive monotone decision trees - decision trees where each query is a monotone function on the input bits. In the most general setting, the monotone decision tree height (or size) can be viewed as a measure of non-monotonicity of a given Boolean function. We also study the restriction of the model by restricting (in terms of circuit complexity) the monotone functions that can be queried at each node. This naturally leads to complexity classes of the form DT(mon-C) for any circuit complexity class C, where the height of the tree is O(log n), and the query functions can be computed by monotone circuits in the class C. In the above context, we prove the following characterizations and bounds. For any Boolean function f, we show that the minimum monotone decision tree height can be exactly characterized (both in the adaptive and non-adaptive versions of the model) in terms of its alternation (alt(f) is defined as the maximum number of times that the function value changes, in any chain in the Boolean lattice). We also characterize the non-adaptive decision tree height with a natural generalization of certification complexity of a function. Similarly, we determine the complexity of non-deterministic and randomized variants of monotone decision trees in terms of alt(f). We show that DT(mon-C) = C when C contains monotone circuits for the threshold functions (for e.g., if C = TC0). For C = AC0, we are able to show that any function in AC0 can be computed by a sub-linear height monotone decision tree with queries having monotone AC0 circuits. To understand the logarithmic height case in case of AC0 i.e., DT(mon-AC0), we show that functions in DT(mon-AC0) have AC0 circuits with few negation gates.

Induction of Monotonic Decision Trees

Large-margin Feature Selection for Monotonic Classification

Fraudulent Firm Classification Using Monotonic Classification Techniques

Feature Selection for Monotonic Classification

Monotonic classification: an overview on algorithms, performance measures and data sets

Feature Selection for Monotonic Classification Via Maximizing Monotonic Dependency

A New Method for Learning Decision Tree Classifier

Monotone Learning

Power of Decision Trees with Monotone Queries

A Review: the Effects of Imperfect Data on Incremental Decision Tree

Novel Design of Decision-Tree-Based Support Vector Machines Multi-Class Classifier

Building decision trees for the multi-class imbalance problem

Dive into Decision Trees and Forests: A Theoretical Demonstration

Optimal Mixed Integer Linear Optimization Trained Multivariate Classification Trees

Strong Optimal Classification Trees

Tree in Tree: from Decision Trees to Decision Graphs

Metric learning for monotonic classification: turning the space up to the limits of monotonicity

Matching Model Versus Single Model: A Study Of The Requirement To Match Class Distribution Using Decision Trees

Induction of Hybrid Decision Tree Based on Post-Discretization Strategy*

Mixed-Integer Linear Optimization for Semi-Supervised Optimal Classification Trees

A linear multivariate decision tree with branch-and-bound components