Abstract:Abstract We apply multiparty computation (MPC) techniques to show, given a database that is secret-shared among multiple mutually distrustful parties, how the parties may obliviously construct a decision tree based on the secret data. We consider data with continuous attributes (i.e., coming from a large domain), and develop a secure version of a learning algorithm similar to the C4.5 or CART algorithms. Previous MPC-based work only focused on decision tree learning with discrete attributes (De Hoogh et al. 2014). Our starting point is to apply an existing generic MPC protocol to a standard decision tree learning algorithm, which we then optimize in several ways. We exploit the fact that even if we allow the data to have continuous values, which a priori might require fixed or floating point representations, the output of the tree learning algorithm only depends on the relative ordering of the data. By obliviously sorting the data we reduce the number of comparisons needed per node to O ( N log 2 N ) from the naive O ( N 2 ), where N is the number of training records in the dataset, thus making the algorithm feasible for larger datasets. This does however introduce a problem when duplicate values occur in the dataset, but we manage to overcome this problem with a relatively cheap subprotocol. We show a procedure to convert a sorting network into a permutation network of smaller complexity, resulting in a round complexity of O (log N ) per layer in the tree. We implement our algorithm in the MP-SPDZ framework and benchmark our implementation for both passive and active three-party computation using arithmetic modulo 2 64 . We apply our implementation to a large scale medical dataset of ≈ 290 000 rows using random forests, and thus demonstrate practical feasibility of using MPC for privacy-preserving machine learning based on decision trees for large datasets.

UC Secure Private Branching Program and Decision Tree Evaluation.

SoK: Modular and Efficient Private Decision Tree Evaluation.

Scalable Private Decision Tree Evaluation with Sublinear Communication

Mostree : Malicious Secure Private Decision Tree Evaluation with Sublinear Communication

Level Up: Private Non-Interactive Decision Tree Evaluation using Levelled Homomorphic Encryption

Secure Outsourcing Evaluation for Sparse Decision Trees

Ents: An Efficient Three-party Training Framework for Decision Trees by Communication Optimization

Securely Training Decision Trees Efficiently

PriVDT: An Efficient Two-Party Cryptographic Framework for Vertical Decision Trees

Secure Computation for G-Module and Its Applications

Privacy-preserving outsourcing decision tree evaluation from homomorphic encryption

An ultra-fast optimization algorithm for unit commitment based on neural branching

Communication-Efficient (Client-Aided) Secure Two-Party Protocols and Its Application

Secure and Privacy-Preserving Decision Tree Classification with Lower Complexity

Efficient Mixed-Protocol Secure Four-Party Computation with Private Robustness

Probabilistic Lookahead Strong Branching via a Stochastic Abstract Branching Model

Outsourced Privacy-Preserving C4.5 Decision Tree Algorithm over Horizontally and Vertically Partitioned Dataset among Multiple Parties

Efficient decision tree training with new data structure for secure multi-party computation

Secure decision tree classification with decentralized authorization and access control

Branches: A Fast Dynamic Programming and Branch & Bound Algorithm for Optimal Decision Trees

Secure training of decision trees with continuous attributes