Abstract:Multi-party training frameworks for decision trees based on secure multi-party computation enable multiple parties to train high-performance models on distributed private data with privacy preservation. The training process essentially involves frequent dataset splitting according to the splitting criterion (e.g. Gini impurity). However, existing multi-party training frameworks for decision trees demonstrate communication inefficiency due to the following issues: (1) They suffer from huge communication overhead in securely splitting a dataset with continuous attributes. (2) They suffer from huge communication overhead due to performing almost all the computations on a large ring to accommodate the secure computations for the splitting criterion. In this paper, we are motivated to present an efficient three-party training framework, namely Ents, for decision trees by communication optimization. For the first issue, we present a series of training protocols based on the secure radix sort protocols to efficiently and securely split a dataset with continuous attributes. For the second issue, we propose an efficient share conversion protocol to convert shares between a small ring and a large ring to reduce the communication overhead incurred by performing almost all the computations on a large ring. Experimental results from eight widely used datasets show that Ents outperforms state-of-the-art frameworks by $5.5\times \sim 9.3\times$ in communication sizes and $3.9\times \sim 5.3\times$ in communication rounds. In terms of training time, Ents yields an improvement of $3.5\times \sim 6.7\times$. To demonstrate its practicality, Ents requires less than three hours to securely train a decision tree on a widely used real-world dataset (Skin Segmentation) with more than 245,000 samples in the WAN setting.

Secure and Fast Decision Tree Evaluation on Outsourced Cloud Data.

SoK: Modular and Efficient Private Decision Tree Evaluation.

Efficient and Secure Decision Tree Classification for Cloud-Assisted Online Diagnosis Services

OnePath: Efficient and Privacy-Preserving Decision Tree Inference in the Cloud

Securely and Efficiently Outsourcing Decision Tree Inference

Secure decision tree classification with decentralized authorization and access control

Outsourced privacy-preserving decision tree classification service over encrypted data

Privacy-preserving outsourcing decision tree evaluation from homomorphic encryption

Decision Tree Classification on Outsourced Data

Secure and Privacy-Preserving Decision Tree Classification with Lower Complexity

A Hybrid-Domain Framework for Secure Gradient Tree Boosting.

Achieving Verifiable Decision Tree Prediction on Hybrid Blockchains

PPSDT: A Novel Privacy-Preserving Single Decision Tree Algorithm for Clinical Decision-Support Systems Using IoT Devices

Efficient and Privacy-Preserving Tree-Based Inference via Additive Homomorphic Encryption

Level Up: Private Non-Interactive Decision Tree Evaluation using Levelled Homomorphic Encryption

Federated Extra-Trees with Privacy Preserving

PriVDT: An Efficient Two-Party Cryptographic Framework for Vertical Decision Trees

Ents: An Efficient Three-party Training Framework for Decision Trees by Communication Optimization

Scalable Private Decision Tree Evaluation with Sublinear Communication

Multi-cloud Service Provision Based on Decision Tree and Two-Layer Restricted Monte Carlo Tree Search.

Privacy Preserving C4.5 Algorithm over Horizontally Partitioned Data.