Abstract:Multi-party training frameworks for decision trees based on secure multi-party computation enable multiple parties to train high-performance models on distributed private data with privacy preservation. The training process essentially involves frequent dataset splitting according to the splitting criterion (e.g. Gini impurity). However, existing multi-party training frameworks for decision trees demonstrate communication inefficiency due to the following issues: (1) They suffer from huge communication overhead in securely splitting a dataset with continuous attributes. (2) They suffer from huge communication overhead due to performing almost all the computations on a large ring to accommodate the secure computations for the splitting criterion. In this paper, we are motivated to present an efficient three-party training framework, namely Ents, for decision trees by communication optimization. For the first issue, we present a series of training protocols based on the secure radix sort protocols to efficiently and securely split a dataset with continuous attributes. For the second issue, we propose an efficient share conversion protocol to convert shares between a small ring and a large ring to reduce the communication overhead incurred by performing almost all the computations on a large ring. Experimental results from eight widely used datasets show that Ents outperforms state-of-the-art frameworks by $5.5\times \sim 9.3\times$ in communication sizes and $3.9\times \sim 5.3\times$ in communication rounds. In terms of training time, Ents yields an improvement of $3.5\times \sim 6.7\times$. To demonstrate its practicality, Ents requires less than three hours to securely train a decision tree on a widely used real-world dataset (Skin Segmentation) with more than 245,000 samples in the WAN setting.

Outsourced Privacy-Preserving C4.5 Decision Tree Algorithm over Horizontally and Vertically Partitioned Dataset among Multiple Parties

Privacy Preserving Distributed DBSCAN Clustering

Privacy Preserving C4.5 Algorithm over Horizontally Partitioned Data.

Privacy Preserving PCA for Multiparty Modeling

SoK: Modular and Efficient Private Decision Tree Evaluation.

Privacy Preserving ID3 Algorithm over Horizontally Partitioned Data

Securely and Efficiently Outsourcing Decision Tree Inference

Privacy-preserving outsourcing decision tree evaluation from homomorphic encryption

Outsourced privacy-preserving decision tree classification service over encrypted data

Privacy preserving distributed data mining based on secure multi-party computation

Secure and Privacy-Preserving Decision Tree Classification with Lower Complexity

A secure and efficient outsourced computation on data sharing scheme for privacy computing

Fully Privacy-Preserving Distributed Optimization Based on Secret Sharing

Ents: An Efficient Three-party Training Framework for Decision Trees by Communication Optimization

Private Set Intersection with Authorization over Outsourced Encrypted Datasets.

OnePath: Efficient and Privacy-Preserving Decision Tree Inference in the Cloud

Secure decision tree classification with decentralized authorization and access control

A rational and reliable model for outsourcing polynomial two-party computation

Privacy-Preserving and Outsourced Multi-User k-Means Clustering

Decision Tree Classification on Outsourced Data

Outsourcing shortest distance computing with privacy protection