Abstract:Providing privacy protection for classification algorithms has become a research hotspot in current data mining. In this paper, differential privacy is applied to the random forest classification algorithm, and a random forest algorithm based on differential privacy is proposed to protect the privacy information in the data classification process. Firstly, differential privacy provides privacy protection by adding perturbation noise, which leads to a decrease in the classification accuracy of random forest algorithms. In order to reduce the impact of differential privacy protection on the accuracy of random forest classification, a hybrid decision tree algorithm is proposed. For the construction of a single decision tree in a random forest, the information gain ratio in the ID3 algorithm and the information gain ratio in the C4.5 are combined to generate a new attribute metric IG_GR to improve the classification accuracy of a single decision tree. Secondly, a new privacy budget allocation strategy is proposed. For nodes of different depths in the decision tree, the privacy budget is allocated to its counting query and attribute query by weight, which is used to balance the signalto-noise ratio of differential privacy technology to nodes of different depths in the decision tree. At the same time, the hybrid decision tree algorithm is applied to the construction of random forest, which balances the privacy and classification accuracy of the random forest algorithm based on differential privacy. Finally, this paper conducted experiments on UCI's Adult and Mushroom datasets. The results show that compared with the traditional decision tree algorithm, the algorithm proposed in this paper has better classification accuracy; and the DPRF can provide effective privacy protection under the premise of ensuring high classification performance. The work of this paper achieves a balance between privacy and classification accuracy, and has practical application value.

A Differentially Private Random Decision Forest Using Reliable Signal-to-Noise Ratios

Differentially Private Greedy Decision Forest

A two-phase random forest with differential privacy

Random Forest Algorithm under Differential Privacy

DPRF: A Differential Privacy Protection Random Forest.

Decision Tree Classification with Differential Privacy: A Survey

Differentially- and non-differentially-private random decision trees

A Differential Privacy Random Forest Method of Privacy Protection in Cloud

A Privacy-Preserving Algorithm for Clinical Decision-Support Systems Using Random Forest

Random forest with differential privacy in federated learning framework for network attack detection and classification

Differentially Private Classification with Decision Tree Ensemble

Random Forest Algorithm Based on Linear Privacy Budget Allocation

A Differential Privacy Budget Allocation Algorithm Based on Out-of-Bag Estimation in Random Forest

An Ensemble Learning Model Based on Differentially Private Decision Tree

Differentially Private Algorithms for Empirical Machine Learning

An Ensemble of Random Decision Trees with Local Differential Privacy in Edge Computing

Decision Making with Differential Privacy under a Fairness Lens

Differentially private and decentralized randomized power method

Fair Decision Making using Privacy-Protected Data

A Differential Privacy Framework for Collaborative Filtering

Embedding Differential Privacy in Decision Tree Algorithm with Different Depths.