Two Differentially Private Rating Collection Mechanisms for Recommender Systems

Wenjie Zheng

DOI: https://doi.org/10.48550/arXiv.1604.08402

IF: 5.414

2016-04-28

Machine Learning

Abstract:We design two mechanisms for the recommender system to collect user ratings. One is modified Laplace mechanism, and the other is randomized response mechanism. We prove that they are both differentially private and preserve the data utility.

What problem does this paper attempt to address?

When Differential Privacy Meets Randomized Perturbation: A Hybrid Approach For Privacy-Preserving Recommender System

Xiao Liu,An Liu,Xiangliang Zhang,Zhixu Li,Guanfeng Liu,Lei Zhao,Xiaofang Zhou

DOI: https://doi.org/10.1007/978-3-319-55753-3_36

2017-01-01

Abstract:Privacy risks of recommender systems have caused increasing attention. Users' private data is often collected by probably untrusted recommender system in order to provide high-quality recommendation. Meanwhile, malicious attackers may utilize recommendation results to make inferences about other users' private data. Existing approaches focus either on keeping users' private data protected during recommendation computation or on preventing the inference of any single user's data from the recommendation result. However, none is designed for both hiding users' private data and preventing privacy inference. To achieve this goal, we propose in this paper a hybrid approach for privacy-preserving recommender systems by combining differential privacy (DP) with randomized perturbation (RP). We theoretically show the noise added by RP has limited effect on recommendation accuracy and the noise added by DP can be well controlled based on the sensitivity analysis of functions on the perturbed data. Extensive experiments on three large-scale real world datasets show that the hybrid approach generally provides more privacy protection with acceptable recommendation accuracy loss, and surprisingly sometimes achieves better privacy without sacrificing accuracy, thus validating its feasibility in practice.
Towards practical personalized recommendation with multi-level differential privacy controls

Guowen Xu,Hongwei Li,Wenlei Wang,Yue Chen,Haomiao Yang,Yanzhi Ren

DOI: https://doi.org/10.1109/INFCOMW.2018.8406839

2018-01-01

Abstract:Recommender systems have been widely applied in many scenarios such as shopping websites, online learning systems and video sharing clients, etc, which need to collect user's historical data for improving the accuracy of recommended results. However, user's private data inadvertently left behind on the internet or clients also will be gathered by service providers, and the risk of user's privacy being leaked may greatly increase. While the problem of private recommended algorithm has been studied in recent years, the latest research findings are still inadequate in security or utility. In this paper, we propose a novel multi-level differential privacy (Multi-DP)scheme under untrusted personalized recommendation system. Specifically, we firstly design a multi-level differential privacy algorithm employing Laplace mechanism to protect both overall privacy towards service provider and each data attributes privacy. Then, randomized response is introduced to sanitize user's historical data for generating useful perturbed data. In this way, the error between raw historical data and perturbed data will be further reduced. Finally, theoretical analysis and extensive experiments demonstrate the high security and data utility of our proposed model compared with existing methods.
Preserving the Privacy of Social Recommendation with a Differentially Private Approach

Liang Chen,Peidong Zhu

DOI: https://doi.org/10.1109/SmartCity.2015.162

2015-01-01

Abstract:With the popularity of social networks such as Facebook and twitter, social recommendations have become possible, which rely on individual's social connections in order to make personalized recommendations of ads, content, products, and people. Since recommendations involving sensitive information, adversaries may re-identify a user's sensitive information from the recommendation results using background information. This paper proposes a privacy preserving approach to address the problem in the context of social recommendation in a strict privacy notion, called differential privacy. The approach incorporates a clustering method to group users according to the structure of the target social network. Then use the weighted paths as the utility function, which measures the recommendation utility. It adds Laplace noise to the weight of social graph to inject perturbation. Experimental analysis are provided to show the proposed approach can ensure differential privacy while retaining the utility of social recommendation.
A differentially private nonnegative matrix factorization for recommender system

Xun Ran,Yong Wang,Leo Yu Zhang,Jun Ma

DOI: https://doi.org/10.1016/j.ins.2022.01.050

IF: 8.1

2022-05-01

Information Sciences

Abstract:Nonnegative matrix factorization (NMF)-based models have been proven to be highly effective and scalable in addressing collaborative filtering (CF) problems in the recommender system (RS). Since RS requires tremendous user data to provide personalized information services, the issue of data privacy has gained prominence. Although the differential privacy (DP) technique has been widely applied to RS, the requirement of nonnegativity makes it difficult to successfully incorporate DP into NMF. In this paper, a differentially private NMF (DPNMF) method is proposed by perturbing the coefficients of the polynomial expression of the objective function, which achieves a good trade-off between privacy protection and recommendation quality. Moreover, to alleviate the influence of the noises added by DP on the items with sparse ratings, an imputation-based DPNMF (IDPNMF) method is proposed. Theoretic analyses and experimental results on several benchmark datasets show that the proposed schemes have good performance and can achieve better recommendation quality on large-scale datasets. Therefore, our schemes have high potential to implement privacy-preserving RS based on big data.

computer science, information systems
A differentially private matrix factorization based on vector perturbation for recommender system

Xun Ran,Yong Wang,Leo Yu Zhang,Jun Ma

DOI: https://doi.org/10.1016/j.neucom.2022.01.079

IF: 6

2022-04-01

Neurocomputing

Abstract:Matrix factorization (MF) techniques have yielded immense success in recommender systems (RSs). Since a huge amount of user data is collected and used in RS, it raises concerns about data privacy. As a strict privacy protection framework, many efforts attempt to apply Differential Privacy (DP) to MF. However, there are still some challenges or problems in designing MF with privacy preservation, such as error accumulation in the multiple iterations of MF, introduction of unnecessary noises, and difficult sensitivity analysis. To overcome these problems, we devise a vector perturbation-based differentially private matrix factorization (VP-DPMF). Our scheme can prevent error accumulation by perturbing the objective function of MF rather than its factorization process or results. It also addresses the difficulty of analyzing sensitivity by exploiting the polynomial representation of the objective function. Furthermore, our scheme can reduce unnecessary noises by controlling the perturbation within the vector term of the polynomial, and can preserve the convexity property of the original function. Theoretical analysis demonstrates that our scheme can achieve good performance in a large-scale recommender system. Experimental results on some benchmark datasets show that the proposed scheme can provide both rigid privacy guarantee and satisfactory recommendation quality.

computer science, artificial intelligence
Randomized Response Mechanisms for Differential Privacy Data Analysis: Bounds and Applications

Fang Ma,Ping Wang

DOI: https://doi.org/10.48550/arxiv.2112.07397

2021-01-01

Abstract:Randomized response, as a basic building-block for differentially private mechanism, has given rise to great interest and found various potential applications in science communities. In this work, we are concerned with three-elements randomized response (RR$_{3}$) along with relevant applications to the analysis of weighted bipartite graph upon differentially private guarantee. We develop a principled framework for estimating statistics produced by RR$_{3}$-based mechanisms, and then prove the corresponding estimations to be unbiased. At the same time, we study in detail several fundamental and significant members in RR$_{3}$ family, and derive the closed-form solutions to unbiased estimations. Next, we show potential applications of several RR$_{3}$-based mechanisms into the estimation of average degree and average weighted value on weighted bipartite graph when requiring local differential privacy guarantee. In the meantime, we determine the lower bounds for choice of relevant parameters by minimizing variance of statistics in order to design optimal RR$_{3}$-based local differential private mechanisms, with which we optimize previous protocols in the literature and put forward a version that achieves the tight bound. Last but most importantly, we observe that in the analysis of relational data such as weighted bipartite graph, a portion of privacy budget in local differential private mechanism is sometimes "consumed" by mechanism itself accidentally, resulting to a more stronger privacy guarantee than we would get by simply sequential compositions.
Differential Privacy with Multiple Selections

Ashish Goel,Zhihao Jiang,Aleksandra Korolova,Kamesh Munagala,Sahasrajit Sarmasarkar

2024-07-20

Abstract:We consider the setting where a user with sensitive features wishes to obtain a recommendation from a server in a differentially private fashion. We propose a ``multi-selection'' architecture where the server can send back multiple recommendations and the user chooses one from these that matches best with their private features. When the user feature is one-dimensional -- on an infinite line -- and the accuracy measure is defined w.r.t some increasing function $\mathfrak{h}(.)$ of the distance on the line, we precisely characterize the optimal mechanism that satisfies differential privacy. The specification of the optimal mechanism includes both the distribution of the noise that the user adds to its private value, and the algorithm used by the server to determine the set of results to send back as a response and further show that Laplace is an optimal noise distribution. We further show that this optimal mechanism results in an error that is inversely proportional to the number of results returned when the function $\mathfrak{h}(.)$ is the identity function.

Data Structures and Algorithms,Cryptography and Security
DPSR: A Differentially Private Social Recommender System for Mobile Users

Xueling Zhou,Lingbo Wei,Yukun Niu,Chi Zhang,Yuguang Fang

DOI: https://doi.org/10.1007/978-3-030-23597-0_54

2019-01-01

Abstract:Recommender systems, which provide users with suggestions for selecting items that is of potential interest to them, are widely used to assist mobile users in reducing information overload and making better choice quickly in their daily life. Social recommender systems, which have the potential to mitigate the new user cold-start problem, utilize social relationships as an extra source of information. As recommendation results depend on users’ individual data, privacy breaches may occur. Although several differentially private social recommender systems have been proposed, their application scopes or protection strengths are limited. In this paper, we propose a differentially private social recommender system for mobile users named $\mathcal D\!P\!S\!R$ to block curious users from inferring the existence of someone else’s numeric rating or social relationship. Empirical evaluations on two real-world datasets are conducted, and the results show that $\mathcal D\!P\!S\!R$ can balance the utility of recommendations with the privacy of users’ data in both normal and cold-start test view.
Rate-Optimal Rank Aggregation with Private Pairwise Rankings

Shirong Xu,Will Wei Sun,Guang Cheng

2024-08-09

Abstract:In various real-world scenarios, such as recommender systems and political surveys, pairwise rankings are commonly collected and utilized for rank aggregation to obtain an overall ranking of items. However, preference rankings can reveal individuals' personal preferences, underscoring the need to protect them from being released for downstream analysis. In this paper, we address the challenge of preserving privacy while ensuring the utility of rank aggregation based on pairwise rankings generated from a general comparison model. Using the randomized response mechanism to perturb raw pairwise rankings is a common privacy protection strategy used in practice. However, a critical challenge arises because the privatized rankings no longer adhere to the original model, resulting in significant bias in downstream rank aggregation tasks. Motivated by this, we propose to adaptively debiasing the rankings from the randomized response mechanism, ensuring consistent estimation of true preferences and enhancing the utility of downstream rank aggregation. Theoretically, we offer insights into the relationship between overall privacy guarantees and estimation errors from private ranking data, and establish minimax rates for estimation errors. This enables the determination of optimal privacy guarantees that balance consistency in rank aggregation with privacy protection. We also investigate convergence rates of expected ranking errors for partial and full ranking recovery, quantifying how privacy protection influences the specification of top-$K$ item sets and complete rankings. Our findings are validated through extensive simulations and a real application.

Machine Learning,Cryptography and Security
Differentially Private and Fair Classification Via Calibrated Functional Mechanism.

Jiahao Ding,Xinyue Zhang,Xiaohuan Li,Junyi Wang,Rong Yu,Miao Pan

DOI: https://doi.org/10.1609/aaai.v34i01.5402

2020-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Machine learning is increasingly becoming a powerful tool to make decisions in a wide variety of applications, such as medical diagnosis and autonomous driving. Privacy concerns related to the training data and unfair behaviors of some decisions with regard to certain attributes (e.g., sex, race) are becoming more critical. Thus, constructing a fair machine learning model while simultaneously providing privacy protection becomes a challenging problem. In this paper, we focus on the design of classification model with fairness and differential privacy guarantees by jointly combining functional mechanism and decision boundary fairness. In order to enforce ϵ-differential privacy and fairness, we leverage the functional mechanism to add different amounts of Laplace noise regarding different attributes to the polynomial coefficients of the objective function in consideration of fairness constraint. We further propose an utility-enhancement scheme, called relaxed functional mechanism by adding Gaussian noise instead of Laplace noise, hence achieving (ϵ,δ)-differential privacy. Based on the relaxed functional mechanism, we can design (ϵ,δ)-differentially private and fair classification model. Moreover, our theoretical analysis and empirical results demonstrate that our two approaches achieve both fairness and differential privacy while preserving good utility and outperform the state-of-the-art algorithms.
DPLCF: Differentially Private Local Collaborative Filtering

Chen Gao,Chao Huang,Dongsheng Lin,Yong Li,Depeng Jin

DOI: https://doi.org/10.1145/3397271.3401053

2020-01-01

Abstract:Most existing recommender systems leverage users' complete original behavioral logs, which are collected from mobile devices and stored by the service provider and further fed into recommendation models. This may lead to a high risk of privacy leakage since the recommendation service provider may be trustless. Despite many research efforts on privacy-aware recommendation, the problem of building an effective recommender system completely preserving user privacy is still open. In this work, we propose a general framework named differentially private local collaborative filtering for recommendation. The designed workflow consists of three steps. First, for accumulated behavioral logs saved on users' devices, a differentially private protection mechanism is adopted to help obfuscate the real interactions before reporting them to the server. Second, after collecting all obfuscated records from all users, the server runs an estimation model to calculate similarities between each pair of items. This step requires no user-relevant data, and thus it does not introduce any auxiliary privacy risk. Last, the server sends the estimated user-irrelevant item-similarity matrix to each user device, and the recommendation results are inferred locally based on item similarities with each user's locally stored original behavioral data. To verify our method's efficacy, we conduct extensive experiments on three real-world datasets, demonstrating that our proposed method achieves the best performance compared with the state-of-the-art baselines. We further demonstrate that our method still works well under various privacy budgets and different data sparsity level.
Private and Utility Enhanced Recommendations with Local Differential Privacy and Gaussian Mixture Model

Jeyamohan Neera,Xiaomin Chen,Nauman Aslam,Kezhi Wang,Zhan Shu

DOI: https://doi.org/10.48550/arXiv.2102.13453

IF: 5.414

2021-02-26

Machine Learning

Abstract:Recommendation systems rely heavily on users behavioural and preferential data (e.g. ratings, likes) to produce accurate recommendations. However, users experience privacy concerns due to unethical data aggregation and analytical practices carried out by the Service Providers (SP). Local differential privacy (LDP) based perturbation mechanisms add noise to users data at user side before sending it to the SP. The SP then uses the perturbed data to perform recommendations. Although LDP protects the privacy of users from SP, it causes a substantial decline in predictive accuracy. To address this issue, we propose an LDP-based Matrix Factorization (MF) with a Gaussian Mixture Model (MoG). The LDP perturbation mechanism, Bounded Laplace (BLP), regulates the effect of noise by confining the perturbed ratings to a predetermined domain. We derive a sufficient condition of the scale parameter for BLP to satisfy $\epsilon$ LDP. At the SP, The MoG model estimates the noise added to perturbed ratings and the MF algorithm predicts missing ratings. Our proposed LDP based recommendation system improves the recommendation accuracy without violating LDP principles. The empirical evaluations carried out on three real world datasets, i.e., Movielens, Libimseti and Jester, demonstrate that our method offers a substantial increase in predictive accuracy under strong privacy guarantee.
Permute-and-Flip: A new mechanism for differentially private selection

Ryan McKenna,Daniel Sheldon

DOI: https://doi.org/10.48550/arXiv.2010.12603

2020-10-23

Cryptography and Security

Abstract:We consider the problem of differentially private selection. Given a finite set of candidate items and a quality score for each item, our goal is to design a differentially private mechanism that returns an item with a score that is as high as possible. The most commonly used mechanism for this task is the exponential mechanism. In this work, we propose a new mechanism for this task based on a careful analysis of the privacy constraints. The expected score of our mechanism is always at least as large as the exponential mechanism, and can offer improvements up to a factor of two. Our mechanism is simple to implement and runs in linear time.
RAP: A Light-Weight Privacy-Preserving Framework for Recommender Systems

Miao Hu,Di Wu,Run Wu,Zhenkai Shi,Min Chen,Yipeng Zhou

DOI: https://doi.org/10.1109/tsc.2021.3065035

IF: 11.019

2022-01-01

IEEE Transactions on Services Computing

Abstract:In today's Internet, recommender systems play an indispensable role in helping users discover items of interests, such as products, books, movies and so on. However, a higher recommendation accuracy is commonly at the cost of more disclosure of user privacy. Thus, a wider adoption of recommender systems poses significant security and privacy concerns to users. In this article, we propose a light-weight privacy-preserving framework called RAP for recommender systems, which can protect user privacy while still ensuring a high recommendation accuracy. Instead of directly sending users’ private ratings to the recommender, users first conduct a local perturbation operation on private ratings, and then send the perturbed ratings to the recommender. The recommender can run recommendation algorithms directly over the perturbed ratings and return the results to users. Different from crypto-based methods, our perturbation and de-perturbation methods are linear operations. Thus, RAP is light-weight and highly efficient in privacy protection. To be more rigorous, we formally prove that the order of recommendation accuracy will not decrease when our RAP framework is applied to any MF (Matrix Factorization)-based recommender systems. We also derive the closed-form expression for the degree of privacy preservation of our framework. Finally, we conduct extensive evaluations using large-scale real-world datasets to verify the effectiveness of our RAP framework and compare with other baseline algorithms. The results show that our RAP framework can improve the degree of privacy preservation from zero to over 0.5 for the Movielens dataset and 4 for the Jester dataset, and still maintain the approaching level of recommendation accuracy.
Differential Data Analysis for Recommender Systems

Richard Chow,Hongxia Jin,Bart Knijnenburg,Gokay Saldamli

DOI: https://doi.org/10.48550/arXiv.1310.0894

2013-10-03

Abstract:We present techniques to characterize which data is important to a recommender system and which is not. Important data is data that contributes most to the accuracy of the recommendation algorithm, while less important data contributes less to the accuracy or even decreases it. Characterizing the importance of data has two potential direct benefits: (1) increased privacy and (2) reduced data management costs, including storage. For privacy, we enable increased recommendation accuracy for comparable privacy levels using existing data obfuscation techniques. For storage, our results indicate that we can achieve large reductions in recommendation data and yet maintain recommendation accuracy. Our main technique is called differential data analysis. The name is inspired by other sorts of differential analysis, such as differential power analysis and differential cryptanalysis, where insight comes through analysis of slightly differing inputs. In differential data analysis we chunk the data and compare results in the presence or absence of each chunk. We present results applying differential data analysis to two datasets and three different kinds of attributes. The first attribute is called user hardship. This is a novel attribute, particularly relevant to location datasets, that indicates how burdensome a data point was to achieve. The second and third attributes are more standard: timestamp and user rating. For user rating, we confirm previous work concerning the increased importance to the recommender of data corresponding to high and low user ratings.

Information Retrieval
Mechanisms for Robust Local Differential Privacy

Milan Lopuhaä-Zwakenberg,Jasper Goseling

DOI: https://doi.org/10.3390/e26030233

IF: 2.738

2024-03-07

Entropy

Abstract:We consider privacy mechanisms for releasing data X=(S,U), where S is sensitive and U is non-sensitive. We introduce the robust local differential privacy (RLDP) framework, which provides strong privacy guarantees, while preserving utility. This is achieved by providing robust privacy: our mechanisms do not only provide privacy with respect to a publicly available estimate of the unknown true distribution, but also with respect to similar distributions. Such robustness mitigates the potential privacy leaks that might arise from the difference between the true distribution and the estimated one. At the same time, we mitigate the utility penalties that come with ordinary differential privacy, which involves making worst-case assumptions and dealing with extreme cases. We achieve robustness in privacy by constructing an uncertainty set based on a Rényi divergence. By analyzing the structure of this set and approximating it with a polytope, we can use robust optimization to find mechanisms with high utility. However, this relies on vertex enumeration and becomes computationally inaccessible for large input spaces. Therefore, we also introduce two low-complexity algorithms that build on existing LDP mechanisms. We evaluate the utility and robustness of the mechanisms using numerical experiments and demonstrate that our mechanisms provide robust privacy, while achieving a utility that is close to optimal.

physics, multidisciplinary
Towards Differential Privacy in Sequential Recommendation: A Noisy Graph Neural Network Approach

Wentao Hu,Hui Fang

2024-01-30

Abstract:With increasing frequency of high-profile privacy breaches in various online platforms, users are becoming more concerned about their privacy. And recommender system is the core component of online platforms for providing personalized service, consequently, its privacy preservation has attracted great attention. As the gold standard of privacy protection, differential privacy has been widely adopted to preserve privacy in recommender systems. However, existing differentially private recommender systems only consider static and independent interactions, so they cannot apply to sequential recommendation where behaviors are dynamic and dependent. Meanwhile, little attention has been paid on the privacy risk of sensitive user features, most of them only protect user feedbacks. In this work, we propose a novel DIfferentially Private Sequential recommendation framework with a noisy Graph Neural Network approach (denoted as DIPSGNN) to address these limitations. To the best of our knowledge, we are the first to achieve differential privacy in sequential recommendation with dependent interactions. Specifically, in DIPSGNN, we first leverage piecewise mechanism to protect sensitive user features. Then, we innovatively add calibrated noise into aggregation step of graph neural network based on aggregation perturbation mechanism. And this noisy graph neural network can protect sequentially dependent interactions and capture user preferences simultaneously. Extensive experiments demonstrate the superiority of our method over state-of-the-art differentially private recommender systems in terms of better balance between privacy and accuracy.

Cryptography and Security,Information Retrieval,Machine Learning
Studying the Impact of Data Disclosure Mechanism in Recommender Systems via Simulation

Ziqian Chen,Fei Sun,Yifan Tang,Haokun Chen,Jinyang Gao,Bolin Ding

DOI: https://doi.org/10.48550/arXiv.2204.00279

2022-10-20

Abstract:Recently, privacy issues in web services that rely on users' personal data have raised great attention. Unlike existing privacy-preserving technologies such as federated learning and differential privacy, we explore another way to mitigate users' privacy concerns, giving them control over their own data. For this goal, we propose a privacy aware recommendation framework that gives users delicate control over their personal data, including implicit behaviors, e.g., clicks and watches. In this new framework, users can proactively control which data to disclose based on the trade-off between anticipated privacy risks and potential utilities. Then we study users' privacy decision making under different data disclosure mechanisms and recommendation models, and how their data disclosure decisions affect the recommender system's performance. To avoid the high cost of real-world experiments, we apply simulations to study the effects of our proposed framework. Specifically, we propose a reinforcement learning algorithm to simulate users' decisions (with various sensitivities) under three proposed platform mechanisms on two datasets with three representative recommendation models. The simulation results show that the platform mechanisms with finer split granularity and more unrestrained disclosure strategy can bring better results for both end users and platforms than the "all or nothing" binary mechanism adopted by most real-world applications. It also shows that our proposed framework can effectively protect users' privacy since they can obtain comparable or even better results with much less disclosed data.

Information Retrieval

Two Differentially Private Rating Collection Mechanisms for Recommender Systems

When Differential Privacy Meets Randomized Perturbation: A Hybrid Approach For Privacy-Preserving Recommender System

Towards practical personalized recommendation with multi-level differential privacy controls

Preserving the Privacy of Social Recommendation with a Differentially Private Approach

A differentially private nonnegative matrix factorization for recommender system

A differentially private matrix factorization based on vector perturbation for recommender system

Randomized Response Mechanisms for Differential Privacy Data Analysis: Bounds and Applications

Differential Privacy with Multiple Selections

DPSR: A Differentially Private Social Recommender System for Mobile Users

Rate-Optimal Rank Aggregation with Private Pairwise Rankings

Differentially Private and Fair Classification Via Calibrated Functional Mechanism.

DPLCF: Differentially Private Local Collaborative Filtering

Private and Utility Enhanced Recommendations with Local Differential Privacy and Gaussian Mixture Model

Permute-and-Flip: A new mechanism for differentially private selection

RAP: A Light-Weight Privacy-Preserving Framework for Recommender Systems

Differential Data Analysis for Recommender Systems

Mechanisms for Robust Local Differential Privacy

Towards Differential Privacy in Sequential Recommendation: A Noisy Graph Neural Network Approach

Studying the Impact of Data Disclosure Mechanism in Recommender Systems via Simulation