Abstract:The emerging development of cloud computing makes a trend that the cloud becomes a outsourced agglomeration for storing big data that generally contains numerous information. To mine the rich value involved in big data, the machine learning methodology is widespread employed due to its ability to adapt to data changes. However, the data mining process may involve the privacy issues of the users, hence they are reluctant to share their information. This is the reason why the outsourced data need to be dealt with securely, where data encryption is considered to be the most straightforward method to keep the privacy of data, but machine learning on the data in ciphertext domain is more complicated than the plaintext, since the relationship structure between data is no longer maintained, in such a way that we focus on the machine learning over encrypted big data. In this work, we study locally weighted linear regression (LWLR), a widely used classic machine learning algorithm in real-world, such as predict and find the best-fit curve through numerous data points. To tackle the privacy concerns in utilizing the LWLR algorithm, we present a system for privacy-preserving locally weighted linear regression, where the system not only protects the privacy of users but also encrypts the best-fit curve. Therefore, we use Paillier homomorphic encryption as the building modular to encrypt data and then apply the stochastic gradient descent in encrypted domain. After given a security analysis, we study how to let Paillier encryption deal with real numbers and implement the system in Python language with a couple of experiments on real-world data sets to evaluate the effectiveness, and show that it outperforms the state-of-the-art and occurs negligible errors compared with performing locally weighted linear regression in the clear.

Efficient and Secure Outsourced Linear Regression.

Secure and efficient outsourcing computation on large-scale linear regressions

When Homomorphic Encryption Marries Secret Sharing: Secure Large-Scale Sparse Logistic Regression and Applications in Risk Control.

Machine Learning on Cloud with Blockchain: A Secure, Verifiable and Fair Approach to Outsource the Linear Regression for Data Analysis

Privacy-enhanced and non-interactive linear regression with dropout-resilience

Privacy-Preserving Locally Weighted Linear Regression over Encrypted Millions of Data.

Privacy-Preserving Linear Regression on Distributed Data by Homomorphic Encryption and Data Masking

Secure Outsourced Decryption for FHE-based Privacy-preserving Cloud Computing

Efficient, Secure And Non-Iterative Outsourcing Of Large-Scale Systems Of Linear Equations

Outsourcing Eigen-Decomposition and Singular Value Decomposition of Large Matrix to a Public Cloud

Privacy-preserving large-scale systems of linear equations in outsourcing storage and computation

Statistical Learning Based Fully Homomorphic Encryption on Encrypted Data

Efficient and Privacy-Preserving Logistic Regression Scheme Based on Leveled Fully Homomorphic Encryption

Harnessing the Cloud for Securely Outsourcing Large-Scale Systems of Linear Equations

Outsourcing Large-Scale Systems of Linear Matrix Equations in Cloud Computing.

Efficient and Privacy-Preserving Logistic Regression Prediction over Vertically Partitioned Data

Achieving Privacy-Preserving Outsourced SVM Training with Non-Linear Kernel

Encrypted Gradient Descent Protocol for Outsourced Data Mining

Privacy-Preserving and Secure Cloud Computing: A Case of Large-Scale Nonlinear Programming

Logistic regression model training based on the approximate homomorphic encryption

Privacy-Preserving Outsourcing of Large-Scale Nonlinear Programming to the Cloud