Abstract:Machine learning methods are employed in many areas, such as medical data research, for their efficient and powerful data mining ability. However, submitting unprotected data to a third party, which attempts to train a machine learning model, may suffer from data leakage and privacy violation when the third party is compromised by an adversary. Hence, designing a protocol to execute encrypted computation is inevitably indispensable. In order to address this problem, we propose protocols based on secure multi-party computation to train a support vector machine model privately. Utilizing the semi-honest adversary model and oblivious transfer, the proposed protocols enable the training of a non-linear support vector machine on the combined data from various sources without sacrificing the privacy of individuals. The protocols are applied to train a support vector machine model with the radial basis function kernel on HIV sequence data to predict the efficacy of a certain antiviral drug, which only works if the viruses can only use the human CCR5 coreceptor for cell entry. Benchmarked on synthesized data with 10 data sources that consist of randomly generated integers, containing 100 labeled samples each, the protocol has consumed online time 2991.386/166.912 ms on average in arithmetic/boolean circuits, respectively. The cross-validation has reached 0.5819 F1-score on average on training data with the optimized parameters, which have reached 0.7058 F1-score afterwards on testing data set, which consists of protein sequence of CCR5 and its subtypes. The complete training and testing process on the real data, which contains in total 766 samples having 924 features after encoding, has consumed 43.75/15.84 seconds on average using arithmetic/boolean circuits, respectively, which shows the effectiveness and efficiency of our protocols compared to some of the existing studies in the literature.

How To Construct Support Vector Machines Without Breaching Privacy

Privacy-Preserving Collaborative Model Learning: the Case of Word Vector Training

Privacy Preserving PCA for Multiparty Modeling

Secret Sharing based Secure Regressions with Applications

Secure SVM Training over Vertically-Partitioned Datasets Using Consortium Blockchain for Vehicular Social Networks

Privacy-preserving SVM on Outsourced Genomic Data via Secure Multi-party Computation

Privacy-Preserving Fair Learning of Support Vector Machine with Homomorphic Encryption

SecureML: A System for Scalable Privacy-Preserving Machine Learning

Support vector machine classification over encrypted data

Privacy-preserving medical diagnosis system with Gaussian kernel-based support vector machine

SHAPER: A General Architecture for Privacy-Preserving Primitives in Secure Machine Learning.

Privacy-preserving Data Aggregation Without Secure Channel: Multivariate Polynomial Evaluation

Achieving Privacy-Preserving and Verifiable Support Vector Machine Training in the Cloud

A privacy preserving federated learning scheme using homomorphic encryption and secret sharing

Secure Byzantine-Robust Machine Learning

Privacy-Preserving Vertical Collaborative Logistic Regression without Trusted Third-Party Coordinator

Privacy-Preserving Machine Learning Algorithms for Big Data Systems

Towards Secure and Practical Machine Learning Via Secret Sharing and Random Permutation

Privacy-preserving two-parties logistic regression on vertically partitioned data using asynchronous gradient sharing

Achieving Privacy-Preserving Outsourced SVM Training with Non-Linear Kernel

Online Efficient Secure Logistic Regression based on Function Secret Sharing