Abstract:Machine learning on encrypted data can address the concerns related to privacy and legality of sharing sensitive data with untrustworthy service providers. Fully Homomorphic Encryption (FHE) is a promising technique to enable machine learning and inferencing while providing strict guarantees against information leakage. Since deep convolutional neural networks (CNNs) have become the machine learning tool of choice in several applications, several attempts have been made to harness CNNs to extract insights from encrypted data. However, existing works focus only on ensuring data security and ignore security of model parameters. They also report high level implementations without providing rigorous analysis of the accuracy, security, and speed trade-offs involved in the FHE implementation of generic primitive operators of a CNN such as convolution, non-linear activation, and pooling. In this work, we consider a Machine Learning as a Service (MLaaS) scenario where both input data and model parameters are secured using FHE. Using the CKKS scheme available in the open-source HElib library, we show that operational parameters of the chosen FHE scheme such as the degree of the cyclotomic polynomial, depth limitations of the underlying leveled HE scheme, and the computational precision parameters have a major impact on the design of the machine learning model (especially, the choice of the activation function and pooling method). Our empirical study shows that choice of aforementioned design parameters result in significant trade-offs between accuracy, security level, and computational time. Encrypted inference experiments on the MNIST dataset indicate that other design choices such as ciphertext packing strategy and parallelization using multithreading are also critical in determining the throughput and latency of the inference process.

Efficient Clustering on Encrypted Data.

Fully Privacy-Preserving and Efficient Clustering Scheme Based on Fully Homomorphic Encryption

Effective Privacy Preserved Clustering Based on Voronoi Diagram

Secure and Efficient Outsourced k-Means Clustering using Fully Homomorphic Encryption With Ciphertext Packing Technique

Privacy-Preserving and Outsourced Multi-Party K-Means Clustering Based on Multi-Key Fully Homomorphic Encryption

Hierarchical Clustering via Single and Complete Linkage Using Fully Homomorphic Encryption

Privacy-Preserving Accelerated Clustering for Data Encrypted by Different Keys.

Privacy-Preserving Clustering Using Representatives over Arbitrarily Partitioned Data

Privacy-Preserving Clustering of Unstructured Big Data for Cloud-Based Enterprise Search Solutions

Efficient CNN Building Blocks for Encrypted Data

An Efficient Clustering-Based Privacy-Preserving Recommender System.

<i>HEDA</i>: Multi-Attribute Unbounded Aggregation over Homomorphically Encrypted Database

Design and Implementation of Big Data Analysis Algorithm in Ciphertext Domain Based on Homomorphic Encryption

An Efficient Matrix Multiplication with Enhanced Privacy Protection in Cloud Computing and Its Applications

Toward Highly Secure Yet Efficient KNN Classification Scheme on Outsourced Cloud Data

A privacy preserving federated learning scheme using homomorphic encryption and secret sharing

Efficient and Privacy-Preserving Federated Learning based on Full Homomorphic Encryption

EncCluster: Scalable Functional Encryption in Federated Learning through Weight Clustering and Probabilistic Filters

Enabling Practical and Privacy-Preserving Image Processing

Privacy-preserving multikey computing framework for encrypted data in the cloud

Efficient and privacy-preserving image classification using homomorphic encryption and chunk-based convolutional neural network