Abstract:Fully homomorphic encryption (FHE) is a prospective tool for privacy-preserving machine learning (PPML). Several PPML models have been proposed based on various FHE schemes and approaches. Although FHE schemes are suitable as tools for implementing PPML models, previous PPML models based on FHE, such as CryptoNet, SEALion, and CryptoDL, are limited to simple and nonstandard types of machine learning models; they have not proven to be efficient and accurate with more practical and advanced datasets. Previous PPML schemes replaced non-arithmetic activation functions with simple arithmetic functions instead of adopting approximation methods and did not use bootstrapping, which enables continuous homomorphic evaluations. Thus, they could neither use standard activation functions nor employ large numbers of layers. In this work, we first implement the standard ResNet-20 model with the RNS-CKKS FHE with bootstrapping and verify the implemented model with the CIFAR-10 dataset and plaintext model parameters. Instead of replacing the non-arithmetic functions with simple arithmetic functions, we use state-of-the-art approximation methods to evaluate these non-arithmetic functions, such as ReLU and Softmax, with sufficient precision. Further, for the first time, we use the bootstrapping technique of the RNS-CKKS scheme in the proposed model, which enables us to evaluate an arbitrary deep learning model on encrypted data. We numerically verify that the proposed model with the CIFAR-10 dataset shows 98.43% identical results to the original ResNet-20 model with non-encrypted data. The classification accuracy of the proposed model is 92.43%±2.65%, which is quite close to that of the original ResNet-20 CNN model (91.89%). It takes approximately 3 h for inference on a dual Intel Xeon Platinum 8280 CPU (112 cores) with 172 GB of memory. We believe that this opens the possibility of applying FHE to an advanced deep PPML model.

CrossNet: A Low-Latency MLaaS Framework for Privacy-Preserving Neural Network Inference on Resource-Limited Devices

CHEETAH: An Ultra-Fast, Approximation-Free, and Privacy-Preserved Neural Network Framework based on Joint Obscure Linear and Nonlinear Computations

GELU-Net: A Globally Encrypted, Locally Unencrypted Deep Neural Network for Privacy-Preserved Learning.

Efficient FHE-based Privacy-Enhanced Neural Network for Trustworthy AI-as-a-Service

XNET: A Real-Time Unified Secure Inference Framework Using Homomorphic Encryption.

FastSecNet: An Efficient Cryptographic Framework for Private Neural Network Inference

FPCNN: A fast privacy-preserving outsourced convolutional neural network with low-bandwidth

MOFHEI: Model Optimizing Framework for Fast and Efficient Homomorphically Encrypted Neural Network Inference

Privacy preserving Neural Network Inference on Encrypted Data with GPUs

SSNet: A Lightweight Multi-Party Computation Scheme for Practical Privacy-Preserving Machine Learning Service in the Cloud

Privacy-Preserving Machine Learning With Fully Homomorphic Encryption for Deep Neural Network

Model Protection: Real-Time Privacy-Preserving Inference Service for Model Privacy at the Edge

Faster CryptoNets: Leveraging Sparsity for Real-World Encrypted Inference

ENIGMA: Low-Latency and Privacy-Preserving Edge Inference on Heterogeneous Neural Network Accelerators

Computation-efficient Deep Model Training for Ciphertext-based Cross-silo Federated Learning

Privacy preserving layer partitioning for Deep Neural Network models

LinGCN: Structural Linearized Graph Convolutional Network for Homomorphically Encrypted Inference

Occlumency

ShadowNet: A Secure and Efficient On-device Model Inference System for Convolutional Neural Networks

StreamliNet: Cost-aware Layer-wise Neural Network Linearization for Fast and Accurate Private Inference

Privacy Preserving Inference for Deep Neural Networks: Optimizing Homomorphic Encryption for Efficient and Secure Classification