Abstract:The widespread acceptance of machine learning, particularly of neural networks leads to great success in many areas, such as recommender systems, medical predictions, and recognition. It is becoming possible for any individual with a personal electronic device and Internet access to complete complex machine learning tasks using cloud servers. However, it must be taken into consideration that the data from clients may be exposed to cloud servers. Recent work to preserve data confidentiality has allowed for the outsourcing of services using homomorphic encryption schemes. But these architectures are based on honest but curious cloud servers, which are unable to tell whether cloud servers have completed the computation delegated to the cloud server. This paper proposes a verifiable neural network framework which focuses on solving the problem of data confidentiality and training integrity in machine learning. Specifically, we first leverage homomorphic encryption and extended diagonal packing method to realize a privacy-preserving neural network model efficiently, it enables the user training over encrypted data, thereby protecting the user’s private data. Then, considering the problem that malicious cloud servers are likely to return a wrong result for saving cost, we also integrate a training validation modular Proof-of-Learning, a strategy for verifying the correctness of computations performed during training. Moreover, we introduce practical byzantine fault tolerance to complete the verification progress without a verifiable center. Finally, we conduct a series of experiments to evaluate the performance of the proposed framework, the results show that our construction supports the verifiable training of PPNN based on HE without introducing much computational cost.

Efficient and Privacy-Preserving Neural Network Prediction Scheme with TEE.

CHEETAH: An Ultra-Fast, Approximation-Free, and Privacy-Preserved Neural Network Framework based on Joint Obscure Linear and Nonlinear Computations

ToNN: an Oblivious Neural Network Prediction Scheme with Semi-honest TEE

Achieving Efficient and Privacy-Preserving Neural Network Training and Prediction in Cloud Environments

THE-V: Verifiable Privacy-Preserving Neural Network Via Trusted Homomorphic Execution

Crypto-Nets: Neural Networks over Encrypted Data

Encrypted Data Learning and Prediction Using a BFV-based Cryptographic Convolutional Neural Network

HT2ML : An Efficient Hybrid Framework for Privacy-preserving Machine Learning Using HE and TEE

Non-interactive Privacy-Preserving Neural Network Prediction

Lightweight Privacy-Preserving Training and Evaluation for Discretized Neural Networks

Neural Network Model Training Method Based on Homomorphic Encryption

Verifiable Privacy-Preserving Neural Network on Encrypted Data

Privacy Preserving Inference for Deep Neural Networks: Optimizing Homomorphic Encryption for Efficient and Secure Classification

Efficient and Privacy-Preserving Logistic Regression Prediction over Vertically Partitioned Data

Privacy-Preserving DNN Training with Prefetched Meta-Keys on Heterogeneous Neural Network Accelerators

Secure Prediction of Neural Network in the Cloud

Securer and Faster Privacy-Preserving Distributed Machine Learning

A Novel Privacy-Preserving Neural Network Computing Approach for E-Health Information System

2P-DNN : Privacy-Preserving Deep Neural Networks Based on Homomorphic Cryptosystem

SecFed: A Secure and Efficient Federated Learning Based on Multi-Key Homomorphic Encryption

TenSEAL: A Library for Encrypted Tensor Operations Using Homomorphic Encryption