Abstract:The widespread acceptance of machine learning, particularly of neural networks leads to great success in many areas, such as recommender systems, medical predictions, and recognition. It is becoming possible for any individual with a personal electronic device and Internet access to complete complex machine learning tasks using cloud servers. However, it must be taken into consideration that the data from clients may be exposed to cloud servers. Recent work to preserve data confidentiality has allowed for the outsourcing of services using homomorphic encryption schemes. But these architectures are based on honest but curious cloud servers, which are unable to tell whether cloud servers have completed the computation delegated to the cloud server. This paper proposes a verifiable neural network framework which focuses on solving the problem of data confidentiality and training integrity in machine learning. Specifically, we first leverage homomorphic encryption and extended diagonal packing method to realize a privacy-preserving neural network model efficiently, it enables the user training over encrypted data, thereby protecting the user’s private data. Then, considering the problem that malicious cloud servers are likely to return a wrong result for saving cost, we also integrate a training validation modular Proof-of-Learning, a strategy for verifying the correctness of computations performed during training. Moreover, we introduce practical byzantine fault tolerance to complete the verification progress without a verifiable center. Finally, we conduct a series of experiments to evaluate the performance of the proposed framework, the results show that our construction supports the verifiable training of PPNN based on HE without introducing much computational cost.

Oblivious Neural Network Predictions Via MiniONN Transformations.

Optimizing Privacy-Preserving Outsourced Convolutional Neural Network Predictions

Non-interactive Privacy-Preserving Neural Network Prediction

Secure Neural Network Prediction in the Cloud-Based Open Neural Network Service

Secure Prediction of Neural Network in the Cloud

Industrial Scale Privacy Preserving Deep Neural Network

ToNN: an Oblivious Neural Network Prediction Scheme with Semi-honest TEE

Achieving Efficient and Privacy-Preserving Neural Network Training and Prediction in Cloud Environments

Private Model Compression Via Knowledge Distillation.

ABNN(2): Secure Two-party Arbitrary-Bitwidth Quantized Neural Network Predictions

Verifiable Privacy-Preserving Neural Network on Encrypted Data

PrivyNet: A Flexible Framework for Privacy-Preserving Deep Neural Network Training

PPNNI: Privacy-Preserving Neural Network Inference Against Adversarial Example Attack

Lightweight and Unobtrusive Privacy Preservation for Remote Inference Via Edge Data Obfuscation

Efficient Privacy-Preserving Inference Outsourcing for Convolutional Neural Networks.

Privacy‐preserving convolutional neural network prediction with low latency and lightweight users

Privacy Prediction of Lightweight Convolutional Neural Network

Privacy-Preserving Outsourced Artificial Neural Network Training for Secure Image Classification

Crypto-Nets: Neural Networks over Encrypted Data

Enabling Inference Privacy with Adaptive Noise Injection

CrossNet: A Low-Latency MLaaS Framework for Privacy-Preserving Neural Network Inference on Resource-Limited Devices