Abstract:Machine learning algorithms based on deep neural networks have achieved remarkable results and are being extensively used in different domains. However, the machine learning algorithms requires access to raw data which is often privacy sensitive. To address this issue, we develop new techniques to provide solutions for running deep neural networks over encrypted data. In this paper, we develop new techniques to adopt deep neural networks within the practical limitation of current homomorphic encryption schemes. More specifically, we focus on classification of the well-known convolutional neural networks (CNN). First, we design methods for approximation of the activation functions commonly used in CNNs (i.e. ReLU, Sigmoid, and Tanh) with low degree polynomials which is essential for efficient homomorphic encryption schemes. Then, we train convolutional neural networks with the approximation polynomials instead of original activation functions and analyze the performance of the models. Finally, we implement convolutional neural networks over encrypted data and measure performance of the models. Our experimental results validate the soundness of our approach with several convolutional neural networks with varying number of layers and structures. When applied to the MNIST optical character recognition tasks, our approach achieves 99.52\% accuracy which significantly outperforms the state-of-the-art solutions and is very close to the accuracy of the best non-private version, 99.77\%. Also, it can make close to 164000 predictions per hour. We also applied our approach to CIFAR-10, which is much more complex compared to MNIST, and were able to achieve 91.5\% accuracy with approximation polynomials used as activation functions. These results show that CryptoDL provides efficient, accurate and scalable privacy-preserving predictions.

Data Authentication Based on Discrete Random Convolutional Neural Network

A Nonlinearity-Based Secure Face-to-Face Device Authentication for Mobile Devices

Res-DFNN: an NN-Based Device Fingerprint Extraction Method Using Network Packet Data

Industrial Scale Privacy Preserving Deep Neural Network

NAuth: Secure Face-to-Face Device Authentication Via Nonlinearity

Security Enhancement for Mobile Edge Computing Through Physical Layer Authentication.

Enhanced Security Authentication Based on Convolutional-LSTM Networks

A Novel Physical Layer Authentication Method with Convolutional Neural Network

Deep Learning-Enhanced Physical Layer Authentication for Mobile Devices

Convolution Based Feature Extraction for Edge Computing Access Authentication

A Data Authentication Method Based on Vector Projection for Industrial Edge Computing System

Deep-Learning-Based Physical Layer Authentication for Industrial Wireless Sensor Networks.

A Malicious Node Identification Method Based on Edge Computing

Channel state information based physical layer authentication for Wi‐Fi sensing systems using deep learning in Internet of things networks

Hierarchical Security Authentication with Attention-Enhanced Convolutional Network for Internet of Things

Optical authentication scheme based on all-optical neural network

Data Source Authentication of Synchrophasor Measurement Devices Based on 1D-CNN and GRU

Multiuser physical layer security mechanism in the wireless communication system of the IIOT

CryptoDL: Deep Neural Networks over Encrypted Data

AuthNet: Neural Network with Integrated Authentication Logic

Design of Convolutional Neural Networks Architecture for Non-Profiled Side-Channel Attack Detection