Abstract:Supporting convolutional neural network (CNN) inference on resource-constrained IoT devices in a timely manner has been an outstanding challenge for emerging smart systems. To mitigate the burden on IoT devices, the prevailing solution is to offload the CNN inference task, which is usually composed of billions of operations, to public cloud. However, the "offloading-to-cloud" solution may cause privacy breach while moving sensitive data to cloud. For privacy protection, the research community has resorted to advanced cryptographic primitives and approximation techniques to support CNN inference on encrypted data. Consequently, these attempts cause impractical computational overhead on IoT devices and degrade the performance of CNNs. Moreover, relying on the remote cloud can cause additional network latency and even make the system dysfunction when network connection is off. We proposes an extremely lightweight edge device assisted private CNN inference solution for IoT devices, namely LEP-CNN. The main design of LEP-CNN is based on a novel online/offline encryption scheme. The decryption of LEP-CNN is pre-computed offline via utilizing the linear property of the most time-consuming operations of CNNs. As a result, LEP-CNN allows IoT devices to securely offload over 99% CNN operations, and edge devices to execute CNN inference on encrypted data as efficient as on plaintext. LEP-CNN also provides an integrity check option to help IoT devices detect error results with a successful rate over 99%. Experiments on AlexNet show that LEP-CNN can speed up the CNN inference for more than 35 times for resource constrained IoT devices. A homomorphic encryption based AlexNet using CryptoNets is implemented to compare with LEP-CNN to demonstrate that LEP-CNN has a better performance than homomorphic encryption based privacy preserving neural networks under time-sensitive scenarios.

FPCNN: A fast privacy-preserving outsourced convolutional neural network with low-bandwidth

CHEETAH: An Ultra-Fast, Approximation-Free, and Privacy-Preserved Neural Network Framework based on Joint Obscure Linear and Nonlinear Computations

PCNNCEC: Efficient and Privacy-Preserving Convolutional Neural Network Inference Based on Cloud-Edge-Client Collaboration

GFS-CNN: A GPU-friendly Secure Computation Platform for Convolutional Neural Networks

Privacy‐preserving convolutional neural network prediction with low latency and lightweight users

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

Optimizing Privacy-Preserving Outsourced Convolutional Neural Network Predictions

A Privacy-Preserving Scheme For Convolutional Neural Network-Based Applications In Mobile Cloud

FALCON: A Fourier Transform Based Approach for Fast and Secure Convolutional Neural Network Predictions

Toward Practical Privacy-Preserving Convolutional Neural Networks Exploiting Fully Homomorphic Encryption

cuSCNN: A Secure and Batch-Processing Framework for Privacy-Preserving Convolutional Neural Network Prediction on GPU

Pratical Privacy-preserving Convolutional Neural Network Inference Framework with Edge Computing for Health Monitoring

A privacy preservation framework for feedforward-designed convolutional neural networks

LEP-CNN: A Lightweight Edge Device Assisted Privacy-preserving CNN Inference Solution for IoT

Privacy Prediction of Lightweight Convolutional Neural Network

Optimized Privacy-Preserving CNN Inference With Fully Homomorphic Encryption

CrossNet: A Low-Latency MLaaS Framework for Privacy-Preserving Neural Network Inference on Resource-Limited Devices

Privacy-Preserving Computation Offloading for Parallel Deep Neural Networks Training

Privacy-Preserving Convolutional Neural Networks Using Homomorphic Encryption

Efficient optimisation framework for convolutional neural networks with secure multiparty computation

Reducing ReLU Count for Privacy-Preserving CNN Speedup