Abstract:Supporting convolutional neural network (CNN) inference on resource-constrained IoT devices in a timely manner has been an outstanding challenge for emerging smart systems. To mitigate the burden on IoT devices, the prevailing solution is to offload the CNN inference task, which is usually composed of billions of operations, to public cloud. However, the "offloading-to-cloud" solution may cause privacy breach while moving sensitive data to cloud. For privacy protection, the research community has resorted to advanced cryptographic primitives and approximation techniques to support CNN inference on encrypted data. Consequently, these attempts cause impractical computational overhead on IoT devices and degrade the performance of CNNs. Moreover, relying on the remote cloud can cause additional network latency and even make the system dysfunction when network connection is off. We proposes an extremely lightweight edge device assisted private CNN inference solution for IoT devices, namely LEP-CNN. The main design of LEP-CNN is based on a novel online/offline encryption scheme. The decryption of LEP-CNN is pre-computed offline via utilizing the linear property of the most time-consuming operations of CNNs. As a result, LEP-CNN allows IoT devices to securely offload over 99% CNN operations, and edge devices to execute CNN inference on encrypted data as efficient as on plaintext. LEP-CNN also provides an integrity check option to help IoT devices detect error results with a successful rate over 99%. Experiments on AlexNet show that LEP-CNN can speed up the CNN inference for more than 35 times for resource constrained IoT devices. A homomorphic encryption based AlexNet using CryptoNets is implemented to compare with LEP-CNN to demonstrate that LEP-CNN has a better performance than homomorphic encryption based privacy preserving neural networks under time-sensitive scenarios.

Pratical Privacy-preserving Convolutional Neural Network Inference Framework with Edge Computing for Health Monitoring

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

PCNNCEC: Efficient and Privacy-Preserving Convolutional Neural Network Inference Based on Cloud-Edge-Client Collaboration

Secure Convolution Neural Network Inference Based on Homomorphic Encryption

Privacy‐preserving convolutional neural network prediction with low latency and lightweight users

A Secure Convolutional Neural Network Inference Model Based on Homomorphic Encryption

cuSCNN: A Secure and Batch-Processing Framework for Privacy-Preserving Convolutional Neural Network Prediction on GPU

FPCNN: A fast privacy-preserving outsourced convolutional neural network with low-bandwidth

A Privacy-Preserving Scheme For Convolutional Neural Network-Based Applications In Mobile Cloud

Communication-Efficient Privacy-Preserving Neural Network Inference via Arithmetic Secret Sharing

Researching the CNN Collaborative Inference Mechanism for Heterogeneous Edge Devices

DeeperThings: Fully Distributed CNN Inference on Resource-Constrained Edge Devices

Toward Practical Privacy-Preserving Convolutional Neural Networks Exploiting Fully Homomorphic Encryption

LEP-CNN: A Lightweight Edge Device Assisted Privacy-preserving CNN Inference Solution for IoT

Privacy-preserving Security Inference Towards Cloud-Edge Collaborative Using Differential Privacy

Automated Exploration and Implementation of Distributed CNN Inference at the Edge

Intelligent Security Performance Prediction for IoT-Enabled Healthcare Networks Using an Improved CNN

SecureAD: A Secure Video Anomaly Detection Framework on Convolutional Neural Network in Edge Computing Environment

Masked image: Visually protected image dataset privacy-preserving scheme for convolutional neural networks

Adaptive Distributed Convolutional Neural Network Inference at the Network Edge with ADCNN

Optimizing Privacy-Preserving Outsourced Convolutional Neural Network Predictions