Abstract:In the emerging Internet of Things (IoT) paradigm, mobile cloud inference serves as an efficient application framework that relieves the computation and storage burden on resource-constrained mobile devices offloading the workload to cloud servers. However, mobile cloud inference encounters computation, communication, and privacy challenges to ensure efficient system inference and protect the privacy of mobile users' collected information. To address the deployment of deep neural networks (DNN) with large capacity, we propose splitting computing (SC) where the entire model is divided into two parts, to be executed mobile and cloud ends respectively. However, the transmission of intermediate data poses a bottleneck system performance. This paper initially demonstrates the privacy issue arising from the machine analysis oriented intermediate feature. We conduct a preliminary experiment to intuitively reveal the latent potential for enhancing the privacy-preserving ability of the initial feature. Motivated by this, we propose a framework for privacy-preserving intermediate feature compression, which addresses the limitations in both compression and privacy that arise in the original extracted feature data. Specifically, we propose a method that jointly enhances privacy and encoding efficiency, achieved through the collaboration of the encoding feature privacy enhancement module and the privacy feature ordering enhancement module. Additionally, we develop gradient-reversal optimization strategy based on information theory to ensure the utmost concealment of core privacy information throughout the entire codec process. We evaluate the proposed method on two DNN models using two datasets, demonstrating its ability to achieve superior analysis accuracy and higher privacy preservation than HEVC. Furthermore, we provide an application case of a wireless sensor network to validate the effectiveness of the proposed method in a real-world scenario.

Learning to Prevent Input Leakages in the Mobile Cloud Inference

Close the Gap Between Deep Learning and Mobile Intelligence by Incorporating Training in the Loop

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

Private Data Inference Attacks against Cloud: Model, Technologies, and Research Directions

GELU-Net: A Globally Encrypted, Locally Unencrypted Deep Neural Network for Privacy-Preserved Learning.

Preventing Information Leakage with Neural Architecture Search

Not Just Privacy: Improving Performance of Private Deep Learning in Mobile Cloud.

A survey on privacy inference attacks and defenses in cloud-based Deep Neural Network

Privacy Inference Attacks and Defenses in Cloud-based Deep Neural Network: A Survey

Not Just Privacy

A Framework to Preserve User Privacy for Machine Learning as a Service

A Privacy-Preserving Scheme For Convolutional Neural Network-Based Applications In Mobile Cloud

Private Compression for Intermediate Feature in Iot-Supported Mobile Cloud Inference

Protecting Inference Privacy with Accuracy Improvement in Mobile-Cloud Deep Learning

EdgeSanitizer: Locally Differentially Private Deep Inference at the Edge for Mobile Data Analytics

Lightweight and Unobtrusive Privacy Preservation for Remote Inference Via Edge Data Obfuscation

XNN: Paradigm Shift in Mitigating Identity Leakage within Cloud-Enabled Deep Learning

A Hybrid Deep Learning Architecture for Privacy-Preserving Mobile Analytics

Defending CNN against privacy leakage in edge computing via binary neural networks

Find and Dig: A Privacy-Preserving Image Processing Mechanism in Deep Neural Networks for Mobile Computation

PrivyNet: A Flexible Framework for Privacy-Preserving Deep Neural Network Training