Abstract:As machine learning (ML) technologies continue to evolve, there is an increasing demand for data. Mobile crowd sensing (MCS) can motivate more users in the data collection process through reasonable compensation, which can enrich the data scale and coverage. However, nowadays, users are increasingly concerned about their privacy and are unwilling to easily share their personal data. Therefore, protecting privacy has become a crucial issue. In ML, federated learning (FL) is a widely known privacy‐preserving technique where the model training process is performed locally by the data owner, which can protect privacy to a large extent. However, as the model size grows, the weak computing power and battery life of user devices are not sufficient to support training a large number of models locally. With mobile edge computing (MEC), user can offload some of the model training tasks to the edge server for collaborative computation, allowing the edge server to participate in the model training process to improve training efficiency. However, edge servers are not fully trusted, and there is still a risk of privacy leakage if data is directly uploaded to the edge server. To address this issue, we design a local differential privacy (LDP) based data privacy‐preserving algorithm and a deep reinforcement learning (DRL) based task offloading algorithm. We also propose a privacy‐preserving distributed ML framework for MEC and model the cloud‐edge‐mobile collaborative training process. These algorithms not only enable effective utilization of edge computing to accelerate machine learning model training but also significantly enhance user privacy and save device battery power. We have conducted experiments to verify the effectiveness of the framework and algorithms.

EdgeMove: Pipelining Device-Edge Model Training for Mobile Intelligence

Extendable Multi-Device Collaborative Pipeline Parallel Inference in the Edge-Cloud Scenario

AccEPT: an Acceleration Scheme for Speeding Up Edge Pipeline-parallel Training

Context-Aware Compilation of DNN Training Pipelines across Edge and Cloud

PipeEdge: A Trusted Pipelining Collaborative Edge Training Based on Blockchain

Privacy-preserving Model Training Architecture for Intelligent Edge Computing

MoEI: Mobility-Aware Edge Inference Based on Model Partition and Service Migration

FTPipeHD: A Fault-Tolerant Pipeline-Parallel Distributed Training Framework for Heterogeneous Edge Devices

FTPipeHD: A Fault-Tolerant Pipeline-Parallel Distributed Training Approach for Heterogeneous Edge Devices

Edge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge Synergy

HierTrain: Fast Hierarchical Edge AI Learning with Hybrid Parallelism in Mobile-Edge-Cloud Computing

EdgeMesh: A Hybrid Distributed Training Mechanism for Heterogeneous Edge Devices.

Privacy‐preserving task offloading in mobile edge computing: A deep reinforcement learning approach

Model Parallelism Optimization for Distributed DNN Inference on Edge Devices.

Asteroid: Resource-Efficient Hybrid Pipeline Parallelism for Collaborative DNN Training on Heterogeneous Edge Devices

Joint Optimization of Device Placement and Model Partitioning for Cooperative DNN Inference in Heterogeneous Edge Computing

Rethinking Machine Learning Development and Deployment for Edge Devices

Trine: Cloud-Edge-Device Cooperated Real-Time Video Analysis for Household Applications

Hastening Stream Offloading of Inference Via Multi-Exit DNNs in Mobile Edge Computing

Edge-PRUNE: Flexible Distributed Deep Learning Inference

Enabling Deep Learning on Edge Devices through Filter Pruning and Knowledge Transfer