Abstract:Big Artificial Intelligence (AI) models have emerged as a crucial element in various intelligent applications at the edge, such as voice assistants in smart homes and autonomous robotics in smart factories. Training big AI models, e.g., for personalized fine-tuning and continual model refinement, poses significant challenges to edge devices due to the inherent conflict between limited computing resources and intensive workload associated with training. Despite the constraints of on-device training, traditional approaches usually resort to aggregating training data and sending it to a remote cloud for centralized training. Nevertheless, this approach is neither sustainable, which strains long-range backhaul transmission and energy-consuming datacenters, nor safely private, which shares users' raw data with remote infrastructures. To address these challenges, we alternatively observe that prevalent edge environments usually contain a diverse collection of trusted edge devices with untapped idle resources, which can be leveraged for edge training acceleration. Motivated by this, in this article, we propose collaborative edge training, a novel training mechanism that orchestrates a group of trusted edge devices as a resource pool for expedited, sustainable big AI model training at the edge. As an initial step, we present a comprehensive framework for building collaborative edge training systems and analyze in-depth its merits and sustainable scheduling choices following its workflow. To further investigate the impact of its parallelism design, we empirically study a case of four typical parallelisms from the perspective of energy demand with realistic testbeds. Finally, we discuss open challenges for sustainable collaborative edge training to point to future directions of edge-centric big AI model training.

Privacy-preserving Model Training Architecture for Intelligent Edge Computing

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

Ubiquitous Intelligent Federated Learning Privacy-Preserving Scheme under Edge Computing

Edge-cloud Collaborative Learning with Federated and Centralized Features

Privacy‐preserving task offloading in mobile edge computing: A deep reinforcement learning approach

Model Protection: Real-Time Privacy-Preserving Inference Service for Model Privacy at the Edge

A Secure and Privacy-Preserving Machine Learning Model Sharing Scheme for Edge-Enabled IoT

Privacy-Preserving Machine Learning Based Data Analytics on Edge Devices

Privacy-preserving cloud-edge collaborative learning without trusted third-party coordinator

Privacy-Enhanced Training-as-a-Service for On-Device Intelligence: Concept, Architectural Scheme, and Open Problems

Cloud-Edge Collaborative Large Model Services: Challenges and Solutions

Implementation of Big AI Models for Wireless Networks with Collaborative Edge Computing

Survey: federated learning data security and privacy-preserving in edge-Internet of Things

Edge-Enabled Distributed Deep Learning for 5G Privacy Protection

A privacy-preserving deep learning approach for face recognition with edge computing

Learning from Differentially Private Neural Activations with Edge Computing

Keep Your Data Locally: Federated-Learning-Based Data Privacy Preservation in Edge Computing

Enabling Secure Intelligent Network with Cloud-Assisted Privacy-Preserving Machine Learning

Fed-PEMC: A Privacy-Enhanced Federated Deep Learning Algorithm for Consumer Electronics in Mobile Edge Computing

Privacy-Preserving Federated Learning for Internet of Medical Things Under Edge Computing

Federated Learning Model Training Mechanism with Edge Cloud Collaboration for Services in Smart Cities