Abstract:With the rapid arrival of the Internet of Everything era,massive data resources are generated on edge sides,causing problems such as large network load,high energy consumption,and privacy security in traditional distributed training based on cloud computing.Edge computing sinks computing power resources to the edge side,forming a collaborative computing system that integrates“cloud,edge,and end,”which can meet the basic needs of real-time operations,intelligence,security,and privacy protection.With the help of edge computing capabilities,edge intelligence effectively promotes the intelligent development of the edge side,which has become a popular topic.Through our research,we found that edge collaborative intelligence is currently in a stage of rapid development.At this stage,several deep learning models are combined with edge computing,and many edge collaborative intelligent processing solutions have exploded,such as distributed training in edge computing scenarios,federated learning,and distributed collaborative reasoning based on technologies such as model cutting and early exit.The combination of a shallow breadth learning system and virtualization technology allows for quick implementation of edge intelligence,which considerably improves service quality and user experience and makes services more intelligent.As a key link of edge intelligence,edge intelligence collaborative training aims to assist or implement the distributed training of machine learning models on the edge side.However,in an edge computing scenario,the distributed training of the model must coordinate several edge nodes,and many challenges remain.Therefore,by fully investigating the existing research foundation of edge intelligent collaborative training,we focus on the challenges and solutions of edge intelligent collaborative training in edge scenarios such as equipment heterogeneity,limited equipment resources,and unstable network environments.This paper introduces and summarizes the overall architecture and core modules of edge intelligent collaborative training.The overall architecture mainly focuses on the interaction framework between edge devices.In terms of whether there is a central server role,it can be divided into two categories:parameter server centralized architecture and fully decentralized parallel architecture.The core module of edge intelligent collaborative training mainly focuses on the problem of collaborative training of a large number of edge devices for neural network models to update parameters.In terms of the role of parallel computing in model training,it is divided into data parallelism and model parallelism.Finally,the many challenges and prospects of edge collaborative training are analyzed and summarized.

Collective Deep Reinforcement Learning for Intelligence Sharing in the Internet of Intelligence-Empowered Edge Computing

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Collaborative Edge Computing and Caching with Deep Reinforcement Learning Decision Agents

Seek Common While Shelving Differences: Orchestrating Deep Neural Networks for Edge Service Provisioning

Bring Intelligence among Edges: A Blockchain-Assisted Edge Intelligence Approach

Multi-User QoE Enhancement: Federated Multi-Agent Reinforcement Learning for Cooperative Edge Intelligence.

Survey of Edge–edge Collaborative Training for Edge Intelligence

Joint Task and Computing Resource Allocation in Distributed Edge Computing Systems Via Multi-Agent Deep Reinforcement Learning

Distributed and Collective Deep Reinforcement Learning for Computation Offloading: A Practical Perspective.

Distributed Training for Deep Learning Models On An Edge Computing Network Using ShieldedReinforcement Learning

Reinforcement Learning Based Energy-Efficient Collaborative Inference for Mobile Edge Computing

Edge Dynamic Service Offloading Based on Multi-agent Deep Q Learning.

Online Practical Deep Learning Education: Using Collective Intelligence from a Resource Sharing Perspective

In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning

Cooperative Edge Caching: A Multi-Agent Deep Learning Based Approach

DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications

Distributed Resource Scheduling for Large-Scale MEC Systems: A Multiagent Ensemble Deep Reinforcement Learning With Imitation Acceleration

Distributed Resource Scheduling for Large-Scale MEC Systems: A Multi-Agent Ensemble Deep Reinforcement Learning with Imitation Acceleration

A Double-Timescale Reinforcement Learning Based Cloud-Edge Collaborative Framework for Decomposable Intelligent Services in Industrial Internet of Things