Abstract:With the rise of artificial intelligence (AIoT), integrating deep neural networks (DNNs) with mobile and embedded devices has become an increasingly growing trend. This integration enhances the ability of mobile IoT devices to collect and analyze data. The previous integration paradigm mainly relied on cloud based training and terminal deployment. However, the real world is dynamic and changing, and previous integration paradigms can lead to untimely model updates, decreased accuracy, and significant communication overhead. Therefore, in order to ensure the accuracy of DNN, the on device training method has gradually become a research hotspot. However, the bottleneck that restricts the efficiency of on device training is usually limited local perception data and computing resources. To address this bottleneck, researchers have proposed federated learning. However, in order to protect data privacy, federated learning cannot share data or model details, which brings new problems such as slow model convergence and reduced convergence accuracy. By contrast, we consider that the environment in which mobile devices operate in the real world is trustworthy (such as personal devices in smart spaces, trusted devices from the same organization/company, etc.). This trustworthiness promotes the sharing of data and model training tasks among mobile devices to improve training efficiency and model accuracy. Therefore, in this article, we propose CrowdLearning, a decentralized distributed training framework based on a collection of trusted AIoT devices. It consists of two collaborative modules, namely the heterogeneous resource sensitive task offloading module that solves the training delay bottleneck and the communication efficient data reallocation module that determines when, how, and to whom data is transmitted, improving the efficiency and effectiveness of DNN training. The experimental results show that group learning outperforms existing federated learning and distributed training baselines on devices in different scenarios. It achieved a 55.8% reduction in training latency and a 67.1% reduction in communication costs.

CoLLaRS : A cloud-edge-terminal collaborative lifelong learning framework for AIoT

Collaborative Learning Between Cloud and End Devices

Edge-cloud Collaborative Learning with Federated and Centralized Features

CCSFLF: Cloud‐edge‐terminal collaborative self‐adaptive federated learning framework

Self-aware distributed deep learning framework for heterogeneous IoT edge devices

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

CE-CoLLM: Efficient and Adaptive Large Language Models Through Cloud-Edge Collaboration

Real-Time Edge Intelligence in the Making: A Collaborative Learning Framework via Federated Meta-Learning

Edge-based Collaborative Training System for Artificial Intelligence-of-Things

CoLLM: A Collaborative LLM Inference Framework for Resource-Constrained Devices

Toward Decentralized and Collaborative Deep Learning Inference for Intelligent IoT Devices

OL4EL: Online Learning for Edge-Cloud Collaborative Learning on Heterogeneous Edges with Resource Constraints

ConLAR: Learning to Allocate Resources to Docker Containers under Time-Varying Workloads

CrowdLearning: A Decentralized Distributed Training Framework Based on Collectives of Trusted AIoT Devices

RALaaS: Resource-Aware Learning-as-a-Service in Edge-Cloud Collaborative Smart Connected Communities

Cloud-Edge-Client Collaborative Learning in Digital Twin Empowered Mobile Networks

Implementation of Big AI Models for Wireless Networks with Collaborative Edge Computing

Efficient Federated Learning for Cloud-Based AIoT Applications

An Offline-Transfer-Online Framework for Cloud-Edge Collaborative Distributed Reinforcement Learning

CLAID: Closing the Loop on AI & Data Collection -- A Cross-Platform Transparent Computing Middleware Framework for Smart Edge-Cloud and Digital Biomarker Applications

Communication-Efficient Device Scheduling via Over-the-Air Computation for Federated Learning