Abstract:With the rise of artificial intelligence (AIoT), integrating deep neural networks (DNNs) with mobile and embedded devices has become an increasingly growing trend. This integration enhances the ability of mobile IoT devices to collect and analyze data. The previous integration paradigm mainly relied on cloud based training and terminal deployment. However, the real world is dynamic and changing, and previous integration paradigms can lead to untimely model updates, decreased accuracy, and significant communication overhead. Therefore, in order to ensure the accuracy of DNN, the on device training method has gradually become a research hotspot. However, the bottleneck that restricts the efficiency of on device training is usually limited local perception data and computing resources. To address this bottleneck, researchers have proposed federated learning. However, in order to protect data privacy, federated learning cannot share data or model details, which brings new problems such as slow model convergence and reduced convergence accuracy. By contrast, we consider that the environment in which mobile devices operate in the real world is trustworthy (such as personal devices in smart spaces, trusted devices from the same organization/company, etc.). This trustworthiness promotes the sharing of data and model training tasks among mobile devices to improve training efficiency and model accuracy. Therefore, in this article, we propose CrowdLearning, a decentralized distributed training framework based on a collection of trusted AIoT devices. It consists of two collaborative modules, namely the heterogeneous resource sensitive task offloading module that solves the training delay bottleneck and the communication efficient data reallocation module that determines when, how, and to whom data is transmitted, improving the efficiency and effectiveness of DNN training. The experimental results show that group learning outperforms existing federated learning and distributed training baselines on devices in different scenarios. It achieved a 55.8% reduction in training latency and a 67.1% reduction in communication costs.

Big Data Analytics by CrowdLearning: Architecture and Mechanism Design.

Crowdtraining: Architecture and Incentive Mechanism for Deep Learning Training in the Internet of Things

Crowdsensing Game with Demand Uncertainties: A Deep Reinforcement Learning Approach

An Incentive Mechanism for Privacy-Preserving Crowdsensing via Deep Reinforcement Learning

Learning-based Incentive Mechanism Design for Crowd Sensing

Free Market of Multi-Leader Multi-Follower Mobile Crowdsensing: an Incentive Mechanism Design by Deep Reinforcement Learning

Crowd-Empowered Privacy-Preserving Data Aggregation for Mobile Crowdsensing.

CrowdLearning: A Decentralized Distributed Training Framework Based on Collectives of Trusted AIoT Devices

Socially Privacy-Preserving Data Collection for Crowdsensing

Federated Learning Based Mobile Crowd Sensing with Unreliable User Data

Decentralized Online Learning in Task Assignment Games for Mobile Crowdsensing

Scalable Mobile Crowdsensing via Peer-to-Peer Data Sharing

Achieving Incentive, Security, and Scalable Privacy Protection in Mobile Crowdsensing Services

Incentive Mechanism for Privacy-Aware Data Aggregation in Mobile Crowd Sensing Systems.

Crowdsensing Big Data: Sensing, Data Selection, and Understanding

High Quality Participant Recruitment of Mobile Crowdsourcing over Big Data

A Two-Tiered Incentive Mechanism Design for Federated Crowd Sensing

IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning

Magicrowd: A Crowd Based Incentive For Location-Aware Crowd Sensing

A Multi-Leader Multi-Follower Game-Based Analysis for Incentive Mechanisms in Socially-Aware Mobile Crowdsensing

Big Data Analytics Using Cloud and Crowd