Abstract:Adaptive task recommendation in Mobile crowd sensing (MCS) is a challenging problem, mainly because perceptual tasks are spatio-temporal in nature and worker preferences are dynamically changing. Although there have been some approaches to address the dynamics of task recommendation, these approaches suffer from several problems. First, they only learn the worker's past preferences and cannot cope with the situation where the worker's preferences may change in the next moment, and they only consider the current optimal recommendation instead of global optimization. Second, existing methods do not scale efficiently to the arrival of new workers or tasks, requiring the entire model to be retrained. To address these issues, we propose an adaptive task recommendation method (ATRec) based on reinforcement learning. Specifically, we formalize the adaptive task recommendation problem for each target worker as an interactive Markov decision process (MDP). Then, we use an improved matrix decomposition technique to construct worker-personalized latent factor states based on information such as task content and spatio-temporal context, enabling us to use a unified MDP to learn optimal strategies for different workers. After that, we design an adaptive update algorithm (AUA) based on Deep Q Network (DQN) to more accurately learn the dynamic changes of workers' preferences to adaptively update the task recommendation list of workers. In addition, we propose a personalized dimension reduction method (PDR) to reduce the size of the task set. Through comprehensive experimental results and analysis, we demonstrate the effectiveness of the ATRec approach. Compared with existing methods, ATRec can better solve the problem of adaptive task recommendation, and can more accurately predict workers' preferences and make recommendations.

Deep Reinforcement Learning Based Iterative Participant Selection Method for Industrial IoT Big Data Mobile Crowdsourcing

Auxiliary-task Based Deep Reinforcement Learning for Participant Selection Problem in Mobile Crowdsourcing

High Quality Participant Recruitment of Mobile Crowdsourcing over Big Data

Fair and size-scalable participant selection framework for large-scale mobile crowdsensing

Adaptive task recommendation based on reinforcement learning in mobile crowd sensing

An End-to-End Deep RL Framework for Task Arrangement in Crowdsourcing Platforms

A Transfer Learning Based Framework Of Crowd-Selection On Twitter

Crowdsourcing Upon Learning: Energy-Aware Dispatch With Guarantee for Video Analytics

Deep Learning for Mobile Crowdsourcing Techniques, Methods, and Challenges: A Survey

Conscious Task Recommendation via Cognitive Reasoning Computing in Mobile Crowd Sensing

A Participant Selection Method for Crowdsensing under an Incentive Mechanism.

Multiagent Deep Reinforcement Learning Based Incentive Mechanism for Mobile Crowdsensing in Intelligent Transportation Systems

A Trustworthy Recruitment Process for Spatial Mobile Crowdsourcing in Large-scale Social IoT

Towards Personalized Task-Oriented Worker Recruitment in Mobile Crowdsensing

SocialRecruiter: Dynamic Incentive Mechanism for Mobile Crowdsourcing Worker Recruitment With Social Networks

Dynamic Incentive for Reliable MCS Participant Selection

Dynamic Mobile Crowdsourcing Selection for Electricity Load Forecasting

Crowdsensing Game with Demand Uncertainties: A Deep Reinforcement Learning Approach

Unknown Worker Recruitment with Budget and Covering Constraints for Mobile Crowdsensing

LSTM-Oppurs: Opportunistic user recruitment strategy based on deep learning in mobile crowdsensing system

Q-Learning-Based Hyperheuristic Evolutionary Algorithm for Dynamic Task Allocation of Crowdsensing