Abstract:Mobile crowdsensing (MCS) represents a new sensing paradigm that utilizes the smart mobile devices to collect and share data. Traditional MCS systems mainly leverages the people carried smartphones and other wearable devices which are constrained by the limited sensing capability and battery power. With the popularity of unmanned vehicles like unmanned aerial vehicles (UAVs) and driverless cars, they can provide much more reliable, accurate and cost-efficient sensing services due to to their equipped more powerful sensors. In this paper, we propose a distributed control framework for energy-efficient and DIstributed VEhicle navigation with chaRging sTations, called “e-Divert”. It is a distributed multi-agent deep reinforcement learning (DRL) solution, which uses a convolutional neural network (CNN) to extract useful spatial features as the input to the actor-critic network to produce a real-time action. Also, e-Divert incorporates a distributed prioritized experience replay for better exploration and exploitation, and a long short-term memory (LSTM) enabled N-step temporal sequence modeling module. The solution fully explores the spatiotemporal nature of the considered scenario for better vehicle cooperation and competition between themselves and charging stations, to maximize the energy efficiency, data collection ratio, geographic fairness, and minimize the energy consumption simultaneously. Through extensive simulations, we find an appropriate set of hyperparameters that achieve the best performance, i.e., 5 actors in Ape-X architecture, priority exponent 0.5, and LSTM sequence length 3. Finally, we compare with four baselines including one state-of-the-art approach MADDPG. Results show that our proposed e-Divert significantly improves the energy efficiency, as compared to MADDPG, by 3.62 and 2.36 times on average when varying different numbers of vehicles and charging stations, respectively.

Auxiliary-task Based Deep Reinforcement Learning for Participant Selection Problem in Mobile Crowdsourcing

Deep Reinforcement Learning Based Iterative Participant Selection Method for Industrial IoT Big Data Mobile Crowdsourcing

Adaptive task recommendation based on reinforcement learning in mobile crowd sensing

Smart Mobile Crowdsensing with Urban Vehicles: A Deep Reinforcement Learning Perspective

IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning

An End-to-End Deep RL Framework for Task Arrangement in Crowdsourcing Platforms

Cooperative task assignment in spatial crowdsourcing via multi-agent deep reinforcement learning

Reinforcement Learning-Based Cell Selection in Sparse Mobile Crowdsensing.

Free Market of Multi-Leader Multi-Follower Mobile Crowdsensing: an Incentive Mechanism Design by Deep Reinforcement Learning

Cell Selection with Deep Reinforcement Learning in Sparse Mobile Crowdsensing

When Crowdsourcing Meets Unmanned Vehicles: Toward Cost-Effective Collaborative Urban Sensing Via Deep Reinforcement Learning

Energy-Efficient Mobile Crowdsensing by Unmanned Vehicles: A Sequential Deep Reinforcement Learning Approach

Optimizing Worker Selection in Collaborative Mobile Crowdsourcing

A Learning-Based Credible Participant Recruitment Strategy for Mobile Crowd Sensing.

Acceptance-Aware Mobile Crowdsourcing Worker Recruitment in Social Networks.

A Real-World-Oriented Multi-Task Allocation Approach Based on Multi-Agent Reinforcement Learning in Mobile Crowd Sensing

Task Migration Based on Deep Reinforcement Learning in Mobile Crowdsourcing

Distributed and Energy-Efficient Mobile Crowdsensing with Charging Stations by Deep Reinforcement Learning

A Deep Reinforcement Learning-Based Contract Incentive Mechanism for Mobile Crowdsourcing Networks

Mobile Crowdsensing for Data Freshness: A Deep Reinforcement Learning Approach.

Balancing Supply and Demand for Mobile Crowdsourcing Services