Abstract:The emergence of Mobile Edge Computing (MEC) alleviates the large transmission latency resulting from the traditional cloud computing. For the compute-intensive requests such as video analysis, mobile users prefer to obtain a desired quality of experience (QoE) with neglected latency and reduced energy consumption. The popularity of smart devices allows users to release a run of compute-intensive as well as latency-sensitive requests anywhere, which may lead to bursty requests. A single resource-constrained edge server nearby is capable of handling a small amount of requests quickly, yet it seems helpless when encountering bursty compute-intensive requests. Despite the abundance of recently proposed schemes, the majority focus on efficiently scheduling pending requests in a single edge server, and ignored the potential role of edge collaboration to schedule bursty requests. Besides, while some recent studies proposed to finish a task using multiple devices, they focused on collaboration between mobile devices rather than between edge servers. Hence, we propose DeepLoad, a S2S system that schedules the bursty requests with a collaborative method using reinforcement learning (RL). DeepLoad decouples the scheduling decision into AP selection for setting the access point and workload redistribution for collaborative servers. DeepLoad trains a neural network model that picks decisions for each request based on observations collected by mobile devices. DeepLoad learns to make scheduling decisions solely through the resulting performance of historical decisions rather than rely on pre-programmed models or specific assumptions for the environment. Naturally, DeepLoad automatically learns the scheduling algorithm for each request and obtains a gratifying QoE. We aim to maximize the fraction of requests finished before their attached deadlines. Based on the Shanghai taxi trajectory data set, we design a simulator to obtain abundant samples, and leverage two GeForce GTX TITAN Xp GPUs to train the Actor–Critic network. Compared to the state-of-the-art bandwidth-based and server resources-based methods, DeepLoad can achieve a significant improvement in average fraction.

Fragmented Task Scheduling for Load-Balanced Fog Computing Based on Q-Learning

Task scheduling in edge-fog-cloud architecture: a multi-objective load balancing approach using reinforcement learning algorithm

Deep Reinforcement Learning-based scheduling for optimizing system load and response time in edge and fog computing environments

Reinforcement Learning-Based Computing and Transmission Scheduling for LTE-U-Enabled IoT

QoS-Aware Task Offloading in Fog Environment Using Multi-agent Deep Reinforcement Learning

Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing

Cognitive Balance for Fog Computing Resource in Internet of Things: An Edge Learning Approach

A Novel Offloading Mechanism Leveraging Fuzzy Logic and Deep Reinforcement Learning to Improve IoT Application Performance in a Three-Layer Architecture Within the Fog-Cloud Environment

Task scheduling for improved response time of latency sensitive applications in fog integrated cloud environment

Reinforcement Learning-based Resource Allocation in Fog RAN for IoT with Heterogeneous Latency Requirements

Lifelong Learning for Fog Load Balancing: A Transfer Learning Approach

Machine learning-driven task scheduling with dynamic K-means based clustering algorithm using fuzzy logic in FOG environment

Mayfly Taylor Optimisation-Based Scheduling Algorithm with Deep Reinforcement Learning for Dynamic Scheduling in Fog-Cloud Computing

Quantumized approach of load scheduling in fog computing environment for IoT applications

Task offloading mechanism based on federated reinforcement learning in mobile edge computing

Learning Scheduling Bursty Requests in Mobile Edge Computing Using DeepLoad

Fully Distributed Fog Load Balancing with Multi-Agent Reinforcement Learning

Blockchain and Learning-Based Secure and Intelligent Task Offloading for Vehicular Fog Computing

LBATSM: Load Balancing Aware Task Selection and Migration Approach in Fog Computing Environment

An ML‐based task clustering and placement using hybrid Jaya‐gray wolf optimization in fog‐cloud ecosystem

Q‐learning based flexible task scheduling in a global view for the Internet of Things