Abstract:Mobile Edge Computing (MEC) technology can be implemented at cellular base stations, enabling flexible and configurable provisions of services for mobile users to access. Nevertheless, the conventional solutions mainly focus on statical service provisioning, which ignores the dynamic nature of the arriving service requests. In this work, we first conduct comprehensive data-driven observations on over 4 million service requests throughout 9,800 base stations. Our key findings suggest that users' demands intrinsically exhibit spatial and temporal patterns, which inevitably lead to performance degradation in statical service provisioning. Motivated by that, we design and implement MobiEdge, a predictive service provisioning system with online learning in wireless edge networks. We propose a graph embedding learning-based model for representation learning, thus to achieve accurate request prediction at different base stations. Then, based on the prediction of incoming service requests, we study the service provisioning reconfiguration problem, i.e., how to jointly optimize service placement and corresponding request scheduling across dual timescales, under constraints of network resources and the total budget. By leveraging the submodular technique, we transform the research issue into a submodular function maximization problem under the $q$ -independence system constraint, where $q$ is a positive constant related to the ratio of coefficients in constraint conditions. On this basis, we propose a $1/(1+q)$ approximation algorithm with rigorous theoretical analysis on the bounded maximum utility. Extensive trace-driven evaluations are conducted over networks of different scales, and MobiEdge shows remarkable performance enhancements by achieving the accuracy of up to 98% in service prediction and an average utility of 92.9% to the optimal solution in service provisioning.

A Reinforcement Learning Approach for Online Service Tree Placement in Edge Computing

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing

Hierarchical Deep Reinforcement Learning for Joint Service Caching and Computation Offloading in Mobile Edge-Cloud Computing

Reinforcement Learning for Task Placement in Collaborative Cloud- Edge Computing

A Dynamic Service Placement Based on Deep Reinforcement Learning in Mobile Edge Computing

A Meta Reinforcement Learning-based Scheme for Adaptive Service Placement in Edge Computing

Reinforcement learning for cost-effective IoT service caching at the edge

A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing

Knowledge-Driven Service Offloading Decision for Vehicular Edge Computing: A Deep Reinforcement Learning Approach

IoT Microservice Deployment in Edge-Cloud Hybrid Environment Using Reinforcement Learning

Dynamic and intelligent edge server placement based on deep reinforcement learning in mobile edge computing

A Self-Adaptive Approach to Service Deployment under Mobile Edge Computing for Autonomous Driving.

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning

Reinforcement-Learning-Assisted Service Function Chain Embedding Algorithm in Edge Computing Networks

A Dynamic Deep-learning-based Virtual Edge Node Placement Scheme for Edge Cloud Systems in Mobile Environment

Deep Reinforcement Learning for Edge Service Placement in Softwarized Industrial Cyber-Physical System

Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid

A Multi-Agent Reinforcement Learning Scheme for SFC Placement in Edge Computing Networks

Intelligent Driving Task Scheduling Service in Vehicle-Edge Collaborative Networks Based on Deep Reinforcement Learning

A Reinforcement Learning Based Placement Strategy In Datacenter Networks

Predictive Service Provisioning with Online Learning in Wireless Edge Networks