POSEIDON : Efficient Function Placement at the Edge using Deep Reinforcement Learning

Prakhar Jain,Prakhar Singhal,Divyansh Pandey,Giovanni Quatrocchi,Karthik Vaidhyanathan

2024-10-17

Abstract:Edge computing allows for reduced latency and operational costs compared to centralized cloud systems. In this context, serverless functions are emerging as a lightweight and effective paradigm for managing computational tasks on edge infrastructures. However, the placement of such functions in constrained edge nodes remains an open challenge. On one hand, it is key to minimize network delays and optimize resource consumption; on the other hand, decisions must be made in a timely manner due to the highly dynamic nature of edge environments. In this paper, we propose POSEIDON, a solution based on Deep Reinforcement Learning for the efficient placement of functions at the edge. POSEIDON leverages Proximal Policy Optimization (PPO) to place functions across a distributed network of nodes under highly dynamic workloads. A comprehensive empirical evaluation demonstrates that POSEIDON significantly reduces execution time, network delay, and resource consumption compared to state-of-the-art methods.

Distributed, Parallel, and Cluster Computing

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper "POSEIDON: Efficient Function Placement in Edge Computing Using Deep Reinforcement Learning" aims to address the efficient placement of serverless functions in edge computing. Specifically, the paper focuses on the following aspects:

1. **Reducing Network Latency**: In edge computing environments, node resources are limited and workloads are highly dynamic. Therefore, a method is needed to minimize network latency and improve user experience.
2. **Optimizing Resource Consumption**: Given the limited resources of edge nodes, efficiently utilizing these resources to reduce operational costs is a key issue.
3. **Rapid Decision-Making**: The highly dynamic nature of edge environments requires the system to make quick decisions to adapt to constantly changing workloads.

Existing methods, such as combinatorial optimization techniques (e.g., integer programming), can produce optimal solutions but are often complex and time-consuming, failing to meet real-time requirements. Additionally, some custom heuristic methods, while fast in computation, result in lower placement quality.

To address these issues, the paper proposes a deep reinforcement learning (DRL)-based method called POSEIDON. POSEIDON uses the Proximal Policy Optimization (PPO) algorithm to efficiently place functions on distributed network nodes and optimizes traffic routing through Mixed-Integer Linear Programming (MILP), significantly reducing execution time, network latency, and resource consumption.