Abstract:The rise of the Internet of Things and edge computing has shifted computing resources closer to end-users, benefiting numerous delay-sensitive, computation-intensive applications. To speed up computation, distributed computing is a promising technique that allows parallel execution of tasks across multiple compute nodes. However, current research predominantly revolves around the master-worker paradigm, limiting resource sharing within one-hop neighborhoods. This limitation can render distributed computing ineffective in scenarios with limited nearby resources or constrained/dynamic connectivity. In this paper, we address this limitation by introducing a new distributed computing framework that extends resource sharing beyond one-hop neighborhoods through exploring layered network structures. Our framework involves transforming the network graph into a sink tree and formulating a joint optimization problem based on the layered tree structure for task allocation and scheduling. To solve this problem, we propose two exact methods that find optimal solutions and three heuristic strategies to improve efficiency and scalability. The performances of these methods are analyzed and evaluated through theoretical analyses and comprehensive simulation studies. The results demonstrate their promising performances over the traditional distributed computing and computation offloading strategies.
Distributed, Parallel, and Cluster Computing,Networking and Internet Architecture
What problem does this paper attempt to address?
### Problems the paper attempts to solve
The paper aims to address the limitations of distributed computing resource allocation and scheduling in edge computing. Specifically, the existing distributed computing strategies mainly adopt the master - worker paradigm, which restricts the sharing of resources within a single - hop neighborhood. In the edge computing environment, due to the limited computing power, memory capacity and bandwidth of nodes, this limitation is particularly obvious, especially in cases where network connections are restricted or change dynamically, such as aerial computing systems composed of unmanned aerial vehicles.
### Solutions
To solve the above problems, the paper proposes a Multi - Layered Distributed Computing Framework, which extends resource sharing beyond multi - hop neighborhoods by exploring the hierarchical network structure. The main contributions include:
1. **New multi - layered distributed computing framework**:
- The framework takes advantage of the hierarchical network structure to make full use of the resources of the entire edge computing network in order to improve system performance.
- It converts the network graph into a sink tree, and based on this tree structure, models the task allocation and scheduling problem as a mixed - integer programming (MIP) problem.
- The framework is applicable to various network computing systems, such as cloud computing, mobile edge computing (MEC) and networked aerial computing systems.
2. **Two exact methods**:
- Two exact methods are proposed to solve the optimization problem, including a centralized method and a parallel - enhanced centralized method.
- These methods can be executed in real - time and are able to handle dynamic and mobile networks.
3. **Three heuristic methods**:
- In order to improve efficiency and scalability, two worker - node selection methods and a genetic algorithm are proposed to efficiently find approximately optimal solutions.
4. **Comprehensive simulation study**:
- The performance of the proposed methods is evaluated through theoretical analysis and comprehensive simulation studies.
- The results show that, compared with traditional distributed computing and computing offloading strategies, this framework can make better use of the resources of the entire network, thereby improving performance.
### Mathematical models
1. **Computing model**:
- The computing power of server \( i \) is represented as \( f_i \), that is, the CPU frequency (GHz).
- Given the task size \( y \), the total number of CPU cycles required to process this task is \( b \).
- The time required for server \( i \) to process the task is:
\[
T_{\text{comp}}^i=\frac{yb}{f_i}
\]
2. **Communication model**:
- The data transfer rate from server \( i \) to server \( j \) is \( R_{i,j} \).
- The transfer rate can be approximated by Shannon's theory as:
\[
R_{i,j}=B_{i,j}\log_2\left(1 + \frac{s_{i,j}}{n_{i,j}}\right)
\]
where \( B_{i,j} \) is the channel bandwidth, and \( s_{i,j} \) and \( n_{i,j} \) are the signal power and noise power respectively.
3. **Energy consumption model**:
- The energy required for server \( i \) to execute a task includes computing energy consumption and communication energy consumption.
- The computing energy consumption is:
\[
E_{\text{comp}}^i=\gamma_i yb(f_i)^2
\]
where \( \gamma_i \) is the effective switching capacitance of server \( i \), which depends on the chip architecture.
- The communication energy consumption is:
\[
E_{\text{comm}}^{i,j}=\frac{e_i y}{R_{i,j}}
\]
where \( e_i \) is the transmission power of server \( i \).
### Optimization problems