Abstract:This article investigates the distributed online optimization problem over a multi-agent network subject to local set constraints and coupled inequality constraints, which has a lot of applications in many areas, such as wireless sensor networks, power systems, and plug-in electric vehicles. In this problem, the cost function at each time step is the sum of local cost functions with each of them being gradually revealed to its corresponding agent, and meanwhile only local functions in coupled inequality constraints are accessible to each agent. To address this problem, a modified primal-dual algorithm, called distributed online primal-dual push-sum algorithm, is developed in this article, which does not rest on any assumption on parameter boundedness and is applicable to unbalanced networks. It is shown that the proposed algorithm is sublinear for both the dynamic regret and the violation of coupled inequality constraints. Finally, the theoretical results are supported by a simulation example.
What problem does this paper attempt to address?
This paper attempts to solve the distributed online optimization problem in multi - agent networks, which involves local set constraints and coupled inequality constraints. Specifically, the paper focuses on the fact that at each time step, the cost function is the sum of the local cost functions of each agent, and these local cost functions are gradually revealed to the corresponding agents. Meanwhile, only the local functions related to the coupled inequality constraints are visible to each agent. Such problems have wide applications in fields such as wireless sensor networks, power systems, and plug - in electric vehicles.
### Main Problem Description
The problem studied in the paper can be formalized as the following optimization problem:
\[
\min_{x \in X} f_t(x)=\sum_{i = 1}^N f_{i;t}(x_i),\quad \text{s.t.}\quad g(x)=\sum_{i = 1}^N g_i(x_i)\leq0
\]
where:
- \(x = \text{col}(x_1,\dots,x_N)\), \(x_i\in X_i\subset\mathbb{R}^{n_i}\)
- \(f_{i;t}:\mathbb{R}^{n_i}\to\mathbb{R}\) is the local cost function of the \(i\)-th agent at time \(t\)
- \(g_i:\mathbb{R}^{n_i}\to\mathbb{R}^m\) is the local inequality constraint function of the \(i\)-th agent
- \(X=\prod_{i = 1}^N X_i\) is the Cartesian product space of all agents' decision variables
- \(g(x)\leq0\) represents the global coupled inequality constraint
### Dynamic Regret
To measure the algorithm performance, the paper introduces the concept of dynamic regret, which is defined as:
\[
\text{Reg}(T)=\sum_{t = 1}^T\sum_{i = 1}^N f_{i;t}(x_{i;t})-\sum_{t = 1}^T\sum_{i = 1}^N f_{i;t}(x_{i;t}^*)
\]
where \(x_{i;t}^*\) is the optimal solution at time \(t\).
### Constraint Violation
In addition, a measure of constraint violation is also defined:
\[
\text{Reg}_c(T)=\left\|\left[\sum_{t = 1}^T\sum_{i = 1}^N g_i(x_{i;t})\right]_+\right\|
\]
### Solution
To solve the above problems, the paper proposes an improved primal - dual algorithm, called the Distributed Online Primal - Dual Push - Sum Algorithm (DOPP). This algorithm has the following characteristics:
1. **No need to assume bounded Lagrange multipliers**: Different from existing methods, DOPP does not rely on the assumption that Lagrange multipliers are bounded.
2. **Applicable to unbalanced communication graphs**: DOPP can handle more general unbalanced interaction graphs, not just balanced graphs.
3. **Sub - linear dynamic regret and constraint violation**: Theoretical analysis shows that DOPP can achieve sub - linear complexity in terms of dynamic regret and constraint violation.
### Summary
By designing the new DOPP algorithm, this paper solves the distributed online optimization problem with coupled inequality constraints in multi - agent networks, and achieves sub - linear dynamic regret and constraint violation under more relaxed conditions. This makes the algorithm more robust and applicable in practical applications.