Abstract:In this paper, we investigate regrets of an online semi-proximal alternating direction method of multiplier (Online-spADMM) for solving online linearly constrained convex composite optimization problems. Under mild conditions, we establish ${\rm O}(\sqrt{N})$ objective regret and ${\rm O}(\sqrt{N})$ constraint violation regret at round $N$ when the dual step-length is taken in $(0,(1 +\sqrt{5})/2)$ and penalty parameter $\sigma$ is taken as $\sqrt{N}$. We explain that the optimal value of parameter $\sigma$ is of order ${\rm O}(\sqrt{N})$. Like the semi-proximal alternating direction method of multiplier (spADMM), Online-spADMM has the advantage to resolve the potentially non-solvability issue of the subproblems efficiently. We show the usefulness of the obtained results when applied to different types of online optimization problems and verify the theoretical result by numerical experiments}. The inequalities established for Online-spADMM are also used to develop iteration complexity of the average update of spADMM for solving linearly constrained convex composite optimization problems.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the objective regret and constraint violation regret in the online linear - constrained convex composite optimization problem. Specifically, the paper proposes the Online - semi - proximal Alternating Direction Method of Multipliers (Online - spADMM), and under certain conditions, it is proved that after N rounds of iteration, both the objective regret and the constraint violation regret are of the order of \(O(\sqrt{N})\). In addition, the paper also discusses how to optimize the regret bounds by choosing appropriate parameters \(\sigma\) and \(S_k\), and shows the application effects of this method in different types of online optimization problems.
### Main contributions of the paper:
1. **Extended cost function**: The cost function considered in the paper is a proper lower - semicontinuous convex extended real - valued function, which enables the optimization model to include more online optimization problems, such as linear semidefinite programming, quadratic semidefinite programming, and convex composite programming.
2. **Dual variable step size**: The proposed Online - spADMM allows the dual step size to be at least the golden ratio 1.618, and is independent of the time horizon and other parameters.
3. **Proof of regret bounds**: When \(\sigma=\sqrt{N}\) and \(S_k\) is chosen appropriately, under weaker assumptions, it is proved that both the objective function regret and the constraint violation regret of N iterations are \(O(\sqrt{N})\).
4. **Complexity analysis**: For the average value of the first N iterations of using spADMM to solve the linear - constrained convex composite optimization problem, it is proved that both the iteration complexity of the objective function and the iteration complexity of the constraint violation are \(O(\sqrt{N})\).
5. **Numerical experiments**: The Online - spADMM is applied to multiple instances of online linear - constrained optimization problems, and the theoretical results are verified by numerical experiments. Compared with other existing numerical results, the Online - spADMM performs excellently in all aspects, especially in running time.
### Key concepts:
- **Objective Regret**: It is defined as
\[
\text{regret}_{\text{obj}}^N=\sum_{t = 1}^N[f_t(x_t)+g(z_t)]-\min_{Ax + Bz = c}\left\{\sum_{t = 1}^N[f_t(x)+g(z)]\right\}
\]
- **Constraint Violation Regret**: It is defined as
\[
\text{regret}_{\text{ctr}}^N=\sum_{t = 1}^N\left\|Ax_t + Bz_t - c\right\|^2
\]
### Main technical contributions:
- **Key inequalities**: The paper derives two important inequalities, which play a key role in analyzing the objective regret, the constraint violation regret, and the solution error regret.
- **Matrix order**: Assume \(S_1\succeq S_2\succeq\cdots\succeq S_{N + 1}\), which helps to simplify the handling of inequalities.
- **Parameter selection**: By choosing appropriate \(\sigma\) and \(S_k\), the regret bounds can be optimized, making the algorithm perform better in practical applications.
### Conclusion:
Through strict mathematical analysis and numerical experiments, the paper proves the effectiveness and superiority of Online - spADMM in solving online linear - constrained convex composite optimization problems. This method not only has good performance guarantees in theory, but also performs well in practical applications.