Abstract:In this paper, we focus on a class of constrained nonlinear optimization problems (NLP), where some of its equality constraints define a closed embedded submanifold $\mathcal{M}$ in $\mathbb{R}^n$. Although NLP can be solved directly by various existing approaches for constrained optimization in Euclidean space, these approaches usually fail to recognize the manifold structure of $\mathcal{M}$. To achieve better efficiency by utilizing the manifold structure of $\mathcal{M}$ in directly applying these existing optimization approaches, we propose a partial penalty function approach for NLP. In our proposed penalty function approach, we transform NLP into the corresponding constraint dissolving problem (CDP) in the Euclidean space, where the constraints that define $\mathcal{M}$ are eliminated through exact penalization. We establish the relationships on the constraint qualifications between NLP and CDP, and prove that NLP and CDP have the same stationary points and KKT points in a neighborhood of the feasible region under mild conditions. Therefore, various existing optimization approaches developed for constrained optimization in the Euclidean space can be directly applied to solve NLP through CDP. Preliminary numerical experiments demonstrate that by dissolving the constraints that define $\mathcal{M}$, CDP gains superior computational efficiency when compared to directly applying existing optimization approaches to solve NLP, especially in high dimensional scenarios.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to use the embedded sub - manifold structure defined by these constraints to improve the optimization efficiency when dealing with nonlinear programming (NLP) problems with specific equality constraints. Specifically, the paper focuses on the following form of constrained optimization problems:
\[
\begin{aligned}
& \min_{x \in \mathbb{R}^n} & & f(x) \\
& \text{s.t.} & & s(x) = 0, \\
& & & v(x) \leq 0,
\end{aligned}
\]
where some of the equality constraints \(s(x) = 0\) define a closed sub - manifold \(M\) embedded in \(\mathbb{R}^n\). Although many existing constrained optimization methods in Euclidean space can be directly applied to such problems, they usually cannot recognize the manifold structure of \(M\), which may lead to inefficiency.
To solve this problem, the paper proposes a partial penalty function approach, which eliminates the constraints defining \(M\) by transforming the NLP into a constraint dissolution problem (CDP). Specifically, the CDP has the following form:
\[
\begin{aligned}
& \min_{x \in \mathbb{R}^n} & & h(x):=f(A(x))+\frac{\beta}{2}\|c(x)\|^2 \\
& \text{s.t.} & & \tilde{u}_i(x):=u_i(A(x))+\frac{\tau_i}{2}\|c(x)\|^2 = 0, \quad i\in [N_E], \\
& & & \tilde{v}_j(x):=v_j(A(x))+\frac{\gamma_j}{2}\|c(x)\|^2 \leq 0, \quad j\in [N_I],
\end{aligned}
\]
where \(\beta,\{\tau_i\},\{\gamma_j\}\) are non - negative penalty parameters, \(A\) is a constraint dissolution mapping, which satisfies the following assumptions:
1. \(A:\mathbb{R}^n\rightarrow\mathbb{R}^n\) is locally Lipschitz smooth on \(\mathbb{R}^n\);
2. For any \(x\in M\), we have \(A(x) = x\);
3. For any \(x\in M\), the Jacobian matrix of \(J_c(A(x))\) is equal to 0, that is, \(J_A(x)J_c(x)=0\).
In this way, the paper proves that the NLP and CDP have the same stable points and KKT points near the feasible region, and under the appropriate selection of penalty parameters, the CDP can be efficiently solved by directly applying existing Euclidean optimization methods, especially showing better computational efficiency in high - dimensional scenarios.