Abstract:In this paper, we consider the $\alpha\| \cdot\|_{\ell_1}-\beta\| \cdot\|_{\ell_2}$ sparsity regularization with parameter $\alpha\geq\beta\geq0$ for nonlinear ill-posed inverse problems. We investigate the well-posedness of the regularization. Compared to the case where $\alpha>\beta\geq0$, the results for the case $\alpha=\beta\geq0$ are weaker due to the lack of coercivity and Radon-Riesz property of the regularization term. Under certain condition on the nonlinearity of $F$, we prove that every minimizer of $ \alpha\| \cdot\|_{\ell_1}-\beta\| \cdot\|_{\ell_2}$ regularization is sparse. For the case $\alpha>\beta\geq0$, if the exact solution is sparse, we derive convergence rate $O(\delta^{\frac{1}{2}})$ and $O(\delta)$ of the regularized solution under two commonly adopted conditions on the nonlinearity of $F$, respectively. In particular, it is shown that the iterative soft thresholding algorithm can be utilized to solve the $ \alpha\| \cdot\|_{\ell_1}-\beta\| \cdot\|_{\ell_2}$ regularization problem for nonlinear ill-posed equations. Numerical results illustrate the efficiency of the proposed method.
What problem does this paper attempt to address?
This paper attempts to solve the sparsity regularization problem in nonlinear ill - posed inverse problems. Specifically, the author considers the nonlinear operator equation of the form \(F(x) = y\), where \(x\) is sparse and \(F: \ell^2\rightarrow Y\) is a weakly sequentially closed nonlinear operator, mapping between the \(\ell^2\) space and the Hilbert space \(Y\). To deal with this problem, the author introduces a new regularization method:
\[R_{\alpha,\beta}(x):=\alpha\|x\|_{\ell^1}-\beta\|x\|_{\ell^2},\quad\alpha\geq\beta\geq0.\]
### Main research contents:
1. **Well - posedness analysis**: The author studies the well - posedness of this regularization, that is, the existence, stability and convergence of the regularized solution. In particular, two cases of \(\alpha > \beta\geq0\) and \(\alpha=\beta\geq0\) are discussed in detail.
- For the case of \(\alpha > \beta\geq0\), the author proves that the regularization problem is well - posed, and when the exact solution is sparse, the convergence rates of the regularized solution are derived as \(O(\delta^{1 / 2})\) and \(O(\delta)\) respectively, depending on two common conditions of the nonlinear operator \(F\).
- For the case of \(\alpha=\beta\geq0\), due to the lack of coercivity and Radon - Riesz property, the well - posedness result is weaker.
2. **Sparsity**: Under certain nonlinear conditions, the author proves that each minimizing point is sparse.
3. **Convergence rate**: By assuming the nonlinear conditions of \(F\), the author derives the convergence rates \(O(\delta^{1 / 2})\) and \(O(\delta)\) of the regularized solution in the \(\ell^2\) norm.
4. **Numerical algorithm**: The author proposes an iterative soft - thresholding algorithm based on the generalized conditional gradient method (GCGM) to solve the regularization problem. For the case of \(q = 2\), the author rewrites the objective function into two parts and proves that if the nonlinear operator \(F\) is continuously Fréchet differentiable and bounded on bounded sets, then the algorithm is convergent.
### Mathematical formulas:
- The regularization term is defined as:
\[
R_{\alpha,\beta}(x):=\alpha\|x\|_{\ell^1}-\beta\|x\|_{\ell^2},\quad\alpha\geq\beta\geq0.
\]
- The objective function is:
\[
J_{\delta}^{\alpha,\beta}(x)=\frac{1}{q}\|F(x)-y^{\delta}\|_Y^q+R_{\alpha,\beta}(x).
\]
- The convergence rate formula is:
\[
\begin{aligned}
&\text{When }q = 1\text{ and }c_2\alpha-c_3\beta < 1\text{,}\\
&\|x_{\alpha,\beta}^{\delta}-x^{\dagger}\|_{\ell^2}^2\leq\frac{c_1[1+(c_2\alpha-c_3\beta)]\delta}{(\alpha-\beta)(1-\Gamma)},\\
&\|F(x_{\alpha,\beta}^{\delta})-y^{\delta}\|_Y\leq\frac{[1+(c_2\alpha-c_3\beta)]\delta}{