Abstract:We consider a multiple-block separable convex programming problem, where the objective function is the sum of m individual convex functions without overlapping variables, and the constraints are linear, aside from side constraints. Based on the combination of the classical Gauss–Seidel and the Jacobian decompositions of the augmented Lagrangian function, we propose a partially parallel splitting method, which differs from existing augmented Lagrangian based splitting methods in the sense that such an approach simplifies the iterative scheme significantly by removing the potentially expensive correction step. Furthermore, a relaxation step, whose computational cost is negligible, can be incorporated into the proposed method to improve its practical performance. Theoretically, we establish global convergence of the new method in the framework of proximal point algorithm and worst-case nonasymptotic \({\mathcal {O}}(1/t)\) convergence rate results in both ergodic and nonergodic senses, where t counts the iteration. The efficiency of the proposed method is further demonstrated through numerical results on robust PCA, i.e., factorizing from incomplete information of an unknown matrix into its low-rank and sparse components, with both synthetic and real data of extracting the background from a corrupted surveillance video.

Splitting Method for Support Vector Machine in Reproducing Kernel Banach Space with a Lower Semi-continuous Loss Function

Splitting Method for Support Vector Machine in Reproducing Kernel Banach Space with Lower Semi-continuous Loss Function

Splitting Method for Support Vector Machine with Lower Semi-continuous Loss

An Incremental Updating Method for Support Vector Machines

Incremental batch learning with support vector machines

Split Method of Multipliers and Its Application to Parallel and Distributed Logistic Regression

A Novel Loss Function-based Support Vector Machine for Binary Classification

Online Kernel Learning with a Near Optimal Sparsity Bound

Localisation of Regularised and Multiview Support Vector Machine Learning

Non-smooth optimization algorithm to solve the LINEX soft support vector machine

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

An Alternating Proximal Splitting Method With Global Convergence For Nonconvex Structured Sparsity Optimization

Stochastic forward-backward-half forward splitting algorithm with variance reduction

Multiscale Support Vector Regression Method in Sobolev Spaces on Bounded Domains

A Partially Parallel Splitting Method for Multiple-Block Separable Convex Programming with Applications to Robust Pca

Nonlinear kernel-free quadratic hyper-surface support vector machine with 0-1 loss function

Sparse Least Absolute Deviation Support Vector Machine

The splitting algorithms by Ryu, by Malitsky-Tam, and by Campoy applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

A Relaxed Tseng's Method-based Algorithm for Solving Split Variational Inequalities with Multiple Output Sets

Proximal method of solving split system of minimization problem

Multikernel semiparametric linear programming support vector regression