Abstract:We consider a multiple-block separable convex programming problem, where the objective function is the sum of m individual convex functions without overlapping variables, and the constraints are linear, aside from side constraints. Based on the combination of the classical Gauss–Seidel and the Jacobian decompositions of the augmented Lagrangian function, we propose a partially parallel splitting method, which differs from existing augmented Lagrangian based splitting methods in the sense that such an approach simplifies the iterative scheme significantly by removing the potentially expensive correction step. Furthermore, a relaxation step, whose computational cost is negligible, can be incorporated into the proposed method to improve its practical performance. Theoretically, we establish global convergence of the new method in the framework of proximal point algorithm and worst-case nonasymptotic \({\mathcal {O}}(1/t)\) convergence rate results in both ergodic and nonergodic senses, where t counts the iteration. The efficiency of the proposed method is further demonstrated through numerical results on robust PCA, i.e., factorizing from incomplete information of an unknown matrix into its low-rank and sparse components, with both synthetic and real data of extracting the background from a corrupted surveillance video.

Splitting Method for Support Vector Machine in Reproducing Kernel Banach Space with Lower Semi-continuous Loss Function

Splitting Method for Support Vector Machine in Reproducing Kernel Banach Space with a Lower Semi-continuous Loss Function

Splitting Method for Support Vector Machine with Lower Semi-continuous Loss

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

An Incremental Updating Method for Support Vector Machines

Split Method of Multipliers and Its Application to Parallel and Distributed Logistic Regression

Multilinear Model Decomposition of MIMO Nonlinear Systems and Its Implication for Multilinear Model-Based Control

A Novel Loss Function-based Support Vector Machine for Binary Classification

Localisation of Regularised and Multiview Support Vector Machine Learning

Multiscale Support Vector Regression Method in Sobolev Spaces on Bounded Domains

Stochastic forward-backward-half forward splitting algorithm with variance reduction

Proximal method of solving split system of minimization problem

Non-smooth optimization algorithm to solve the LINEX soft support vector machine

On the convergence of splittings for semidefinite linear systems

An Alternating Proximal Splitting Method With Global Convergence For Nonconvex Structured Sparsity Optimization

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

A Relaxed Tseng's Method-based Algorithm for Solving Split Variational Inequalities with Multiple Output Sets

The splitting algorithms by Ryu, by Malitsky-Tam, and by Campoy applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

Nonlinear kernel-free quadratic hyper-surface support vector machine with 0-1 loss function

A Partially Parallel Splitting Method for Multiple-Block Separable Convex Programming with Applications to Robust Pca

On the Convergence of Subproper (Multi)-Splitting Methods for Solving Rectangular Linear Systems