Abstract:SCoTLASS is the first sparse principal component analysis (SPCA) model which imposes extra l1 norm constraints on the measured variables to obtain sparse loadings. Due to the the difficulty of finding projections on the intersection of an l1 ball/sphere and an l2 ball/sphere, early approaches to solving the SCoTLASS problems were focused on penalty function methods or conditional gradient methods. In this paper, we re-examine the SCoTLASS problems, denoted by SPCA-P1, SPCA-P2 or SPCA-P3 when using the intersection of an l1 ball and an l2 ball, an l1 sphere and an l2 sphere, or an l1 ball and an l2 sphere as constrained set, respectively. We prove the equivalence of the solutions to SPCA-P1 and SPCA-P3, and the solutions to SPCA-P2 and SPCA-P3 are the same in most case. Then by employing the projection method onto the intersection of an l1 ball/sphere and an l2 ball/sphere, we design a gradient projection method (GPSPCA for short) and an approximate Newton algorithm (ANSPCA for short) for SPCA-P1, SPCA-P2 and SPCA-P3 problems, and prove the global convergence of the proposed GPSPCA and ANSPCA algorithms. Finally, we conduct several numerical experiments in MATLAB environment to evaluate the performance of our proposed GPSPCA and ANSPCA algorithms. Simulation results confirm the assertions that the solutions to SPCA-P1 and SPCA-P3 are the same, and the solutions to SPCA-P2 and SPCA-P3 are the same in most case, and show that ANSPCA is faster than GPSPCA for large-scale data. Furthermore, GPSPCA and ANSPCA perform well as a whole comparing with the typical SPCA methods: the l0-constrained GPBB algorithm, the l1-constrained BCD-SPCAl1 algorithm, the l1-penalized ConGradU and Gpowerl1 algorithms, and can be used for large-scale computation.

Affine projection algorithms based on sigmoid cost function

Evolving Order Based Affine Projection Sign Algorithm For Enhanced Adaptive Filtering

Robust hybrid affine projection filtering algorithm under α -stable environment

A Data Selective Segment Proportionate Affine Projection Algorithm for Echo Cancellation

Affine Projection Algorithm by Employing Maximum Correntropy Criterion for System Identification of Mixed Noise

Affine projection mixed-norm algorithms for robust filtering

Sparse constraint affine projection algorithm with parallel implementation and application in compressive sensing

O(log T) Projections for Stochastic Optimization of Smooth and Strongly Convex Functions

A variable diagonal-matrix-step-size APA robust to impulsive noises

Affine Projection Algorithm Based on Least Mean Fourth Algorithm for System Identification

Making SGD Efficient by Reducing Projections: Guaranteed Optimal Rate for Strongly Convex Optimization

Asymptotic Behaviors and Phase Transitions in Projected Stochastic Approximation: A Jump Diffusion Approach

Optimal Stochastic Strongly Convex Optimization with a Logarithmic Number of Projections

Successive Projection for Solving Systems of Nonlinear Equations/Inequalities

A re-examination to the SCoTLASS problems for SPCA and two projection-based methods for them

Delayed Projection Techniques for Linearly Constrained Problems: Convergence Rates, Acceleration, and Applications

An improved relaxed inertial projection algorithm for solving the minimum-norm solution of variational inequality and fixed point problems

Affine projection algorithm-based exponential hyperbolic cosine for partial discharge denoising in substation

A method to adjust regularization parameter of fast affine projection algorithm

An Improved Affine Projection Algorithm and Its Application in Network Echo Cancellation

Accelerated Proximal Gradient Methods for Nonconvex Programming