Abstract:Many graph-based semi-supervised learning methods for large datasets have been proposed to cope with the rapidly increasing size of data, such as Anchor Graph Regularization (AGR). This model builds a regularization framework by exploring the underlying structure of the whole dataset with both datapoints and anchors. Nevertheless, AGR still has limitations in its two components: (1) in anchor graph construction, the estimation of the local weights between each datapoint and its neighboring anchors could be biased and relatively slow; and (2) in anchor graph regularization, the adjacency matrix that estimates the relationship between datapoints, is not sufficiently effective. In this paper, we develop an Efficient Anchor Graph Regularization (EAGR) by tackling these issues. First, we propose a fast local anchor embedding method, which reformulates the optimization of local weights and obtains an analytical solution. We show that this method better reconstructs datapoints with anchors and speeds up the optimizing process. Second, we propose a new adjacency matrix among anchors by considering the commonly linked datapoints, which leads to a more effective normalized graph Laplacian over anchors. We show that, with the novel local weight estimation and normalized graph Laplacian, EAGR is able to achieve better classification accuracy with much less computational costs. Experimental results on several publicly available datasets demonstrate the effectiveness of our approach.

Semi-Supervised Additive Logistic Regression: A Gradient Descent Solution

Semi-supervised Image Classification Via Nonnegative Least-Squares Regression

Multinomial Logistic Regression Algorithms via Quadratic Gradient

Semi-supervised inference for nonparametric logistic regression

Nonconvex Sparse Logistic Regression Via Proximal Gradient Descent.

Semi-supervised regression with label-guided adaptive graph optimization

Sublinear Dual Coordinate Ascent for Regularized Loss Minimization.

Gradient Descent on Logistic Regression with Non-Separable Data and Large Step Sizes

Smoothness Maximization Via Gradient Descents

Distributed Coordinate Descent for L1-regularized Logistic Regression

Gradient-based Regularization Parameter Selection for Problems with Non-smooth Penalty Functions

Semi-Smooth Newton Algorithm for Non-Convex Penalized Linear Regression

Semi-supervised logistic discrimination via labeled data and unlabeled data from different sampling distributions

An Adaptive Gradient Regularization Method

Large Stepsize Gradient Descent for Logistic Loss: Non-Monotonicity of the Loss Improves Optimization Efficiency

Semismooth Newton Coordinate Descent Algorithm for Elastic-Net Penalized Huber Loss Regression and Quantile Regression

Combining Smooth Graphs With Semi-Supervised Learning

Dual Newton Proximal Point Algorithm for Solution Paths of the L1-Regularized Logistic Regression

Adaptive Gradient Regularization: A Faster and Generalizable Optimization Technique for Deep Neural Networks

Beyond Log-Concavity: Theory and Algorithm for Sum-Log-Concave Optimization

Scalable Semi-Supervised Learning by Efficient Anchor Graph Regularization