Abstract:Subspace learning is an effective and widely used image feature extraction and classification technique. However, for the large-scale image recognition issue in real-world applications, many subspace learning methods often suffer from large computational burden. In order to reduce the computational time and improve the recognition performance of subspace learning technique under this situation, we introduce the idea of parallel computing which can reduce the time complexity by splitting the original task into several subtasks. We develop a parallel subspace learning framework. In this framework, we first divide the sample set into several subsets by designing two random data division strategies that are equal data division and unequal data division. These two strategies correspond to equal and unequal computational abilities of nodes under parallel computing environment. Next, we calculate projection vectors from each subset in parallel. The graph embedding technique is employed to provide a general formulation for parallel feature extraction. After combining the extracted features from all nodes, we present a unified criterion to select most distinctive features for classification. Under the developed framework, we separately propose supervised and unsupervised parallel subspace learning approaches, which are called parallel linear discriminant analysis (PLDA) and parallel locality preserving projection (PLPP). PLDA selects features with the largest Fisher scores by estimating the weighted and unweighted sample scatter, while PLPP selects features with the smallest Laplacian scores by constructing a whole affinity matrix. Theoretically, we analyze the time complexities of proposed approaches and provide the fundamental supports for applying random division strategies. In the experiments, we establish two real parallel computing environments and employ four public image and video databases as the test data. Experimental results demonstrate that the proposed approaches outperform several related supervised and unsupervised subspace learning methods, and significantly reduce the computational time.

A Local Online Learning Approach for Non-linear Data.

One-pass online learning: A local approach

Adaptive Local Kernel-Based Learning for Soft Sensor Modeling of Nonlinear Processes

Online Kernel Learning with a Near Optimal Sparsity Bound

Large Scale Online Kernel Classification

Local least squares support vector regression with application to online modeling for batch processes

Online Learning under A Separable Stochastic Approximation Framework

Online Semi-Supervised Learning with Multiple Regularization Terms.

Exact Soft Confidence-Weighted Learning

A Framework of Sparse Online Learning and Its Applications

Conscience online learning: an efficient approach for robust kernel-based clustering

Iteratively Divide-and-Conquer Learning for Nonlinear Classification and Ranking

Online Meta-Learning on Non-convex Setting

Overlapping Subspace Clustering Based on Local Weighted Least Squares Regression

A Conscience On-line Learning Approach for Kernel-Based Clustering

When Online Learning Meets ODE: Learning Without Forgetting on Variable Feature Space.

Online Local Fisher Risk Minimization: a New Online Kernel Method for Online Classification

Learning a Coupled Linearized Method in Online Setting.

Online Management for Edge-Cloud Collaborative Continuous Learning: A Two-timescale Approach

Nonlinear Online Learning with Adaptive Nyström Approximation

Supervised and Unsupervised Parallel Subspace Learning for Large-Scale Image Recognition.