Abstract:Subspace learning is an effective and widely used image feature extraction and classification technique. However, for the large-scale image recognition issue in real-world applications, many subspace learning methods often suffer from large computational burden. In order to reduce the computational time and improve the recognition performance of subspace learning technique under this situation, we introduce the idea of parallel computing which can reduce the time complexity by splitting the original task into several subtasks. We develop a parallel subspace learning framework. In this framework, we first divide the sample set into several subsets by designing two random data division strategies that are equal data division and unequal data division. These two strategies correspond to equal and unequal computational abilities of nodes under parallel computing environment. Next, we calculate projection vectors from each subset in parallel. The graph embedding technique is employed to provide a general formulation for parallel feature extraction. After combining the extracted features from all nodes, we present a unified criterion to select most distinctive features for classification. Under the developed framework, we separately propose supervised and unsupervised parallel subspace learning approaches, which are called parallel linear discriminant analysis (PLDA) and parallel locality preserving projection (PLPP). PLDA selects features with the largest Fisher scores by estimating the weighted and unweighted sample scatter, while PLPP selects features with the smallest Laplacian scores by constructing a whole affinity matrix. Theoretically, we analyze the time complexities of proposed approaches and provide the fundamental supports for applying random division strategies. In the experiments, we establish two real parallel computing environments and employ four public image and video databases as the test data. Experimental results demonstrate that the proposed approaches outperform several related supervised and unsupervised subspace learning methods, and significantly reduce the computational time.

Parallel Sparse Subspace Clustering Via Joint Sample and Parameter Blockwise Partition.

Decentralized Robust Subspace Clustering

SSCNet: learning-based subspace clustering

Sparse Convolution Subspace Clustering

Sparse subspace clustering based on L0 constraint

A Subspace Clustering Algorithm Based on Simultaneously Sparse and Low-Rank Representation

Efficient Sparse Subspace Clustering by Nearest Neighbour Filtering

A Nonconvex Implementation of Sparse Subspace Clustering: Algorithm and Convergence Analysis

Active Orthogonal Matching Pursuit for Sparse Subspace Clustering

Joint Sparse Subspace Clustering Via Fast ℓ2,0-Norm Constrained Optimization

Ordered Subspace Clustering with Block-Diagonal Priors.

Subspace Clustering Via Integrating Sparse Representation and Adaptive Graph Learning.

Structured block diagonal representation for subspace clustering

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

Nonconvex Sparse Spectral Clustering by Alternating Direction Method of Multipliers and Its Convergence Analysis

Distributed Sparse Subspace Clustering by K-Means Subspace Fusion

Sparse Subspace Clustering with Jointly Learning Representation and Affinity Matrix.

Downsampling for Sparse Subspace Clustering.

Supervised and Unsupervised Parallel Subspace Learning for Large-Scale Image Recognition.

Efficient L Q Norm Based Sparse Subspace Clustering Via Smooth IRLS and ADMM.

Large-Scale Subspace Clustering by Independent Distributed and Parallel Coding