Abstract:Subspace learning is an effective and widely used image feature extraction and classification technique. However, for the large-scale image recognition issue in real-world applications, many subspace learning methods often suffer from large computational burden. In order to reduce the computational time and improve the recognition performance of subspace learning technique under this situation, we introduce the idea of parallel computing which can reduce the time complexity by splitting the original task into several subtasks. We develop a parallel subspace learning framework. In this framework, we first divide the sample set into several subsets by designing two random data division strategies that are equal data division and unequal data division. These two strategies correspond to equal and unequal computational abilities of nodes under parallel computing environment. Next, we calculate projection vectors from each subset in parallel. The graph embedding technique is employed to provide a general formulation for parallel feature extraction. After combining the extracted features from all nodes, we present a unified criterion to select most distinctive features for classification. Under the developed framework, we separately propose supervised and unsupervised parallel subspace learning approaches, which are called parallel linear discriminant analysis (PLDA) and parallel locality preserving projection (PLPP). PLDA selects features with the largest Fisher scores by estimating the weighted and unweighted sample scatter, while PLPP selects features with the smallest Laplacian scores by constructing a whole affinity matrix. Theoretically, we analyze the time complexities of proposed approaches and provide the fundamental supports for applying random division strategies. In the experiments, we establish two real parallel computing environments and employ four public image and video databases as the test data. Experimental results demonstrate that the proposed approaches outperform several related supervised and unsupervised subspace learning methods, and significantly reduce the computational time.

Parallel Large Average Submatrices Biclustering Based on MapReduce.

Distributed Affinity Propagation Clustering Based on MapReduce

Parallel spectral clustering algorithm

Parallel Subspace Clustering Using MapReduce

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

Parallel case-based reasoning based on projection pursuit and MapReduce

Hybrid Parrallel Bayesian Network Structure Learning from Massive Data Using MapReduce

Towards Scalable Subgraph Pattern Matching over Big Graphs on MapReduce.

RESEARCH ON CASCADE-GROUPING PARALLEL SVM ALGORITHM BASED ON MAPREDUCE

Parallel Matrix Multiplication Algorithm Based on Vector Linear Combination Using MapReduce.

Parallel implementation of K-Means clustering algorithm based on mapReduce computing model of hadoop

An Efficient Parallel Nonlinear Clustering Algorithm Using Mapreduce

Parallel Simrank Computing on Large Scale Dataset on Mapreduce

K-Means Parallel Algorithm of Big Data Clustering Based on Mapreduce PCAM Method

Supervised and Unsupervised Parallel Subspace Learning for Large-Scale Image Recognition.

Parallel Implementation Of Classification Algorithms Based On Mapreduce

Parallelization of BLAST with MapReduce for Long Sequence Alignment.

Detecting Associations in Large Dataset on MapReduce

Enumerating Maximal Bicliques from a Large Graph using MapReduce

Large-Scale Subspace Clustering by Independent Distributed and Parallel Coding