Abstract:The trend of analyzing big data in artificial intelligence demands highly-scalable machine learning algorithms, among which clustering is a fundamental and arguably the most widely applied method. To extend the applications of regular vector-based clustering algorithms, the Discrete Distribution (D2) clustering algorithm has been developed, aiming at clustering data represented by bags of weighted vectors which are well adopted data signatures in many emerging information retrieval and multimedia learning applications. However, the high computational complexity of D2-clustering limits its impact in solving massive learning problems. Here we present the parallel D2-clustering (PD2-clustering) algorithm with substantially improved scalability. We developed a hierarchical multipass algorithm structure for parallel computing in order to achieve a balance between the individual-node computation and the integration process of the algorithm. Experiments and extensive comparisons between PD2-clustering and other clustering algorithms are conducted on synthetic datasets. The results show that the proposed parallel algorithm achieves significant speed-up with minor accuracy loss. We apply PD2-clustering to image concept learning. In addition, by extending D2-clustering to symbolic data, we apply PD2-clustering to protein sequence clustering. For both applications, we demonstrate the high competitiveness of our new algorithm in comparison with other state-of-the-art methods.

Implementing Dynamical Pattern Recognition Algorithm on Computer Cluster

Rapid Detection of Rotating Stall in Axial Flow Compressors on Computer Cluster

Implementing Dynamical Pattern Recognition Algorithm on GPU

Realization and Application of Parallel Computing in Identification of Dynamic Model

Application Of Clustering Technologies In Very Large Power Grid Dispatch And Control System

Application of Lab VIEW Multi-Core Technology in Dynamic Pattern Recognition Algorithm

Research on Hybrid Parallel Algorithm in Detection of Rotating Stall

CLUSTER-BASED OCEAN REMOTE SENSING IMAGE FUSION PARALLEL COMPUTING STRATEGY

LINUX CLUSTER BASED POWER SYSTEM PARALLEL SIMULATION SYSTEM

Utilization Of Cluster Of Pcs For The Study Of Dynamic Load Balancing

DESIGN AND IMPLEMENTATION OF POLYNOMIAL-PRECONDITIONED EBE-PCG PARALLEL ALGORITHM IN CLUSTER

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

A Double Evolution Genetic Clustering Algorithm for Detection of Early Fault in Reciprocating Compressor Valve

A Parallel Hierarchical Clustering Algorithm for PCs Cluster System.

DETERMINISTIC LEARNING AND RAPID DYNAMICAL PATTERN RECOGNITION

Dynamical pattern recognition for univariate time series and its application to an axial compressor

A Scalable Hybrid Algorithm for Solving Partial Differential Equations on a Cluster of CPU/GPU

Parallel Massive Clustering of Discrete Distributions

Cluster-PC Based Parallel Distributed Data Clustering and Its Applications

Time series clustering of dynamical systems via deterministic learning

Parallel computing in automation of decoupled fluid-thermostructural simulation approach