Abstract:In recent years, due to the emergence of Big Data (terabytes or petabytes) and Big Model (tens of billions of parameters), there has been an ever-increasing need of parallelizing machine learning (ML) algorithms in both academia and industry. Although there are some existing distributed computing systems, such as Hadoop and Spark, for parallelizing ML algorithms, they only provide synchronous and coarse-grained operators (e.g., Map, Reduce, and Join, etc.), which may hinder developers from implementing more efficient algorithms. This motivated us to design a universal distributed platform termed KunPeng , that combines both distributed systems and parallel optimization algorithms to deal with the complexities that arise from large-scale ML. Specifically, KunPeng not only encapsulates the characteristics of data/model parallelism, load balancing, model sync-up, sparse representation, industrial fault-tolerance, etc., but also provides easy-to-use interface to empower users to focus on the core ML logics. Empirical results on terabytes of real datasets with billions of samples and features demonstrate that, such a design brings compelling performance improvements on ML programs ranging from Follow-the-Regularized-Leader Proximal algorithm to Sparse Logistic Regression and Multiple Additive Regression Trees. Furthermore, KunPeng's encouraging performance is also shown for several real-world applications including the Alibaba's Double 11 Online Shopping Festival and Ant Financial's transaction risk estimation.

Research on Parallel Data Currency Rule Algorithms.

Research on Data Currency Rule and Quality Evaluation

Efficient Currency Determination Algorithms for Dynamic Data

Leveraging Currency for Repairing Inconsistent and Incomplete Data (extended Abstract).

Determining the currency of dynamic data

Improve3C: Data Cleaning on Consistency and Completeness with Currency.

An Algorithm for Data Stream Speed Anomaly Detection Based on RCSW

KunPeng: Parameter Server Based Distributed Learning Systems and Its Applications in Alibaba and Ant Financial

Investigation of Parallel Data Mining

An Approach to Discovering Multi-Temporal Patterns and Its Application to Financial Databases

The State-of-the-Art Technology of Currency Identification: A Comparative Study.

Parallel Statistical Computing with R

The State-of-the-Art Technology of Currency Identification

Mining CFD Rules on Big Data

Parallel Data Mining Optimal Algorithm of Virtual Cluster

Parallel Algorithm for Raster-based Multiple Sources Cost Distance Analysis

Hadoop-Based Inconsistence Detection and Reparation Algorithm for Big Data

Mining Privacy-Preserving Association Rules based on Parallel Processing in Cloud Computing

Parallel mining and application of fuzzy association rules

Research on big data mining based on improved parallel collaborative filtering algorithm

Optimization algorithm of association rule mining for heavy-haul railway freight train fault data based on distributed parallel computing