Abstract:In recent years, a constant and fast information growing has characterized digital applications in the majority of real-life scenarios. Thus, a new information asset, namely Big Data, has been defined and lead to different challenges, mainly related to data storage, management and analysis. Focusing on the last challenge, several Big Data analytics techniques have been developed, based on Machine Learning and Deep Learning paradigms. When dealing with Big Data, traditional approaches often take a lot of time to produce even a single predictive model, due to the extremely high demand of computational resources. The design of approaches specifically oriented to Big Data is required to overcome these computational issues. Most solutions rely on the deployment of Big Data analytics infrastructures on a cluster of machines and/or on parallelization techniques. When deployment and parallelization apply to Machine Learning and Deep Learning, we can refer to the terms Distributed Machine Learning and Distributed Deep Learning, respectively. We here discuss the main principles and features of Distributed Machine Learning and Distributed Deep Learning frameworks. The main contribution of this work is a survey of solutions proposed in the literature, through the investigation of selected features and capabilities. In particular, the survey provides a comparative analysis according to the following classification criteria: implemented parallelization technique, supporting device, supported architecture, implemented communication mode, working mode, and class of algorithms. The paper also gives an overview of the most commonly used criteria and metrics for the performance evaluation of analyzed frameworks; finally, some emerging but promising optimization techniques are reviewed apart from our classification.

Distributed data mining: a survey

Data mining in distributed environment: a survey

Distributed Computing Environment: Approaches and Applications

Distributed Data Mining Based on Multi-agent System

Research on Distributed Data Mining Technology Based on Grid.

Distributed data mining for e-business

A Problem Oriented Approach to Data Mining in Distributed Spatio-temporal Database

Survey on Distributed Data Mining in P2P Networks

Mining from Distributed and Abstracted Data.

State-of-the-art in Distributed Privacy Preserving Data Mining

A Survey of Distributed Graph Algorithms on Massive Graphs

Distributed Spatial Data Mining in Geospatial Knowledge Service Grid

Distributed Data Mining on Agent Grid: Issues, Platform and Development Toolkit.

A survey of parallel sequential pattern mining

Distributed Analytics For Big Data: A Survey

Investigation of Parallel Data Mining

Deploying Mobile Agents In Distributed Data Mining

A hierarchical distributed data mining architecture

Distributed Graph Algorithms: From Local Data to Global Solutions