Abstract:In recent years, a constant and fast information growing has characterized digital applications in the majority of real-life scenarios. Thus, a new information asset, namely Big Data, has been defined and lead to different challenges, mainly related to data storage, management and analysis. Focusing on the last challenge, several Big Data analytics techniques have been developed, based on Machine Learning and Deep Learning paradigms. When dealing with Big Data, traditional approaches often take a lot of time to produce even a single predictive model, due to the extremely high demand of computational resources. The design of approaches specifically oriented to Big Data is required to overcome these computational issues. Most solutions rely on the deployment of Big Data analytics infrastructures on a cluster of machines and/or on parallelization techniques. When deployment and parallelization apply to Machine Learning and Deep Learning, we can refer to the terms Distributed Machine Learning and Distributed Deep Learning, respectively. We here discuss the main principles and features of Distributed Machine Learning and Distributed Deep Learning frameworks. The main contribution of this work is a survey of solutions proposed in the literature, through the investigation of selected features and capabilities. In particular, the survey provides a comparative analysis according to the following classification criteria: implemented parallelization technique, supporting device, supported architecture, implemented communication mode, working mode, and class of algorithms. The paper also gives an overview of the most commonly used criteria and metrics for the performance evaluation of analyzed frameworks; finally, some emerging but promising optimization techniques are reviewed apart from our classification.

Fundamentals of Big Data-A Survey

A Survey of Big Data Research

Big Data Analytics in Medicine and Healthcare

Algorithm and approaches to handle large Data- A Survey

Big Data Analytics: A Survey

A Survey on Big Data Analytics Technologies.

A Survey on Big Data Analytics: Challenges, Open Research Issues and Tools

Data-intensive applications, challenges, techniques and technologies: A survey on Big Data

Exploring Big Data Analysis: Fundamental Scientific Problems

Survey of in-memory big data analytics and latest research opportunities

Big data: From beginning to future

Big Data Challenge: a Data Management Perspective.

Challenge and Security Issues Using Big Data: A Survey

A brief survey on big data: technologies, terminologies and data-intensive applications

A Survey of Recent Technologies and Challenges in Big Data Utilizations.

A Survey on Emerging Computing Paradigms for Big Data

The anatomy of big data computing

Big Data Analytics: A Review on Theoretical Contributions and Tools Used in Literature

Distributed Analytics For Big Data: A Survey

A survey of big data management: Taxonomy and state-of-the-art

A Survey on Spark Ecosystem: Big Data Processing Infrastructure, Machine Learning, and Applications