Abstract:In recent years, a constant and fast information growing has characterized digital applications in the majority of real-life scenarios. Thus, a new information asset, namely Big Data, has been defined and lead to different challenges, mainly related to data storage, management and analysis. Focusing on the last challenge, several Big Data analytics techniques have been developed, based on Machine Learning and Deep Learning paradigms. When dealing with Big Data, traditional approaches often take a lot of time to produce even a single predictive model, due to the extremely high demand of computational resources. The design of approaches specifically oriented to Big Data is required to overcome these computational issues. Most solutions rely on the deployment of Big Data analytics infrastructures on a cluster of machines and/or on parallelization techniques. When deployment and parallelization apply to Machine Learning and Deep Learning, we can refer to the terms Distributed Machine Learning and Distributed Deep Learning, respectively. We here discuss the main principles and features of Distributed Machine Learning and Distributed Deep Learning frameworks. The main contribution of this work is a survey of solutions proposed in the literature, through the investigation of selected features and capabilities. In particular, the survey provides a comparative analysis according to the following classification criteria: implemented parallelization technique, supporting device, supported architecture, implemented communication mode, working mode, and class of algorithms. The paper also gives an overview of the most commonly used criteria and metrics for the performance evaluation of analyzed frameworks; finally, some emerging but promising optimization techniques are reviewed apart from our classification.

Evaluating New Approaches of Big Data Analytics Frameworks

Exploring Real-Time Data Processing Using Big Data Frameworks

Performance Analysis of Distributed Computing Frameworks for Big Data Analytics: Hadoop Vs Spark

Distributed Analytics For Big Data: A Survey

Framing Apache Spark in life sciences

Data Processing Framework Using Apache and Spark Technologies in Big Data

Evaluation and Analysis of Distributed Graph-Parallel Processing Frameworks

A Survey on Spark Ecosystem for Big Data Processing

Towards an Integrated Platform for Big Data Analysis

Big Data: Tutorial and Guidelines on Information and Process Fusion for Analytics Algorithms with MapReduce

Survey of Distributed Computing Frameworks for Supporting Big Data Analysis

A Survey on Geographically Distributed Big-Data Processing using MapReduce

An Efficient Industrial Big-Data Engine

Semantic-based Big Data integration framework using scalable distributed ontology matching strategy

Big data scalability based on Spark Machine Learning Libraries

Programming big data analysis: principles and solutions

Design and Construction of a Big Data Analytics Framework for Health Applications

Big Data analytics. Three use cases with R, Python and Spark

Survey of Apache spark optimized job scheduling in big data

Evaluation of big data frameworks for analysis of smart grids