Abstract:Abstract Nowadays, with the rapid growth of data volume, massive data has become one of the factors that plague the development of enterprises. How to effectively process data and reduce the concurrency pressure of data access has become the driving force for the continuous development of big data solutions. This article mainly studies the MapReduce parallel computing framework based on multiple data fusion sensors and GPU clusters. This experimental environment uses a Hadoop fully distributed cluster environment, and the entire programming of the single-source shortest path algorithm based on MapReduce is implemented in Java language. 8 ordinary physical machines are used to build a fully distributed cluster, and the configuration environment of each node is basically the same. The MapReduce framework divides the request job into several mapping tasks and assigns them to different computing nodes. After the mapping process, a certain intermediate file that is consistent with the final file format is generated. At this time, the system will generate several reduction tasks and distribute these files to different cluster nodes for execution. This experiment will verify the changes in the running time of the PSON algorithm when the size of the test data set gradually increases while keeping the hardware level and software configuration of the Hadoop platform unchanged. When the number of computing nodes increases from 2 to 4, the running time is significantly reduced. When the number of computing nodes continues to increase, the reduction in running time will become less and less significant. The results show that NESTOR can complete the basic workflow of MapReduce, and simplifies the process of user development of GPU positive tree order, which has a significant speedup for applications with large amounts of calculations.

Parallel Implementation of Multilayered Neural Networks Based on Map-Reduce on Cloud Computing Clusters.

Parallel implementation of multilayered neural networks based on Map-Reduce on cloud computing clusters

Fuzzy Method and Neural Network Model Parallel Implementation of Multi-Layer Neural Network Based on Cloud Computing for Real Time Data Transmission in Large Offshore Platform

The Parallelization of Back Propagation Neural Network in MapReduce and Spark

Parallelizing Backpropagation Neural Network Using MapReduce and Cascading Model.

Big Data: A Parallel Particle Swarm Optimization-Back-Propagation Neural Network Algorithm Based on MapReduce

Training Backpropagation Neural Network in MapReduce

Research on parallel strategy of convolution neural network in distributed environment

MapReduce Based Parallel Neural Networks in Enabling Large Scale Machine Learning

Accelerating Training For Distributed Deep Neural Networks In Mapreduce

Parallel Implementation Of Classification Algorithms Based On Mapreduce

Parallel Graph Pattern Matching in Massive Networks Based on MapReduce

The Improved BP Algorithm Based on MapReduce and Genetic Algorithm

FP-MRBP: Fine-grained Parallel MapReduce Back Propagation Algorithm.

Parallel implementation of K-Means clustering algorithm based on mapReduce computing model of hadoop

A parallel computing platform for training large scale neural networks

Parallel Based on Cloud Computing to Achieve Large Data Sets Clustering

Implementation of MapReduce parallel computing framework based on multi-data fusion sensors and GPU cluster

Hybrid Parrallel Bayesian Network Structure Learning from Massive Data Using MapReduce

Cloud computing model for big data processing and performance optimization of multimedia communication

RESEARCH ON CASCADE-GROUPING PARALLEL SVM ALGORITHM BASED ON MAPREDUCE