Abstract:Abstract Nowadays, with the rapid growth of data volume, massive data has become one of the factors that plague the development of enterprises. How to effectively process data and reduce the concurrency pressure of data access has become the driving force for the continuous development of big data solutions. This article mainly studies the MapReduce parallel computing framework based on multiple data fusion sensors and GPU clusters. This experimental environment uses a Hadoop fully distributed cluster environment, and the entire programming of the single-source shortest path algorithm based on MapReduce is implemented in Java language. 8 ordinary physical machines are used to build a fully distributed cluster, and the configuration environment of each node is basically the same. The MapReduce framework divides the request job into several mapping tasks and assigns them to different computing nodes. After the mapping process, a certain intermediate file that is consistent with the final file format is generated. At this time, the system will generate several reduction tasks and distribute these files to different cluster nodes for execution. This experiment will verify the changes in the running time of the PSON algorithm when the size of the test data set gradually increases while keeping the hardware level and software configuration of the Hadoop platform unchanged. When the number of computing nodes increases from 2 to 4, the running time is significantly reduced. When the number of computing nodes continues to increase, the reduction in running time will become less and less significant. The results show that NESTOR can complete the basic workflow of MapReduce, and simplifies the process of user development of GPU positive tree order, which has a significant speedup for applications with large amounts of calculations.

MapReduce Implementation of Face Recognition Based on HOG Feature and NSMD

Towards Mask-robust Face Recognition.

Multi-objects Real Time Recognition Based on Color Information

Exploration on Facial Image Recognition and Processing Algorithms under Hadoop

Intelligent Education Managemnt System Design for Universities based on MTCNN Face Recognition Algorithm

Hadoop Small Image Processing Technology Based on Big Data Processing and Its Application Effect in Face Feature Extraction and Face Recognition System Design

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Integrated System for Face Detection, Clustering and Recognition

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Implementation of MapReduce parallel computing framework based on multi-data fusion sensors and GPU cluster

Implementation of Robust Face Recognition System Using Live Video Feed Based on CNN

Parallel Implementation Of Classification Algorithms Based On Mapreduce

Research on Parallelization of Face Recognition

A Hierarchical Face Recognition Algorithm Based on Humanoid Nonlinear Least-Squares Computation

Research on Face Recognition Algorithm Based on Multi-Class Support Vector Machine

Face Recognition Based on Convolutional Neural Network and Support Vector Machine.

A new hybrid classifier model and its application on face recognition

A Mapreduce Scheme For Image Feature Extraction And Its Application To Man-Made Object Detection

Remote Sensing Image Segmentation Based On Hadoop Cloud Platform

Face Recognition System Using SVM Classifier and Feature Extraction by PCA and LDA Combination

A high performance face recognition system based on a huge face database