Abstract:With the rapid development of electronic, engineering, information and network technologies, large-scale data mining and knowledge discovery have become a new challenge. In this paper, a hierarchical-coevolutionary-MapReduce-based knowledge reduction algorithm (HCMRKR) with robust ensemble Pareto dominance is proposed for big data analysis. Firstly, a novel hierarchical co-evolutionary MapReduce framework with niche neighborhood radius is designed to divide the entire population into N subpopulations. The layered niche neighborhood radius is constructed so that subpopulations can be self-adaptively decomposed into the attribute approximate space with uncovering the underlying interaction structure of decision attributes. The reduction performances of elitist leaders are surely guaranteed to be the same with those using the whole independent dataset. Secondly, a robust ensemble strategy of reduction Pareto equilibrium is adopted to help elitist leaders from the Pareto front region to conduct the ensemble game of reduction subsets in different niche conic subspaces. Thus, most reduction solutions will be enhanced to be more robust within the stable elitists region. Thirdly, various elitist leaders will use the parallel MapReduce mechanism to determine the best strategy to extract their knowledge reduction set, and the adaptive reduction evolution with incremental learning can be implemented well. Experimental results illustrate that the proposed HCMRKR algorithm can effectively and efficiently handle the knowledge reduction problem in the big data sets as well as keeping more robust and stable performances, compared with existing state-of-the-art algorithms. Furthermore, the validation performed on two kinds of neonatal brain MRIs further demonstrates the HCMRKR's promising advantage for the real-world applications.

MReC4.5: C4.5 Ensemble Classification with MapReduce

Distributed Affinity Propagation Clustering Based on MapReduce

ELM-MapReduce: MapReduce Accelerated Extreme Learning Machine for Big Spatial Data Analysis

MR-ELM: a MapReduce-based framework for large-scale ELM training in big data era

Parallel Semi-Supervised Multi-Ant Colonies Clustering Ensemble Based on MapReduce Methodology.

Multi-class Classification Algorithm Based on Ensemble Learning and Hierarchical Structure

Distributed Model Reuse with Multiple Classifiers

A parallel fuzzy rule-base based decision tree in the framework of map-reduce

Hierarchical Ensemble Support Cluster Machine

Ensemble Transfer Learning Algorithm

Large-scale Data Mining Method based on Clustering Algorithm Combined with MAPREDUCE

A 2-Tier Clustering Algorithm with Map-Reduce

Dynamic Classifier Ensemble Using Classification Confidence

An Improved Ensemble Learning for Imbalanced Data Classification

A Parallel Computing Model for Large-Graph Mining with MapReduce.

Corrective Classification: Learning From Data Imperfections With Aggressive And Diverse Classifier Ensembling

An Ensemble Detection Method of Pipeline Condition Based on Tabu Search

LibD3C: Ensemble Classifiers with a Clustering and Dynamic Selection Strategy

A Hierarchical-Coevolutionary-mapreduce-based Knowledge Reduction Algorithm with Robust Ensemble Pareto Equilibrium.

Tri-Training And Mapreduce-Based Massive Data Learning

ReCoM: reinforcement clustering of multi-type interrelated data objects.