Abstract:Journal of Information &Knowledge Management, Ahead of Print. Big data is generally derived with a large volume and combined categories of attributes like categorical and numerical. Among them, [math]-prototypes have been adopted into MapReduce structure, and thus, it provides a better solution for the huge range of data. However, [math]-prototypes need to compute all distances among every data point and cluster centres. Moreover, the computations of distances are redundant as data points are often present in similar clusters after fewer iterations. Nowadays, to cluster huge-scale datasets, one of the efficient solutions is [math]-means. However, [math]-means is not intrinsically appropriate to execute in MapReduce due to the iterative nature of this technique. Moreover, for every iteration, [math]-means should perform an independent MapReduce job but, it leads to higher Input/Output (I/O) overhead at every iteration. This research paper presents a novel enhanced linear time clustering for handling big data called Heuristic mrk-means (H-mrk-means) using optimized [math]-means on the MapReduce model. In order to manage big data that is time series in nature, the sampling and MapReduce framework are adopted, which utilize different machines for processing data. Before initiating the main clustering process, a sampling process is adopted to get the noteworthy information. The two main phases of the developed method are the map phase (divide and conquer) and the reduce phase (final clustering). In the map phase, the data are divided into diverse chunks that should be stored in assigned machines. In the reduce phase, data clustering is performed. Here, the cluster centroid of data is tuned with the help of hybrid Tunicate-Deer Hunting Optimization (T-DHO) algorithm by attaining a newly derived objective function. This type of optimal tuning of solution enhances the efficiency of clustering when compared over normal iterative [math]-means and mrk-means clustering. The experimental evaluation on varied counts of chunks using the proposed H-mrk-means has attained higher quality of clustering results and faster execution times evaluated with other clustering approaches.

An Enhanced Agglomerative Fuzzy K-Means Clustering Method with Mapreduce Implementation on Hadoop Platform

Distributed Affinity Propagation Clustering Based on MapReduce

An Efficient K-Means Clustering Algorithm On Mapreduce

An Improved K-means Algorithm Based on Mapreduce and Grid

An efficient PAM spatial clustering algorithm based on MapReduce

Large-scale Data Mining Method based on Clustering Algorithm Combined with MAPREDUCE

5New density clustering algorithm based on MapReduce

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

Research and implementation of user clustering based on MapReduce in multimedia big data

Fast Clustering using MapReduce

H-mrk-means: Enhanced Heuristic mrk-means for Linear Time Clustering of Big Data Using Hybrid Meta-heuristic Algorithm

An optimized SVM-RFE based feature selection and weighted entropy K-means approach for big data clustering in mapreduce

A MapReduce Cluster Deployment Optimization Framework with Geo-distributed Data.

Parallel Subspace Clustering Using MapReduce

MAP-JOIN-REDUCE: Toward Scalable and Efficient Data Analysis on Large Clusters

Big data clustering using fractional sail fish-sparse fuzzy C-means and particle whale optimization based MapReduce framework

A new fuzzy clustering-based recommendation method using grasshopper optimization algorithm and Map-Reduce

Fuzzy K-Means Clustering With Discriminative Embedding

The performance of MapReduce: an in-depth study

Adaptive Approach to Fuzzy Clustering

A multi-threaded particle swarm optimization-kmeans algorithm based on MapReduce