Abstract:Journal of Information &Knowledge Management, Ahead of Print. Big data is generally derived with a large volume and combined categories of attributes like categorical and numerical. Among them, [math]-prototypes have been adopted into MapReduce structure, and thus, it provides a better solution for the huge range of data. However, [math]-prototypes need to compute all distances among every data point and cluster centres. Moreover, the computations of distances are redundant as data points are often present in similar clusters after fewer iterations. Nowadays, to cluster huge-scale datasets, one of the efficient solutions is [math]-means. However, [math]-means is not intrinsically appropriate to execute in MapReduce due to the iterative nature of this technique. Moreover, for every iteration, [math]-means should perform an independent MapReduce job but, it leads to higher Input/Output (I/O) overhead at every iteration. This research paper presents a novel enhanced linear time clustering for handling big data called Heuristic mrk-means (H-mrk-means) using optimized [math]-means on the MapReduce model. In order to manage big data that is time series in nature, the sampling and MapReduce framework are adopted, which utilize different machines for processing data. Before initiating the main clustering process, a sampling process is adopted to get the noteworthy information. The two main phases of the developed method are the map phase (divide and conquer) and the reduce phase (final clustering). In the map phase, the data are divided into diverse chunks that should be stored in assigned machines. In the reduce phase, data clustering is performed. Here, the cluster centroid of data is tuned with the help of hybrid Tunicate-Deer Hunting Optimization (T-DHO) algorithm by attaining a newly derived objective function. This type of optimal tuning of solution enhances the efficiency of clustering when compared over normal iterative [math]-means and mrk-means clustering. The experimental evaluation on varied counts of chunks using the proposed H-mrk-means has attained higher quality of clustering results and faster execution times evaluated with other clustering approaches.

Agglomerative Mean-Shift Clustering via Query Set Compression

Agglomerative Mean-Shift Clustering

Sequential Combination Methods for Data Clustering Analysis

GPU-accelerated Faster Mean Shift with euclidean distance metrics

UEQMS: UMAP Embedded Quick Mean Shift Algorithm for High Dimensional Clustering

Scalable Hierarchical Agglomerative Clustering

A novel Move-Split-Merge based Fuzzy C-Means algorithm for clustering time series

DMS: Differentiable Mean Shift for Dataset Agnostic Task Specific Clustering Using Side Information

A3S: A General Active Clustering Method with Pairwise Constraints

Clustering Method Based on Structural Similarity and Compressive Transformation

Clustering Protein Sequences Given the Approximation Stability of the Min-Sum Objective Function

An Efficient Smoothing Proximal Gradient Algorithm for Convex Clustering

Multiple Kernel Clustering With Compressed Subspace Alignment

From Comparing Clusterings to Combining Clusterings

Optimizing MSE for Clustering with Balanced Size Constraints

Semantic smoothing of document models for agglomerative clustering

Combining multiple clusterings using fast simulated annealing

A column generation algorithm with dynamic constraint aggregation for minimum sum-of-squares clustering

Optimizing Data Migration Using Online Clustering.

Adaptive Over-Relaxed Fast Dynamic Mean Shift

H-mrk-means: Enhanced Heuristic mrk-means for Linear Time Clustering of Big Data Using Hybrid Meta-heuristic Algorithm