Abstract:In the world of big data, extracting meaningful insights from large and continually growing distributed datasets is a major challenge. Classical clustering algorithms are effective at identifying clusters with convex structures. However, they fall short in identifying arbitrary-shaped clusters (more irregular and complex patterns), which are often encountered in real-world applications. The process of identifying non-convex cluster representations from very large and growing datasets is a challenge. It is further compounded by the distributed nature of the data, necessitating complex computations across multiple devices. Support Vector Clustering (SVC) is a much-celebrated algorithm capable of finding arbitrarily shaped clusters. However, the major limitation of this algorithm is that it will not scale to large volumes of data as the time and space complexity is high. The second limitation of the SVC algorithm is the requirement for large computation time in finding cluster structures. The adoption of a coreset based methodology is required for finding the true representation of the underlying large datasets. The implementation of hierarchical clustering on these distributed coresets, unlocks the potential to uncover a structured hierarchy of abstractions across the disseminated data. Moreover, a distance-based clustering approach guarantees the identification of clusters with diverse and arbitrary shapes, providing a robust framework for detecting complex structures. This research utilizes the Core Vector Machine (CVM) approach using an approximate Minimum Enclosing Ball (MEB) algorithm to efficiently address the complexities inherent in traditional SVC. Additionally, an enhanced medoid algorithm is employed for cluster head identification across the data sources. Hierarchical clustering is performed in the Reproducing Kernel Hilbert Space (RKHS) using cosine similarity distance matrices. This is used to identify compact non-convex clusters within distributed datasets. Performance assessment involves benchmarking our approach against state-of-the-art improved SVC algorithms using large datasets. The outcomes validate the superior performance of our approach compared to existing methods.

A New Automated Hierarchical Clustering Algorithm Based on Emergent Self Organizing Maps

A Method of Data Mining Based on SOM Clustering and Its Application

Hierarchical Spatial Clustering in Multi-Hop Wireless Sensor Networks

Hierarchical Clustering Matching for Features with Repetitive Patterns in Visual Odometry

Effective hierarchical clustering based on structural similarities in nearest neighbor graphs

HCDC: A novel hierarchical clustering algorithm based on density-distance cores for data sets with varying density

An Ensemble Hierarchical Clustering Algorithm Based on Merits at Cluster and Partition Levels

A Coding Hierarchy Computing Based Clustering Algorithm

A DATA ANALYZER IN NETWORK ANOMALY DETECTION SYSTEM BASED ON HIERARCHICAL SELF-ORGANIZING MAP

A Hybrid SOM and K-means Model for Time Series Energy Consumption Clustering

Self-organizing Map As a New Method for Clustering and Data Analysis

MHCF-CECSO: A Novel High-Performance Clustering Framework for Industrial IoT

A Multi-disciplinary Ensemble Algorithm for Clustering Heterogeneous Datasets

Scalable decision fusion algorithm for enabling decentralized computation in distributed, big data clustering problems

ECCA: Efficient Correntropy-Based Clustering Algorithm With Orthogonal Concept Factorization

Outlier detection based on improved SOM and its application in power system

Multi-Objective Automatic Clustering Algorithm Based on Evolutionary Multi-Tasking Optimization

An analysis method for residential electricity consumption behavior based on UMAP-CRITIC feature optimization and SSA-assisted clustering

A Hierarchical Clustering Algorithm Based on Fuzzy Graph Connectedness.

Self-Organizing map clustering analysis for molecular data

Energy Clustering for Unsupervised Person Re-identification