Abstract:In the world of big data, extracting meaningful insights from large and continually growing distributed datasets is a major challenge. Classical clustering algorithms are effective at identifying clusters with convex structures. However, they fall short in identifying arbitrary-shaped clusters (more irregular and complex patterns), which are often encountered in real-world applications. The process of identifying non-convex cluster representations from very large and growing datasets is a challenge. It is further compounded by the distributed nature of the data, necessitating complex computations across multiple devices. Support Vector Clustering (SVC) is a much-celebrated algorithm capable of finding arbitrarily shaped clusters. However, the major limitation of this algorithm is that it will not scale to large volumes of data as the time and space complexity is high. The second limitation of the SVC algorithm is the requirement for large computation time in finding cluster structures. The adoption of a coreset based methodology is required for finding the true representation of the underlying large datasets. The implementation of hierarchical clustering on these distributed coresets, unlocks the potential to uncover a structured hierarchy of abstractions across the disseminated data. Moreover, a distance-based clustering approach guarantees the identification of clusters with diverse and arbitrary shapes, providing a robust framework for detecting complex structures. This research utilizes the Core Vector Machine (CVM) approach using an approximate Minimum Enclosing Ball (MEB) algorithm to efficiently address the complexities inherent in traditional SVC. Additionally, an enhanced medoid algorithm is employed for cluster head identification across the data sources. Hierarchical clustering is performed in the Reproducing Kernel Hilbert Space (RKHS) using cosine similarity distance matrices. This is used to identify compact non-convex clusters within distributed datasets. Performance assessment involves benchmarking our approach against state-of-the-art improved SVC algorithms using large datasets. The outcomes validate the superior performance of our approach compared to existing methods.

Highly accurate and efficient cluster validation index engine using global separation and local dispersion architecture for adaptive image clustering systems

CVAP: Validation for Cluster Analyses

An Improved Supervoxel Clustering Algorithm of 3D Point Clouds for the Localization of Industrial Robots

On the Index of Cluster Validity

Quantifying the CVD-grown Two-Dimensional Materials Via Image Clustering.

G2-SCANN: Gaussian-kernel Graph-Based SLD Clustering Algorithm with Natural Neighbourhood

Highly-Economized Multi-view Binary Compression for Scalable Image Clustering

Image Clustering Using Local Discriminant Models and Global Integration

Fast Level-Set-Based Inverse Lithography Algorithm for Process Robustness Improvement and Its Application

Improved Cluster Center Adaption for Image Classification

Efficient synthetical clustering validity indexes for hierarchical clustering

Clustering Deviation Index (CDI): a robust and accurate internal measure for evaluating scRNA-seq data clustering

Local structure divergence index for image quality assessment

Superpixel-Level Global and Local Similarity Graph-Based Clustering for Large Hyperspectral Images

Scalable decision fusion algorithm for enabling decentralized computation in distributed, big data clustering problems

Adaptive Gaussian Regularization Constrained Sparse Subspace Clustering for Image Segmentation.

Dual Smooth Graph Convolutional Clustering for Large-Scale Hyperspectral Images

Linear Spectral Clustering Superpixel.

Sparse Multi-view Image Clustering with Complete Similarity Information

Performance Evaluation of Cluster Validity Indices (CVIs) on Multi/Hyperspectral Remote Sensing Datasets

iLIAC: An approach of identifying dissimilar groups on unstructured numerical image dataset using improved agglomerative clustering technique