Abstract:K-means is one of the most widely used clustering algorithms in various disciplines, especially for large datasets. However the method is known to be highly sensitive to initial seed selection of cluster centers. K-means++ has been proposed to overcome this problem and has been shown to have better accuracy and computational efficiency than k-means. In many clustering problems though -such as when classifying georeferenced data for mapping applications- standardization of clustering methodology, specifically, the ability to arrive at the same cluster assignment for every run of the method i.e. replicability of the methodology, may be of greater significance than any perceived measure of accuracy, especially when the solution is known to be non-unique, as in the case of k-means clustering. Here we propose a simple initial seed selection algorithm for k-means clustering along one attribute that draws initial cluster boundaries along the 'deepest valleys' or greatest gaps in dataset. Thus, it incorporates a measure to maximize distance between consecutive cluster centers which augments the conventional k-means optimization for minimum distance between cluster center and cluster members. Unlike existing initialization methods, no additional parameters or degrees of freedom are introduced to the clustering algorithm. This improves the replicability of cluster assignments by as much as 100% over k-means and k-means++, virtually reducing the variance over different runs to zero, without introducing any additional parameters to the clustering process. Further, the proposed method is more computationally efficient than k-means++ and in some cases, more accurate.

Statistical Initialization of Intrinsic K-means Clustering on Homogeneous Manifolds.

Intrinsic K-means clustering over homogeneous manifolds

Stable Initialization Scheme for K-means Clustering

Subspace Clustering by Directly Solving Discriminative K-means

Principal component analysis and clustering on manifolds

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

An Efficient K-Means Clustering Initialization Using Optimization Algorithm

An Initial Seed Selection Algorithm for K-means Clustering of Georeferenced Data to Improve Replicability of Cluster Assignments for Mapping Application

A Riemannian Optimization Approach to Clustering Problems

The Laplacian K-modes algorithm for clustering

When Do Birds of a Feather Flock Together? K-Means, Proximity, and Conic Programming.

Grassmann Clustering.

$k$-Median Clustering via Metric Embedding: Towards Better Initialization with Differential Privacy

Adaptive Neighboring Selection Algorithm Based on Curvature Prediction in Manifold Learning

Clustering analysis using manifold kernel concept factorization.

Co-Clustering On Manifolds

A Robust Density-Based Clustering Algorithm for Multi-Manifold Structure.

CKmeans and FCKmeans : Two deterministic initialization procedures for Kmeans algorithm using a modified crowding distance

Riemannian manifold learning.

K-Means Clustering With Incomplete Data

IFKMHC: Implicit Fuzzy K-Means Model for High-Dimensional Data Clustering