Abstract:Maximum entropy clustering algorithm (ME) has lately received great attention for its high performance in large-scale data clustering and simplicity in implementation. However, previous studies have demonstrated that different clusters obtained by traditional ME tend to converge to the same one during its process of iteration affected by regularization coefficient and these cluster centers are subject to bias due to its sensitivity to different distributions of objects. These drawbacks of traditional ME can result in its failure of revealing the natural groupings in most datasets, especially in non-Gaussian distributed datasets. In order to address those limitations, we present a novel density-sensitive fuzzy kernel maximum entropy clustering algorithm in this paper. In the proposed approach, to accommodate non-Gaussian distributed cases, the dataset to be clustered in the original space is firstly implicitly mapped into high-dimensional feature space through the kernel function. By introducing the kernel function-based similarity terms in the update formula of the cluster centers, the effect of the objects not belonging to the current cluster on the update of its corresponding center can be counteracted, and simultaneously the influence of regularization coefficient on the clustering result is restricted as well, which can effectively overcome the convergence of the different clusters encountered by traditional ME. In addition, in order to prevent cluster centers from biases caused by the different distribution of the objects in the feature space, the relative density-based weights are also incorporated into the cost function, which can help the proposed approach produce more reasonable and accurate clustering results. In the experiments, the influence of the different parameters on the clustering performance is discussed in detail and some suggestions are also provided. Theoretical analysis and experimental results on several synthetic datasets, UCI benchmark datasets and generated large MNIST handwritten digits datasets demonstrate that the proposed approach is superior to other existing clustering techniques with good robustness.

An unsupervised rough clustering method based on gaussian mixture model

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Unsupervised Classification Based on Penalized Maximum Likelihood of Gaussian Mixture Models

An Unsupervised Gaussian Mixture Classification Mechanism Based on Statistical Learning Analysis

Probabilistic Cluster Structure Ensemble

A New Feature Selection Method for Gaussian Mixture Clustering

Manifold Regularized Gaussian Mixture Model for Semi-supervised Clustering.

EGMM: an Evidential Version of the Gaussian Mixture Model for Clustering

Model-based clustering based on sparse finite Gaussian mixtures

Density-sensitive Fuzzy Kernel Maximum Entropy Clustering Algorithm.

Robust Clustering Based on Finite Mixtures t Distribution

The parsimonious Gaussian mixture models with partitioned parameters and their application in clustering

Model-based clustering with envelopes

Unsupervised Learning of Gaussian Mixture Model with Application to Image Segmentation

Adaptive Clustering Ensemble Method Based on Uncertain Entropy Decision-Making

Laplacian Regularized Gaussian Mixture Model for Data Clustering

An Entropy Weighting Mixture Model for Subspace Clustering of High-Dimensional Data

Unsupervised learning of regression mixture models with unknown number of components

Rough Possibilistic C-means Clustering Based on Multigranulation Approximation Regions and Shadowed Sets

A Spatial Gaussian Mixture Model for Optical Remote Sensing Image Clustering.

Gaussian Mixture Model Clustering with Incomplete Data