Abstract:Maximum entropy clustering algorithm (ME) has lately received great attention for its high performance in large-scale data clustering and simplicity in implementation. However, previous studies have demonstrated that different clusters obtained by traditional ME tend to converge to the same one during its process of iteration affected by regularization coefficient and these cluster centers are subject to bias due to its sensitivity to different distributions of objects. These drawbacks of traditional ME can result in its failure of revealing the natural groupings in most datasets, especially in non-Gaussian distributed datasets. In order to address those limitations, we present a novel density-sensitive fuzzy kernel maximum entropy clustering algorithm in this paper. In the proposed approach, to accommodate non-Gaussian distributed cases, the dataset to be clustered in the original space is firstly implicitly mapped into high-dimensional feature space through the kernel function. By introducing the kernel function-based similarity terms in the update formula of the cluster centers, the effect of the objects not belonging to the current cluster on the update of its corresponding center can be counteracted, and simultaneously the influence of regularization coefficient on the clustering result is restricted as well, which can effectively overcome the convergence of the different clusters encountered by traditional ME. In addition, in order to prevent cluster centers from biases caused by the different distribution of the objects in the feature space, the relative density-based weights are also incorporated into the cost function, which can help the proposed approach produce more reasonable and accurate clustering results. In the experiments, the influence of the different parameters on the clustering performance is discussed in detail and some suggestions are also provided. Theoretical analysis and experimental results on several synthetic datasets, UCI benchmark datasets and generated large MNIST handwritten digits datasets demonstrate that the proposed approach is superior to other existing clustering techniques with good robustness.

An Effective Optimization Method for Fuzzy $K$-Means with Entropy Regularization

Iteratively Reweighted Algorithm for Fuzzy $c$-Means

Enhanced Robust Fuzzy K-Means Clustering Joint ℓ0-Norm Constraint

Deep Fuzzy K-Means with Adaptive Loss and Entropy Regularization

Entropy Regularized Fuzzy Nonnegative Matrix Factorization for Data Clustering

Fuzzy K-Means Clustering With Discriminative Embedding

Density-sensitive Fuzzy Kernel Maximum Entropy Clustering Algorithm.

A Literal Fuzzy c-means clustering method with Iterative Entropy Attribute Weights

Multiple Kernel Relative Entropy Fuzzy C-means Clustering Algorithm

Robust and Efficient Fuzzy C-Means Clustering Constrained on Flexible Sparsity

Fuzzy K-means clustering with reconstructed information

A New Feature-Weighted Relative Entropy Clustering Algorithm

A Robust and High-Dimensional Clustering Algorithm Based on Feature Weight and Entropy

IFKMHC: Implicit Fuzzy K-Means Model for High-Dimensional Data Clustering

Dynamically Incremental K-Means++ Clustering Algorithm Based on Fuzzy Rough Set Theory

A Novel Method for Optimizing Spectral Rotation Embedding K-means with Coordinate Descent

Rough Fuzzy K-Means Clustering Based on Parametric Decision-Theoretic Shadowed Set with Three-Way Approximation

A Novel K -Means Framework Via Constrained Relaxation and Spectral Rotation

Reliability-based regularized weighted soft k-means algorithmfor subspace clustering

Discriminative Projection Fuzzy K-Means with Adaptive Neighbors

Relax and Merge: A Simple Yet Effective Framework for Solving Fair $k$-Means and $k$-sparse Wasserstein Barycenter Problems