Abstract:Clustering ensemble, which aims to learn a robust consensus clustering from multiple weak base clusterings, has achieved promising performance on various applications. With the development of big data, the scale and complexity of data is constantly increasing. However, most existing clustering ensemble methods typically employ shallow clustering algorithms to generate base clusterings. When confronted with high-dimensional complex data, these shallow algorithms fail to fully utilize the intricate features present in the latent data space. As a result, the quality and diversity of the generated base clusterings are insufficient, thus affecting the subsequent ensemble performance. To address this issue, we propose a novel clustering ensemble algorithm for handling deep embeddings using cluster confidence (CEDECC) to improve the robustness and performance. Instead of simply combining deep clustering with clustering ensembles, we take into consideration that the performance of existing deep clustering methods heavily relies on the quality of low-dimensional embeddings generated during the pre-training stage. The quality of embeddings is unstable due to the influence of different initialization parameters. In CEDECC, specifically, we first construct a cluster confidence measure to evaluate the quality of low-dimensional embeddings. Typically, high-quality low-dimensional embeddings yield accurate clustering results with the same model parameters. Then, we utilize multiple high-quality embeddings to generate the base partitions. In the ensemble strategy phase, we consider the cluster-wise diversity and propose a novel ensemble cluster estimation to improve the overall consensus performance of the model. Extensive experiments on three benchmark datasets and four real-world biological datasets have demonstrated that the proposed CEDECC consistently outperforms the state-of-the-art clustering ensemble methods.

DeepCluE: Enhanced Image Clustering via Multi-layer Ensembles in Deep Neural Networks

DeepCluE: Enhanced Deep Clustering Via Multi-Layer Ensembles in Neural Networks

A Clustering Ensemble Algorithm for Handling Deep Embeddings Using Cluster Confidence

Improved Selective Deep-Learning-Based Clustering Ensemble

Jointly Learn the Base Clustering and Ensemble for Deep Image Clustering

Deep image clustering with contrastive learning and multi-scale graph convolutional networks

Structured Deep Discriminant Embedded Coding Network for Image Clustering

Image Clustering Algorithms by Deep Convolutional Autoencoders*

Deep Density-based Image Clustering

Deep Discriminative Clustering Network.

Improved Deep Embedding Clustering with Ensemble Learning

Deep Clustering Via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimization

Deep Clustering with Convolutional Autoencoders

Deep Structural Enhanced Network for Document Clustering

Deep Image Clustering Using Convolutional Autoencoder Embedding With Inception-Like Block

Deep Image Clustering by Fusing Contrastive Learning and Neighbor Relation Mining.

Deep clustering based on embedded auto-encoder

Deep Clustering with Hybrid-Grained Contrastive and Discriminative Learning

A Novel Deeply-Learned Image Quality Analysis Algorithm for Clustering

A Novel Clustering Algorithm Based on Multi-Layer Features and Graph Attention Networks

Contrastive Deep Embedded Clustering