Abstract:Clustering ensemble, which aims to learn a robust consensus clustering from multiple weak base clusterings, has achieved promising performance on various applications. With the development of big data, the scale and complexity of data is constantly increasing. However, most existing clustering ensemble methods typically employ shallow clustering algorithms to generate base clusterings. When confronted with high-dimensional complex data, these shallow algorithms fail to fully utilize the intricate features present in the latent data space. As a result, the quality and diversity of the generated base clusterings are insufficient, thus affecting the subsequent ensemble performance. To address this issue, we propose a novel clustering ensemble algorithm for handling deep embeddings using cluster confidence (CEDECC) to improve the robustness and performance. Instead of simply combining deep clustering with clustering ensembles, we take into consideration that the performance of existing deep clustering methods heavily relies on the quality of low-dimensional embeddings generated during the pre-training stage. The quality of embeddings is unstable due to the influence of different initialization parameters. In CEDECC, specifically, we first construct a cluster confidence measure to evaluate the quality of low-dimensional embeddings. Typically, high-quality low-dimensional embeddings yield accurate clustering results with the same model parameters. Then, we utilize multiple high-quality embeddings to generate the base partitions. In the ensemble strategy phase, we consider the cluster-wise diversity and propose a novel ensemble cluster estimation to improve the overall consensus performance of the model. Extensive experiments on three benchmark datasets and four real-world biological datasets have demonstrated that the proposed CEDECC consistently outperforms the state-of-the-art clustering ensemble methods.

Deep Image Clustering Using Convolutional Autoencoder Embedding With Inception-Like Block

Image Clustering Algorithms by Deep Convolutional Autoencoders*

Deep Clustering with Convolutional Autoencoders

Deep clustering based on embedded auto-encoder

Structured Deep Discriminant Embedded Coding Network for Image Clustering

Deep Embedding Clustering Based on Residual Autoencoder

Deep Embedded Clustering with Asymmetric Residual Autoencoder

Deep Density-based Image Clustering

Multi-level Feature Learning on Embedding Layer of Convolutional Autoencoders and Deep Inverse Feature Learning for Image Clustering

Improved Image Clustering with Deep Semantic Embedding.

Representation Learning Based on Autoencoder and Deep Adaptive Clustering for Image Clustering

An Image Clustering Auto-Encoder Based on Predefined Evenly-Distributed Class Centroids and MMD Distance

Discriminatively Boosted Image Clustering with Fully Convolutional Auto-Encoders.

Deep Convolutional Center-Based Clustering

DeepCluE: Enhanced Image Clustering via Multi-layer Ensembles in Deep Neural Networks

Improved deep convolutional embedded clustering with re-selectable sample training

Image Clustering Based on Deep Sparse Representations

Deep self-supervised clustering with embedding adjacent graph features

Deep Convolutional Self-Paced Clustering

Deep Discriminative Clustering Network.

A Clustering Ensemble Algorithm for Handling Deep Embeddings Using Cluster Confidence