A Diversified Attention Model for Interpretable Multiple Clusterings
Liangrui Ren,Guoxian Yu,Jun Wang,Lei Liu,Carlotta Domeniconi,Xiangliang Zhang
DOI: https://doi.org/10.1109/tkde.2022.3218693
IF: 9.235
2022-01-01
IEEE Transactions on Knowledge and Data Engineering
Abstract:Multiple clusterings can explore the same set of data from different perspectives by discovering different and meaningful clusterings. However, most, if not all, of the existing approaches overwhelmingly focus on the diversity between clustering subspaces, and pay much less attention on the salience of the subspaces. As a consequence, the quality of the produced clusterings is an understudied aspect of the problem. Furthermore, existing methods cannot explain the unique internal subspace structure of each clustering, and cannot incorporate multi-facet knowledge to generate different clusterings. In this paper, we propose a solution named iMClusts (interpretable Multiple Clusterings by diversified attention). iMClusts makes use of the expressive representational power of deep autoencoders and multi-head attention to generate multiple salient embedding matrices, and multiple clusterings therein. In addition, it leverages multi-facet knowledge and enhances the diversity between heads to boost the quality and diversity of multiple clusterings. Experimental results on benchmark datasets show that iMClusts can generate multiple clusterings with quality, interpretability, and diversity.
computer science, information systems, artificial intelligence,engineering, electrical & electronic