A multi-view clustering algorithm based on deep semi-NMF

Dexian Wang,Tianrui Li,Wei Huang,Zhipeng Luo,Ping Deng,Pengfei Zhang,Minbo Ma
DOI: https://doi.org/10.1016/j.inffus.2023.101884
IF: 18.6
2023-06-13
Information Fusion
Abstract:Multi-view clustering (MVC) aims to fuse the information among multiple views to achieve effective clustering. Many MVC algorithms based on semi-nonnegative matrix factorization (SNMF) typically have two issues: (1) their optimization schemes are not flexible enough; and (2) the variables are updated only rely on the data but not guided by learning rate. These problems can result in very poor clusters generated. In this paper, we present a multi-view clustering algorithm based on deep SNMF (MCDS) to resolve these issues. Specifically, we first design two types of activation functions to restrict the value domain of the element in the low-dimensional matrix to eliminate the constraint. Then, the SGD algorithm is used to implement element update guided by the learning rate. After obtaining the corresponding weight matrix and bias matrix, we combine them with the activation functions to construct a deep SNMF (DSNMF) network. This network is to update the element in the corresponding low-dimensional matrix for each view and obtain the consensus matrix. To validate the proposed algorithm, numerous experiments are performed on six multi-view datasets including both normal and large-scale datasets. The results demonstrate that MCDS can achieve excellent clustering results and outperform other competitive methods.
computer science, artificial intelligence, theory & methods
What problem does this paper attempt to address?