Deep Nonnegative Matrix Factorization with Joint Global and Local Structure Preservation
Farid Saberi-Movahed,Bitasta Biswas,Prayag Tiwari,Jens Lehmann,Sahar Vahdati
DOI: https://doi.org/10.1016/j.eswa.2024.123645
IF: 8.5
2024-03-17
Expert Systems with Applications
Abstract:Deep Non-Negative Matrix Factorization (DNMF) methods provide an efficient low-dimensional representation of given data through their layered architecture. A limitation of such methods is that they cannot effectively preserve the local and global geometric structures of the data in each layer. Consequently, a significant amount of the geometrical information within the data, present in each layer of the employed deep framework, can be overlooked by the model. This can lead to an information loss and a subsequent drop in performance. In this paper, we propose a novel deep non-negative matrix factorization method, D eep N on- N egative M atrix F actorization with Joint G lobal and L ocal Structure Preservation (dubbed Dn 2 MF GL ), that ensures the preservation of both global and local structures within the data space. Dn 2 MF GL performs representation learning through a sequential embedding procedure which involves both the global data structure by accounting for the data variance, and the local data relationships by utilizing information from neighboring data points. Moreover, a regularization term that promotes sparsity by utilizing the concept of the inner product is applied to the matrices representing the lower dimensions. This aims to retain the fundamental data structure while discarding less crucial features. Simultaneously, the residual matrix of Dn 2 MF GL is subjected to the L2,1 norm, which ensures the robustness of the model against noisy data samples. An effective and multiplicative updating process also facilitates Dn 2 MF GL in solving the employed objective function. The clustering performance of the proposed deep NMF method is explored across various benchmarks of face datasets. The results point to Dn 2 MF GL outperforming several existing classical and state-of-the-art NMF methods. The source code is available at https://github.com/FaridSaberi/Dn2MFGO.git .
computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science