Abstract:Deep Non-Negative Matrix Factorization (DNMF) methods provide an efficient low-dimensional representation of given data through their layered architecture. A limitation of such methods is that they cannot effectively preserve the local and global geometric structures of the data in each layer. Consequently, a significant amount of the geometrical information within the data, present in each layer of the employed deep framework, can be overlooked by the model. This can lead to an information loss and a subsequent drop in performance. In this paper, we propose a novel deep non-negative matrix factorization method, D eep N on- N egative M atrix F actorization with Joint G lobal and L ocal Structure Preservation (dubbed Dn 2 MF GL ), that ensures the preservation of both global and local structures within the data space. Dn 2 MF GL performs representation learning through a sequential embedding procedure which involves both the global data structure by accounting for the data variance, and the local data relationships by utilizing information from neighboring data points. Moreover, a regularization term that promotes sparsity by utilizing the concept of the inner product is applied to the matrices representing the lower dimensions. This aims to retain the fundamental data structure while discarding less crucial features. Simultaneously, the residual matrix of Dn 2 MF GL is subjected to the L2,1 norm, which ensures the robustness of the model against noisy data samples. An effective and multiplicative updating process also facilitates Dn 2 MF GL in solving the employed objective function. The clustering performance of the proposed deep NMF method is explored across various benchmarks of face datasets. The results point to Dn 2 MF GL outperforming several existing classical and state-of-the-art NMF methods. The source code is available at https://github.com/FaridSaberi/Dn2MFGO.git .

Progressive Deep Non-Negative Matrix Factorization Architecture with Graph Convolution-based Basis Image Reorganization

Feature Extraction Via Multi-View Non-Negative Matrix Factorization with Local Graph Regularization.

The Integration of Neural Network and Physical Reconstruction Model for Fourier Ptychographic Microscopy

Adaptive graph regularized nonnegative matrix factorization for data representation

Image Feature Extraction via Graph Embedding Regularized Projective Non-negative Matrix Factorization.

Generative Adversarial Networks for Non-Negative Matrix Factorization in Temporal Psycho-Visual Modulation

Robust Structured Nonnegative Matrix Factorization for Image Representation.

Neighborhood Preserving Nonnegative Matrix Factorization

Deep Nonnegative Matrix Factorization with Joint Global and Local Structure Preservation

Semi-supervised Convex Nonnegative Matrix Factorizations with Graph Regularized for Image Representation

Deep graph convolution neural network with non-negative matrix factorization for community discovery

A New Scheme for Decomposition of Mixed Pixels Based on Modified Nonnegative Matrix Factorization and Genetic-Algorithm

Graph regularized non-negative matrix factorization with sparse coding

Neighborhood Preserving Non-Negative Tensor Factorization For Image Representation

Nonnegative Discriminant Matrix Factorization

Accelerating Locality Preserving Nonnegative Matrix Factorization

A Deep Non-negative Matrix Factorization Model for Big Data Representation Learning

Multiple Graph Adaptive Regularized Semi-Supervised Nonnegative Matrix Factorization with Sparse Constraint for Data Representation

Non-negative Local Coordinate Factorization for Image Representation.

Non-negative Matrix Factorization on Manifold

Deep and Wide Nonnegative Matrix Factorization with Embedded Regularization