Abstract:Low-rank matrix factorizations are a class of linear models widely used in various fields such as machine learning, signal processing, and data analysis. These models approximate a matrix as the product of two smaller matrices, where the left matrix captures latent features while the right matrix linearly decomposes the data based on these features. There are many ways to define what makes a component "important." Standard LRMFs, such as the truncated singular value decomposition, focus on minimizing the distance between the original matrix and its low-rank approximation. In this thesis, the notion of "importance" is closely linked to interpretability and uniqueness, which are key to obtaining reliable and meaningful results. This thesis thus focuses on volume-based constraints and regularizations designed to enhance interpretability and uniqueness. We first introduce two new volume-constrained LRMFs designed to enhance these properties. The first assumes that data points are naturally bounded (e.g., movie ratings between 1 and 5 stars) and can be explained by convex combinations of features within the same bounds, allowing them to be interpreted in the same way as the data. The second model is more general, constraining the factors to belong to convex polytopes. Then, two variants of volume-regularized LRMFs are proposed. The first minimizes the volume of the latent features, encouraging them to cluster closely together, while the second maximizes the volume of the decompositions, promoting sparse representations. Across all these models, uniqueness is achieved under the core principle that the factors must be "sufficiently scattered" within their respective feasible sets. Motivated by applications such as blind source separation and missing data imputation, this thesis also proposes efficient algorithms that make these models practical for real-world applications.

Factorization for Projective and Metric Reconstruction Via Truncated Nuclear Norm.

Fast and Accurate Matrix Completion Via Truncated Nuclear Norm Regularization

Matrix completion by Truncated Nuclear Norm Regularization

Robust Factorization Machine - A Doubly Capped Norms Minimization.

3d Orthographic Reconstruction Based On Robust Factorization Method With Outliers

Truncated quadratic norm minimization for bilinear factorization based matrix completion

Reconstruction and denoising of high-dimensional seismic data via Frobenius-nuclear mixed norm constraints

Simultaneous Reconstruction and Segmentation for Dynamic PET: A Low Rank Framework.

Proximal Robust Factorization for Piecewise Planar Reconstruction

Subspace-Constrained Quadratic Matrix Factorization: Algorithm and Applications

Truncated Nuclear Norm Minimization for Image Restoration Based On Iterative Support Detection

Feature and Nuclear Norm Minimization for Matrix Completion

Tensor Factorization for Low-Rank Tensor Completion.

Low-Rank Matrix Factorizations with Volume-based Constraints and Regularizations

Structured Low-Rank Matrix Factorization: Global Optimality, Algorithms, and Applications

Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm

Robust Matrix Factorization by Majorization Minimization

Truncated nuclear norm regularization for low-rank tensor completion

Ct Reconstruction Method from Truncated Projection Based on Fsm Analytic Continuation

An Efficient Tensor Completion Method Via New Latent Nuclear Norm

Dynamic MR Image Reconstruction Based on Total Generalized Variation and Low-Rank Decomposition.