Abstract:Low-rank matrix factorizations are a class of linear models widely used in various fields such as machine learning, signal processing, and data analysis. These models approximate a matrix as the product of two smaller matrices, where the left matrix captures latent features while the right matrix linearly decomposes the data based on these features. There are many ways to define what makes a component "important." Standard LRMFs, such as the truncated singular value decomposition, focus on minimizing the distance between the original matrix and its low-rank approximation. In this thesis, the notion of "importance" is closely linked to interpretability and uniqueness, which are key to obtaining reliable and meaningful results. This thesis thus focuses on volume-based constraints and regularizations designed to enhance interpretability and uniqueness. We first introduce two new volume-constrained LRMFs designed to enhance these properties. The first assumes that data points are naturally bounded (e.g., movie ratings between 1 and 5 stars) and can be explained by convex combinations of features within the same bounds, allowing them to be interpreted in the same way as the data. The second model is more general, constraining the factors to belong to convex polytopes. Then, two variants of volume-regularized LRMFs are proposed. The first minimizes the volume of the latent features, encouraging them to cluster closely together, while the second maximizes the volume of the decompositions, promoting sparse representations. Across all these models, uniqueness is achieved under the core principle that the factors must be "sufficiently scattered" within their respective feasible sets. Motivated by applications such as blind source separation and missing data imputation, this thesis also proposes efficient algorithms that make these models practical for real-world applications.

Separable Algorithms for Matrix Factorization with Presence of Missing Data

Nonmonotone variable projection algorithms for matrix decomposition with missing data

Successively Alternate Least Square for Low-Rank Matrix Factorization with Bounded Missing Data

An Efficient Algorithm for Ill-Conditioned Separable Nonlinear Least Squares

An algorithm for low-rank matrix factorization and its applications

Robust Matrix Factorization by Majorization Minimization

A Stochastic Alternating Minimization Approach for Large Scale Low Rank Matrix Factorization.

Alternating Iteratively Reweighted Minimization Algorithms for Low-Rank Matrix Factorization

Robust Low-Rank Matrix Factorization Via Block Iteratively Reweighted Least-Squares.

A Separable Surrogate Function Method for Sparse and Low-Rank Matrices Decomposition

A Cyclic Weighted Median Method for L1 Low-Rank Matrix Factorization with Missing Entries

Augmented Lagrangian alternating direction method for matrix separation based on low-rank factorization

Low-Rank Matrix Factorizations with Volume-based Constraints and Regularizations

An efficient matrix bi-factorization alternative optimization method for low-rank matrix recovery and completion.

Divide-and-Conquer Method for L1 Norm Matrix Factorization in the Presence of Outliers and Missing Data

Subspace-Constrained Quadratic Matrix Factorization: Algorithm and Applications

Low-rank matrix factorization with nonconvex regularization and bilinear decomposition

Robust Asymmetric Bayesian Adaptive Matrix Factorization

Exact Decomposition of Joint Low Rankness and Local Smoothness Plus Sparse Matrices

Efficient Low Rank Matrix Recovery With Flexible Group Sparse Regularization

&Lt;inline-Formula> &Lt;tex-Math Notation="latex">$l_{1}$ &Lt;/tex-Math></inline-formula>-norm Low-Rank Matrix Factorization by Variational Bayesian Method