Abstract:The ubiquitous availability of high-dimensional data such as images and videos has generated a lot of interest in high-dimensional data analysis. One of the key issues that needs to be addressed in real applications is the presence of large-magnitude non-Gaussian errors. For image data, the problem of deformations or domain transformations also poses interesting challenges. In this thesis, we harness recent advances in low-rank matrix recovery via convex optimization techniques to solve real problems in computer vision. This thesis also provides some theoretical analysis that extends existing results to new observation models. Low-rank matrix approximations are a popular tool in data analysis. The well-known Principal Component Analysis (PCA) algorithm is a good example. Recently, it was shown that low-rank matrices can be recovered exactly from grossly corrupted measurements via convex optimization. This framework, called Principal Component Pursuit (PCP), constitutes a powerful tool that allows us to handle corrupted measurements and even missing entries in a principled way. In this thesis, we extend existing theoretical results to the case when a large majority of the entries of the matrix are badly corrupted. On the application side, we first briefly look at the image formation model that naturally gives rise to a low-rank matrix structure, and see how PCP can be used effectively in the photometric stereo problem. We then extend the existing PCP framework in a non-trivial fashion to effectively handle domain transformations in images. The proposed ideas are used to align multiple images simultaneously with one another, as well as to represent structured and symmetric textures in a novel way that is invariant to deformations. In addition to achieving excellent performance on real data, these methods are potentially very useful for other vision tasks like 3D structure recovery for urban images, automatic camera calibration, etc. Finally, we provide some theoretical guarantees for the new observation model encountered in the aforementioned applications. In particular, we show that under some conditions it is possible to recover most low-rank matrices even when a small linear fraction of their entries has been badly corrupted and, furthermore, when only linear measurements of the corrupted matrix are available. Besides being one of the first theoretical results for this case, this dissertation opens up many exciting avenues for future research in this direction.

Supervised Low-Rank Matrix Recovery for Traffic Sign Recognition in Image Sequences

Low-Rank Matrix Recovery for Traffic Sign Recognition in Image Sequences

Recovery of Low-Rank Plus Compressed Sparse Matrices with Application to Unveiling Traffic Anomalies

Sparsity tracking for low rank matrix recovery from noise

Reweighted Low-Rank Matrix Recovery and Its Application in Image Restoration

Salient object detection with low-rank approximation and ℓ2,1-norm minimization

Applications of Low-Rank Matrix Recovery Methods in Computer Vision

A Novel Nonconvex Low-Rank Tensor Completion Approach for Traffic Sensor Data Recovery From Incomplete Measurements

Tensor Low-Rank Representation for Data Recovery and Clustering

Spatio-Temporal Signal Recovery Based on Low Rank and Differential Smoothness

Robust Image Restoration via Reweighted Low-Rank Matrix Recovery

Low-rank matrix recovery with non-quadratic loss: projected gradient method and regularity projection oracle

Sign-RIP: A Robust Restricted Isometry Property for Low-rank Matrix Recovery

Accelerated Low-Rank Visual Recovery by Random Projection

Traffic Signs Identification by Using Sparse Image Decomposition and Adaptive Correlation Techniques

Low-rank Matrix Recovery With Unknown Correspondence

Adaptive Structure-constrained Robust Latent Low-Rank Coding for Image Recovery

A Validation Approach to Over-parameterized Matrix and Image Recovery

Robust auto-weighted projective low-rank and sparse recovery for visual representation

Joint Capped Norms Minimization for Robust Matrix Recovery

Dynamic Matrix Recovery