Abstract:The ubiquitous availability of high-dimensional data such as images and videos has generated a lot of interest in high-dimensional data analysis. One of the key issues that needs to be addressed in real applications is the presence of large-magnitude non-Gaussian errors. For image data, the problem of deformations or domain transformations also poses interesting challenges. In this thesis, we harness recent advances in low-rank matrix recovery via convex optimization techniques to solve real problems in computer vision. This thesis also provides some theoretical analysis that extends existing results to new observation models. Low-rank matrix approximations are a popular tool in data analysis. The well-known Principal Component Analysis (PCA) algorithm is a good example. Recently, it was shown that low-rank matrices can be recovered exactly from grossly corrupted measurements via convex optimization. This framework, called Principal Component Pursuit (PCP), constitutes a powerful tool that allows us to handle corrupted measurements and even missing entries in a principled way. In this thesis, we extend existing theoretical results to the case when a large majority of the entries of the matrix are badly corrupted. On the application side, we first briefly look at the image formation model that naturally gives rise to a low-rank matrix structure, and see how PCP can be used effectively in the photometric stereo problem. We then extend the existing PCP framework in a non-trivial fashion to effectively handle domain transformations in images. The proposed ideas are used to align multiple images simultaneously with one another, as well as to represent structured and symmetric textures in a novel way that is invariant to deformations. In addition to achieving excellent performance on real data, these methods are potentially very useful for other vision tasks like 3D structure recovery for urban images, automatic camera calibration, etc. Finally, we provide some theoretical guarantees for the new observation model encountered in the aforementioned applications. In particular, we show that under some conditions it is possible to recover most low-rank matrices even when a small linear fraction of their entries has been badly corrupted and, furthermore, when only linear measurements of the corrupted matrix are available. Besides being one of the first theoretical results for this case, this dissertation opens up many exciting avenues for future research in this direction.

Robust Low-rank Matrix Completion for sparse motion correction in auto calibration PI

Robust Kinematic Calibration for Improving Collaboration Accuracy of Dual-Arm Manipulators with Experimental Validation

Non-Local Image Inpainting Using Low-Rank Matrix Completion: Non-Local Image Inpainting Using Low-Rank Matrix Completion

Efficient Completion for Corrupted Low-Rank Images Via Alternating Direction Method

Calibration Using Matrix Completion with Application to Ultrasound Tomography

Calibrationless parallel imaging reconstruction for multislice MR data using low-rank tensor completion

Robust Recovery of Myocardial Kinematics Using Dual ℋ∞$\mathcal {h}_{\infty }$ Criteria

Robust recovery of myocardial kinematics using dual ℋ_∞ criteria

Adaptive self-calibrating iterative GRAPPA reconstruction

Applications of Low-Rank Matrix Recovery Methods in Computer Vision

Enhanced Three-Axis Frame and Wand-Based Multi-Camera Calibration Method Using Adaptive Iteratively Reweighted Least Squares and Comprehensive Error Integration

RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images.

Joint calibrationless reconstruction of highly undersampled multicontrast MR datasets using a low-rank Hankel tensor completion framework

Simultaneous Rectification and Alignment via Robust Recovery of Low-rank Tensors.

Robust Calibration Approach for Robot Base Coordinate System Based on RANSAC-SVD

Recovery of Damped Exponentials Using Structured Low Rank Matrix Completion

Fast and Calibrationless Low-Rank Parallel Imaging Reconstruction through Unrolled Deep Learning Estimation of Multi-Channel Spatial Support Maps

Stereo MSCKF with Online Extrinsic Calibration using Invariant Extended Kalman Filter

Adaptive Rank-One Matrix Completion using Sum of Outer Products

The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices