Abstract:In this thesis, we offer a thorough investigation of different regularisation terms used in variational imaging problems, together with detailed optimisation processes of these problems. We begin by studying smooth problems and partially non-smooth problems in the form of Tikhonov denoising and Total Variation (TV) denoising, respectively. For Tikhonov denoising, we study an accelerated gradient method with adaptive restart, which shows a very rapid convergence rate. However, it is not straightforward to apply this fast algorithm to TV denoising, due to the non-smoothness of its built-in regularisation. To tackle this issue, we propose to utilise duality to convert such a non-smooth problem into a smooth one so that the accelerated gradient method with restart applies naturally. However, we notice that both Tikhonov and TV regularisations have drawbacks, in the form of blurred image edges and staircase artefacts, respectively. To overcome these drawbacks, we propose a novel adaption to Total Generalised Variation (TGV) regularisation called Total Smooth Variation (TSV), which retains edges and meanwhile does not produce results which contain staircase artefacts. To optimise TSV effectively, we then propose the Accelerated Proximal Gradient Algorithm (APGA) which also utilises adaptive restart techniques. Compared to existing state-of-the-art regularisations (e.g. TV), TSV is shown to obtain more effective results on denoising problems as well as advanced imaging applications such as magnetic resonance imaging (MRI) reconstruction and optical flow. TSV removes the staircase artefacts observed when using TV regularisation, but has the added advantage over TGV that it can be efficiently optimised using gradient based methods with Nesterov acceleration and adaptive restart. Code is available at <a class="link-external link-https" href="https://github.com/Jbartlett6/Accelerated-First-Order-Method-for-Variational-Imaging" rel="external noopener nofollow">this https URL</a>.

Dualization and Automatic Distributed Parameter Selection of Total Generalized Variation via Bilevel Optimization

Spatially Dependent Regularization Parameter Selection for Total Generalized Variation-Based Image Denoising

ADMM-TGV image restoration for scientific applications with unbiased parameter choice

Automatic nonstationary anisotropic Tikhonov regularization through bilevel optimization

Template-based CT Reconstruction with Optimal Transport and Total Generalized Variation

Dyadic partition-based training schemes for TV/TGV denoising

Regularization parameter selection for nonlinear iterative image restoration and MRI reconstruction using GCV and SURE-based methods

Bilevel learning of regularization models and their discretization for image deblurring and super-resolution

An Efficient Non-Convex Total Variation Approach for Image Deblurring and Denoising

Multiple Degree Total Variation (MDTV) Regularization for Image Restoration.

Parameter Selection by GCV and a $χ^2$ test within Iterative Methods for $\ell_1$-regularized Inverse Problems

Better than the Total Variation Regularization

Accelerated First Order Methods for Variational Imaging

Second Order Total Generalized Variation for Speckle Reduction in Ultrasound Images

Image Restoration by Combined Order Regularization with Optimal Spatial Adaptation

Bilateral Spectrum Weighted Total Variation for Noisy-Image Super-Resolution and Image Denoising

High-order Total Variation-Based Poissonian Image Deconvolution with Spatially Adapted Regularization Parameter

Total Generalized Variation Restoration with Non-Quadratic Fidelity

MPTV: Matching Pursuit Based Total Variation Minimization for Image Deconvolution

Total variation image reconstruction algorithm based on non-convex function

Mesh Total Generalized Variation for Denoising