Abstract:In this thesis, we offer a thorough investigation of different regularisation terms used in variational imaging problems, together with detailed optimisation processes of these problems. We begin by studying smooth problems and partially non-smooth problems in the form of Tikhonov denoising and Total Variation (TV) denoising, respectively. For Tikhonov denoising, we study an accelerated gradient method with adaptive restart, which shows a very rapid convergence rate. However, it is not straightforward to apply this fast algorithm to TV denoising, due to the non-smoothness of its built-in regularisation. To tackle this issue, we propose to utilise duality to convert such a non-smooth problem into a smooth one so that the accelerated gradient method with restart applies naturally. However, we notice that both Tikhonov and TV regularisations have drawbacks, in the form of blurred image edges and staircase artefacts, respectively. To overcome these drawbacks, we propose a novel adaption to Total Generalised Variation (TGV) regularisation called Total Smooth Variation (TSV), which retains edges and meanwhile does not produce results which contain staircase artefacts. To optimise TSV effectively, we then propose the Accelerated Proximal Gradient Algorithm (APGA) which also utilises adaptive restart techniques. Compared to existing state-of-the-art regularisations (e.g. TV), TSV is shown to obtain more effective results on denoising problems as well as advanced imaging applications such as magnetic resonance imaging (MRI) reconstruction and optical flow. TSV removes the staircase artefacts observed when using TV regularisation, but has the added advantage over TGV that it can be efficiently optimised using gradient based methods with Nesterov acceleration and adaptive restart. Code is available at <a class="link-external link-https" href="https://github.com/Jbartlett6/Accelerated-First-Order-Method-for-Variational-Imaging" rel="external noopener nofollow">this https URL</a>.

A Second-Order TGV Discretization with $90^{\circ}$ Rotational Invariance Property

Learned Discretization Schemes for the Second-Order Total Generalized Variation

Discrete Total Variation Model with Gradient Fidelity Term for Image Restoration

Total Generalized Variation for Piecewise Constant Functions on Triangular Meshes with Applications in Imaging

Compact Representation of n-th order TGV

Mesh Total Generalized Variation for Denoising

Exact Solutions of One-Dimensional TGV

Total Generalized Variation Restoration with Non-Quadratic Fidelity

Second-order TGV model for Poisson noise image restoration

Extremal points of total generalized variation balls in 1D: characterization and applications

Dyadic partition-based training schemes for TV/TGV denoising

Dualization and Automatic Distributed Parameter Selection of Total Generalized Variation via Bilevel Optimization

A Combined First and Second Order Variational Approach for Image Reconstruction

Template-based CT Reconstruction with Optimal Transport and Total Generalized Variation

Discretization of Total Variation in Optimization with Integrality Constraints

Better than the Total Variation Regularization

Second Order Total Generalized Variation for Speckle Reduction in Ultrasound Images

ADMM-TGV image restoration for scientific applications with unbiased parameter choice

A study of the one dimensional total generalised variation regularisation problem

Spatially Dependent Regularization Parameter Selection for Total Generalized Variation-Based Image Denoising

Accelerated First Order Methods for Variational Imaging