Spatially Adaptive Total Variation Regularization Model for Interdisciplinary Imaging Recovery

Guanghua Gong,Hongming Zhang,Minyu Yao

DOI: https://doi.org/10.1364/math.2016.mw5h.3

2016-01-01

Abstract:We introduce a spatially adaptive total variation regularization model for interdisciplinary imaging recovery. The model preserves image details and suppresses different kinds of noise in various applications.

What problem does this paper attempt to address?

Efficient Compressed Sensing Reconstruction Using Group Sparse Total Variation Regularization

Mingfeng Jiang,Yuan Liu,Wenlong Xu,Jie Hu,Yaming Wang,Yinglan Gong,Ling Xia

DOI: https://doi.org/10.1166/jmihi.2015.1486

2015-01-01

Journal of Medical Imaging and Health Informatics

Abstract:Compressed Sensing MR imaging (CS-MRI) is one of the most promising approaches to reconstruct the MR image from highly under-sampled k-space data, while greatly reducing scanning time. Total variation (TV) is commonly used as a penalty in sparse signal recovery. In this paper, an extension of TV, termed Group-Sparse Total Variation (GSTV), is employed as a regularization term for the CS-MR image reconstruction. Three different types of MR images with two different sampling trajectories are used to validate the performance of the proposed method in reconstruction accuracy and computational efficiency. Compared with the patch-based nonlocal Operator (PANO) method, the proposed GSTV-based regularization method achieves comparable SNR but owns the advantage of faster computation. Moreover, the proposed method can obviously improve the reconstruction quality with higher signal-to-noise ratio (SNR) than the Wavelet tree sparsity method (WaTMRI), however it takes some more reconstruction time. In all, the proposed method provides a simple and effective alternative solution to the CS-MRI regularization framework.
A Wasserstein distance and total variation regularized model to image reconstruction problems

Yiming Gao

2023-08-17

Abstract:Optimal transport has gained much attention in image processing field, such as computer vision, image interpolation and medical image registration. Recently, Bredies et al. (ESAIM:M2AN 54:2351-2382, 2020) and Schmitzer et al. (IEEE T MED IMAGING 39:1626-1635, 2019) established the framework of optimal transport regularization for dynamic inverse problems. In this paper, we incorporate Wasserstein distance, together with total variation, into static inverse problems as a prior regularization. The Wasserstein distance formulated by Benamou-Brenier energy measures the similarity between the given template and the reconstructed image. Also, we analyze the existence of solutions of such variational problem in Radon measure space. Moreover, the first-order primal-dual algorithm is constructed for solving this general imaging problem in a specific grid strategy. Finally, numerical experiments for undersampled MRI reconstruction are presented which show that our proposed model can recover images well with high quality and structure preservation.

Numerical Analysis
High-Order Total Variation-Based Image Restoration with Spatially Adapted Parameter Selection

Le Jiang,Jin Huang,Xiao-Guang Lv,Jun Liu

DOI: https://doi.org/10.1007/978-81-322-1759-6_9

2014-01-01

Abstract:In this paper, we propose a high-order total variation model to restore blurred and noisy images with spatially adapted regularization parameter selection. The proposed model can substantially reduce the staircase effect, while preserving sharp jump discontinuities (edges) in the restored images. We employ an alternating direction minimization method for the proposed model. Some numerical results are given to illustrate the effectiveness of the proposed method.
Template-based CT Reconstruction with Optimal Transport and Total Generalized Variation

Yiming Gao,Zhengmeng Jin,Xu Li

DOI: https://doi.org/10.1088/1361-6420/aceb17

IF: 2.408

2023-01-01

Inverse Problems

Abstract:x-ray computed tomography (CT) has been widely used in clinical diagnosis as a modality of medical imaging. To decrease the radiation dose patients suffering from, sparse-view CT has gained much attention in medical imaging field. In this paper, we propose to design a variational model based on dynamic optimal transportation and total generalized variation for CT reconstruction. This is a joint task involving inverse problem and template registration. The final state image of the optimal transport problem is unknown and needs to be reconstructed through CT inversion, while the given initial state can be regarded as a template to provide some structural information for the final one. Moreover, the existence and stability of minimizers to our proposed model are shown in continuous space. In discretization with the continuity equation, we utilize the well-known staggered grid in fluid mechanics and develop a first-order algorithm based on primal-dual method for numerically solving the proposed model. Finally, numerical experiments for sparse-view CT reconstruction are exhibited to show the performance of our proposed model in recovering images with high quality and structure preservation.
Construction Model for Total Variation Regularization Parameter

Guanghua Gong,Hongming Zhang,Minyu Yao

DOI: https://doi.org/10.1364/oe.22.010500

IF: 3.8

2014-01-01

Optics Express

Abstract:Image denoising is important for high-quality imaging in adaptive optics. Richardson-Lucy deconvolution with total variation(TV) regularization is commonly used in image denoising. The selection of TV regularization parameter is an essential issue, yet no systematic approach has been proposed. A construction model for TV regularization parameter is proposed in this paper. It consists of four fundamental elements, the properties of which are analyzed in details. The proposed model bears generality, making it apply to different image recovery scenarios. It can achieve effective spatially adaptive image recovery, which is reflected in both noise suppression and edge preservation. Simulations are provided as validation of recovery and demonstration of convergence speed and relative mean-square error.
Image Restoration by Combined Order Regularization with Optimal Spatial Adaptation

Sanjay Viswanath,Simon de Beco,Maxime Dahan,Muthuvel Arigovindan

DOI: https://doi.org/10.1109/TIP.2020.2988146

2021-06-01

Abstract:Total Variation (TV) and related extensions have been popular in image restoration due to their robust performance and wide applicability. While the original formulation is still relevant after two decades of extensive research, its extensions that combine derivatives of first- and second-order are now being explored for better performance, with examples being Combined Order TV (COTV) and Total Generalized Variation (TGV). As an improvement over such multi-order convex formulations, we propose a novel non-convex regularization functional which adaptively combines Hessian-Schatten (HS) norm and first order TV (TV1) functionals with spatially varying weight. This adaptive weight itself is controlled by another regularization term; the total cost becomes the sum of this adaptively weighted HS-TV1 term, the regularization term for the adaptive weight, and the data-fitting term. The reconstruction is obtained by jointly minimizing w.r.t. the required image and the adaptive weight. We construct a block coordinate descent method for this minimization with proof of convergence, which alternates between minimization w.r.t. the required image and the adaptive weights. We derive exact computational formula for minimization w.r.t. the adaptive weight, and construct an ADMM algorithm for minimization w.r.t. to the required image. We compare the proposed method using image recovery examples including MRI reconstruction and microscopy deconvolution.

Image and Video Processing
Generalized nonconvex nonsmooth four-directional total variation with overlapping group sparsity for image restoration

Rong Li,Bing Zheng

DOI: https://doi.org/10.1016/j.cam.2024.116045

IF: 2.872

2024-06-02

Journal of Computational and Applied Mathematics

Abstract:In this paper, we address the challenge of image deblurring in the presence of Gaussian noise. To achieve high-quality image restoration, we introduce an optimization framework that integrates four-directional total variation regularization, overlapping group sparsity, and a range of nonconvex penalties. This novel model effectively mitigates the staircase artifacts associated with total variation regularization and enhances restoration quality by leveraging domain-specific information about image pixels. Compared to the l1 norm, the nonconvex penalty applied to overlapping groups promotes sparsity in image gradients at the group level. To solve this nonconvex optimization problem, we propose a proximal alternating reweighted minimization algorithm, which has a proximal alternating scheme with a reweighted approximation of its subproblem. Theoretically, we establish that the sequences generated by the proposed algorithm converge to a critical point using the Kurdyka–Łojasiewicz property. Experimental results validate the superiority of our approach over competing methods.

mathematics, applied
Image restoration based on the minimax-concave and the overlapping group sparsity

Meimei Ji,Ping Zhao

DOI: https://doi.org/10.1007/s11760-022-02384-z

2022-11-12

Abstract:Total variation model is a popular image restoration method due to its capability to preserve edges. However, it is easy to produce staircase artifacts. In this paper, we propose a non-convex and non-separable regularization term combining the overlapping group sparsity (OGS) and the minimax-concave penalty, which is obtained by subtracting the minimax-concave of the OGS term from the OGS term. The OGS term in the new regularization term can remove the staircase artifacts and preserve the image structure. The minimax-concave penalty can promote the sparsity of image in gradient domain and improve the estimation of the high-frequency components. We prove and set the range of the regularization parameter to ensure that the total cost function of the proposed model is convex. In order to solve the proposed model, we develop an adaptive alternating direction method of multipliers algorithm to tune the regularization parameter adaptively. In the experiments, we compare the proposed model with other state-of-the-art models in image denoising and image deblurring. The experimental results show the effectiveness of the proposed model in image restoration.
Total variation image reconstruction algorithm based on non-convex function

Shaojiu Bi,Minmin Li,Guangcheng Cai,Xi Zhang

DOI: https://doi.org/10.1007/s11760-024-03089-1

IF: 1.583

2024-03-14

Signal Image and Video Processing

Abstract:The total variation method has been widely used because it can preserve important sharp edges and target boundaries in the image, but one of its shortcomings is that the norm would cause excessive punishment. To overcome excessive penalization, suppress step effects, and maintain a clean contour, this article introduces the non-convex function to design a new regularization term and proposes a new non-convex variational model. For non-convex variational optimization problems, the algorithm employs the alternating direction method of multipliers to obtain optimal approximate solutions, and rigorous convergence proofs are provided based on rich mathematical theory. By comparing with advanced fractional-order and other total variation recovery algorithms, it can be observed that this algorithm achieves better visual effects and quantitative analysis results on images with complex texture structures.

engineering, electrical & electronic,imaging science & photographic technology
Image restoration using total variation with overlapping group sparsity

Jun Liu,Ting-Zhu Huang,Ivan W. Selesnick,Xiao-Guang Lv,Po-Yu Chen

DOI: https://doi.org/10.1016/j.ins.2014.10.041

IF: 8.1

2015-02-01

Information Sciences

Abstract:Image restoration is one of the most fundamental issues in imaging science. Total variation regularization is widely used in image restoration problems for its capability to preserve edges. In the literature, however, it is also well known for producing staircase artifacts. In this work we extend the total variation with overlapping group sparsity, which we previously developed for one dimension signal processing, to image restoration. A convex cost function is given and an efficient algorithm is proposed for solving the corresponding minimization problem. In the experiments, we compare our method with several state-of-the-art methods. The results illustrate the efficiency and effectiveness of the proposed method in terms of PSNR and computing time.

computer science, information systems
High-order TVL1-based images restoration and spatially adapted regularization parameter selection.

Gang Liu,Ting-Zhu Huang,Jun Liu

DOI: https://doi.org/10.1016/j.camwa.2014.04.008

IF: 3.218

2014-01-01

Computers & Mathematics with Applications

Abstract:The total variation (TV) model with an L1-fidelity term (TVL1) is a famous model to recover blurred and impulse noisy image with edges-preserving. However, it usually causes some staircase effects. In this paper, we propose a hybrid model combining the TV regularizer and the high-order TV regularizer with the TVL1 model (HTVL1) for blurred and salt-and-pepper impulse noisy image restoration. The solving algorithm is under the frame-work of alternating direction method of multipliers (ADMM). In addition, a spatially adapted regularization parameter selection scheme is also used. Numerical results show that the quality of restored images by the proposed methods is competitive with the quality of restored images by some other existing methods.
An Efficient Non-Convex Total Variation Approach for Image Deblurring and Denoising

Jingjing Liu,Ruijie Ma,Xiaoyang Zeng,Wanquan Liu,Mingyu Wang,Hui Chen

DOI: https://doi.org/10.1016/j.amc.2021.125977

IF: 4.397

2021-01-01

Applied Mathematics and Computation

Abstract:Total variation (TV) is broadly utilized in image processing because it is able to preserve sharp edges and object boundaries, which are usually the most important parts of an image. Recently, the non-convex functions such as the smoothly clipped absolute deviation, the minimax concave penalty, the capped l(1)-norm penalty and the l(p) quasi-norm with 0 < p < 1 have been shown remarkable advantages in sparse learning due to the fact that they can overcome the over-penalization associated with the l(1)-norm. In this paper, an efficient non-convex total variation approach for image deblurring and denoising model has been proposed, which combines a non-convex regularization term and a non-convex data fitting term perfectly. Firstly, the non-convex functions are employed into the regularization term and the fidelity term for enhancing the sensitivity to sharp edges and object boundaries. Secondly, the optimizing minimization method based on the alternating direction method of multipliers (ADMM) is proposed to solve the non-convex total variation optimization problem. The resulting subproblems either have closed-form solutions or can be solved by fast solvers, which makes the ADMM particularly efficient. In theory, with the help of the smoothing technique and Kurdyka-Lojasiewicz function, we prove that the sequence generated by the ADMM converges to a stationary point when the penalty parameter is above a computable threshold. The numerical experiments illustrate that our proposed non-convex total variation model outperforms the existing convex and non-convex total variation models. (C) 2021 Elsevier Inc. All rights reserved.
A Bayesian Adaptive Weighted Total Generalized Variation Model for Image Restoration

Zhenbo Lu,Houqiang Li,Weiping Li

DOI: https://doi.org/10.1109/icip.2015.7350847

2015-01-01

Abstract:In recent years, the Total Generalized Variation (TGV) model has received lots of attention in image processing community. Though this model can restore image with natural intensity transitions, its spatial identical parameter setting limits its performance. In this paper, we propose a novel Adaptive Weighted Total Generalized Variation model for image restoration. We analyze the TGV model from Bayesian Probability view and derive a novel adaptive parameter calculation scheme for it, exploiting the image's self-similarity. Experiment results on image deblurring and reconstruction show that by adapting the parameters in TGV model to image contents, the proposed model can restore image's edges and details well and achieve significant improvement over state of the art variational based models.
Structurally Adaptive Multi-Derivative Regularization for Image Recovery from Sparse Fourier Samples

Sanjay Viswanath,Manu Ghulyani,Muthuvel Arigovindan

DOI: https://doi.org/10.48550/arXiv.2105.12775

2021-06-27

Abstract:The importance of regularization has been well established in image reconstruction -- which is the computational inversion of imaging forward model -- with applications including deconvolution for microscopy, tomographic reconstruction, magnetic resonance imaging, and so on. Originally, the primary role of the regularization was to stabilize the computational inversion of the imaging forward model against noise. However, a recent framework pioneered by Donoho and others, known as compressive sensing, brought the role of regularization beyond the stabilization of inversion. It established a possibility that regularization can recover full images from highly undersampled measurements. However, it was observed that the quality of reconstruction yielded by compressive sensing methods falls abruptly when the under-sampling and/or measurement noise goes beyond a certain threshold. Recently developed learning-based methods are believed to outperform the compressive sensing methods without a steep drop in the reconstruction quality under such imaging conditions. However, the need for training data limits their applicability. In this paper, we develop a regularization method that outperforms compressive sensing methods as well as selected learning-based methods, without any need for training data. The regularization is constructed as a spatially varying weighted sum of first- and canonical second-order derivatives, with the weights determined to be adaptive to the image structure; the weights are determined such that the attenuation of sharp image features -- which is inevitable with the use of any regularization -- is significantly reduced. We demonstrate the effectiveness of the proposed method by performing reconstruction on sparse Fourier samples simulated from a variety of MRI images.

Image and Video Processing
Compressive total variation for image reconstruction and restoration

Peng Li,Wengu Chen,Michael K. Ng

DOI: https://doi.org/10.1016/j.camwa.2020.05.006

2020-09-01

Abstract:In this paper, we make use of the fact that the matrix <math>u</math> is (approximately) low-rank in image inpainting, and the corresponding gradient transform matrices <math>Dxu,Dyu</math> are sparse in image reconstruction and restoration. Therefore we consider that these gradient matrices <math>Dxu,Dyu</math> also are (approximately) low-rank, and also verify it by numerical test and theoretical analysis. We propose a model called compressive total variation (CTV) to characterize the sparsity and low-rank prior knowledge of an image. In order to solve the proposed model, we design a concrete algorithm with provably convergence, which is based on inertial proximal ADMM. The performance of the proposed model is tested for magnetic resonance imaging (MRI) reconstruction, image denoising and image deblurring. The proposed method not only recovers edges of the image but also preserves fine details of the image. And our model is much better than the existing regularization models based on the TGV, Shearlet-TGV, <math>ℓ1−αℓ2</math>TV and BM3D in test for images with piecewise constant regions. And it visibly improves the performances of TV, <math>ℓ1−αℓ2</math>TV and TGV, and is comparable to Shearlet-TGV in test for natural images.

mathematics, applied
Image restoration via the adaptive T V p regularization

Zhi-Feng Pang,Ge Meng,Hui Li,Ke Chen

DOI: https://doi.org/10.1016/j.camwa.2020.04.030

2020-09-01

Abstract:To keep structures in the restoration problem is very important via coupling the local information of the image with the proposed model. In this paper we propose a local self-adaptive ℓ p -regularization model for p ∈ ( 0 , 2 ) based on the total variation scheme, where the choice of p depends on the local structures described by the eigenvalues of the structure tensor. Since the proposed model as the classic ℓ p problem unifies two classes of optimization problems such as the nonconvex and nonsmooth problem when p ∈ ( 0 , 1 ) , and the convex and smooth problem when p ∈ ( 1 , 2 ) , it is generally challenging to find a ready algorithmic framework to solve it. Here we propose a new and robust numerical method via coupling with the half-quadratic scheme and the alternating direction method of multipliers (ADMM). The convergence of the proposed algorithm is established and the numerical experiments illustrate the possible advantages of the proposed model and numerical methods over some existing variational-based models and methods.

mathematics, applied
Nonlocal Gradient Sparsity Regularization for Image Restoration

Hangfan Liu,Ruiqin Xiong,Xinfeng Zhang,Yongbing Zhang,Siwei Ma,Wen Gao

DOI: https://doi.org/10.1109/tcsvt.2016.2556498

IF: 5.859

2017-09-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Total variation (TV) regularization is widely used in image restoration to exploit the local smoothness of image content. Essentially, the TV model assumes a zero-mean Laplacian distribution for the gradient at all pixels. However, real-world images are nonstationary in general, and the zero-mean assumption of pixel gradient might be invalid, especially for regions with strong edges or rich textures. This paper introduces a nonlocal (NL) extension of TV regularization, which models the sparsity of the image gradient with pixelwise content-adaptive distributions, reflecting the nonstationary nature of image statistics. Taking advantage of the NL similarity of natural images, the proposed approach estimates the image gradient statistics at a particular pixel from a group of nonlocally searched patches, which are similar to the patch located at the current pixel. The gradient data in these NL similar patches are regarded as the samples of the gradient distribution to be learned. In this way, more accurate estimation of gradient is achieved. Experimental results demonstrate that the proposed method outperforms the conventional TV and several other anchors remarkably and produces better objective and subjective image qualities.

engineering, electrical & electronic
Iteratively refined nonlocal total variation regularization for Parallel variable density spiral imaging reconstruction

Sheng Fang,Wenchuan Wu,Hua Guo

DOI: https://doi.org/10.1109/ICNC.2013.6818195

2013-01-01

Abstract:Parallel variable density spiral imaging is an efficient fast imaging technique that combines spiral-based fast k-space acquisition and sensitivity encoding reconstruction of parallel imaging. However, due to its ill-conditioned system matrix, sensitivity encoding reconstruction can suffer from severe noise amplification or residual aliasing artifacts. To solve the problem, a regularized reconstruction that is based on iteratively refined nonlocal total variation regularization was proposed in this study. The proposed method extends current popular total variation to non-adjacent pixels and iteratively improves the results based on Bregman scheme. The phantom simulation and in vivo experiments results demonstrate that this method can effectively suppress noise amplification in sensitivity encoding reconstruction while preserving image details. Compared with conventional total variation regularized images, images reconstructed by the new method are free of staircase artifacts and suffer less from structure loss.
Sparse-view x-ray CT reconstruction via total generalized variation regularization

Shanzhou Niu,Yang Gao,Zhaoying Bian,Jing Huang,Wufan Chen,Gaohang Yu,Zhengrong Liang,Jianhua Ma

DOI: https://doi.org/10.1088/0031-9155/59/12/2997

IF: 3.5

2014-05-19

Physics in Medicine and Biology

Abstract:Sparse-view CT reconstruction algorithms via total variation (TV) optimize the data iteratively on the basis of a noise- and artifact-reducing model, resulting in significant radiation dose reduction while maintaining image quality. However, the piecewise constant assumption of TV minimization often leads to the appearance of noticeable patchy artifacts in reconstructed images. To obviate this drawback, we present a penalized weighted least-squares (PWLS) scheme to retain the image quality by incorporating the new concept of total generalized variation (TGV) regularization. We refer to the proposed scheme as 'PWLS-TGV' for simplicity. Specifically, TGV regularization utilizes higher order derivatives of the objective image, and the weighted least-squares term considers data-dependent variance estimation, which fully contribute to improving the image quality with sparse-view projection measurement. Subsequently, an alternating optimization algorithm was adopted to minimize the associative objective function. To evaluate the PWLS-TGV method, both qualitative and quantitative studies were conducted by using digital and physical phantoms. Experimental results show that the present PWLS-TGV method can achieve images with several noticeable gains over the original TV-based method in terms of accuracy and resolution properties.

engineering, biomedical,radiology, nuclear medicine & medical imaging
Total Variation with Overlapping Group Sparsity for Image Deblurring under Impulse Noise

Gang Liu,Ting-Zhu Huang,Jun Liu,Xiao-Guang Lv

DOI: https://doi.org/10.1371/journal.pone.0122562

IF: 3.7

2015-04-15

PLoS ONE

Abstract:The total variation (TV) regularization method is an effective method for image deblurring in preserving edges. However, the TV based solutions usually have some staircase effects. In order to alleviate the staircase effects, we propose a new model for restoring blurred images under impulse noise. The model consists of an ℓ1-fidelity term and a TV with overlapping group sparsity (OGS) regularization term. Moreover, we impose a box constraint to the proposed model for getting more accurate solutions. The solving algorithm for our model is under the framework of the alternating direction method of multipliers (ADMM). We use an inner loop which is nested inside the majorization minimization (MM) iteration for the subproblem of the proposed method. Compared with other TV-based methods, numerical results illustrate that the proposed method can significantly improve the restoration quality, both in terms of peak signal-to-noise ratio (PSNR) and relative error (ReE).

multidisciplinary sciences

Spatially Adaptive Total Variation Regularization Model for Interdisciplinary Imaging Recovery

Efficient Compressed Sensing Reconstruction Using Group Sparse Total Variation Regularization

A Wasserstein distance and total variation regularized model to image reconstruction problems

High-Order Total Variation-Based Image Restoration with Spatially Adapted Parameter Selection

Template-based CT Reconstruction with Optimal Transport and Total Generalized Variation

Construction Model for Total Variation Regularization Parameter

Image Restoration by Combined Order Regularization with Optimal Spatial Adaptation

Generalized nonconvex nonsmooth four-directional total variation with overlapping group sparsity for image restoration

Image restoration based on the minimax-concave and the overlapping group sparsity

Total variation image reconstruction algorithm based on non-convex function

Image restoration using total variation with overlapping group sparsity

High-order TVL1-based images restoration and spatially adapted regularization parameter selection.

An Efficient Non-Convex Total Variation Approach for Image Deblurring and Denoising

A Bayesian Adaptive Weighted Total Generalized Variation Model for Image Restoration

Structurally Adaptive Multi-Derivative Regularization for Image Recovery from Sparse Fourier Samples

Compressive total variation for image reconstruction and restoration

Image restoration via the adaptive T V p regularization

Nonlocal Gradient Sparsity Regularization for Image Restoration

Iteratively refined nonlocal total variation regularization for Parallel variable density spiral imaging reconstruction

Sparse-view x-ray CT reconstruction via total generalized variation regularization

Total Variation with Overlapping Group Sparsity for Image Deblurring under Impulse Noise