An Investigation on Semi-Blind Deconvolution by Using Nonlinear-Programming

L XU,PF YAN,T CHANG

1989-01-01

Chinese Science Bulletin

Abstract:The problem of using partial x(n) and (or) y(n) to solve thewhole x(n),y(n) from the convolved sequence z(n)=x(n)* y(n) is called Semi-blind Deconvolution (SBD) problem which is often encountered in many physical and engineering areas.

What problem does this paper attempt to address?

Multi-frame Blind Deconvolution Using Sparse Priors

Wende Dong,Huajun Feng,Zhihai Xu,Qi Li

DOI: https://doi.org/10.1016/j.optcom.2011.12.105

IF: 2.4

2012-01-01

Optics Communications

Abstract:In this paper, we propose a method for multi-frame blind deconvolution. Two sparse priors, i.e., the natural image gradient prior and an l1-norm based prior are used to regularize the latent image and point spread functions (PSFs) respectively. An alternating minimization approach is adopted to solve the resulted optimization problem. We use both gray scale blurred frames from a data set and some colored ones which are captured by a digital camera to verify the robustness of our approach. Experimental results show that the proposed method can accurately reconstruct PSFs with complex structures and the restored images are of high quality.
Identifiability of Multichannel Blind Deconvolution and Nonconvex Regularization Algorithm

Yu Xia,Song Li

DOI: https://doi.org/10.1109/tsp.2018.2866826

IF: 4.875

2018-01-01

IEEE Transactions on Signal Processing

Abstract:In this paper, we consider the multichannel blind deconvolution problem, where we observe the output of channels $\mathbf {h}_{i}\in \mathbb {R}^n$( $i=1,...,N$) that all convolve with the same unknown input signal $\mathbf {x}\in \mathbb {R}^n$ . We wish to estimate the input signal and blur kernels simultaneously. Existing theoretical results showed that the original inputs are identifiable under subspace assumptions. However, the subspaces discussed before were randomly or generically chosen. Here, we propose deterministic subspace assumption, which is widely used in practice, and give some theoretical results. First of all, we derive tight sufficient condition for identifiability of signal and convolution kernels, which is only violated on a set of Lebesgue measure zero. Then, we present a nonconvex regularization algorithm by a lifting method and approximate the rank-one constraint via the difference of nuclear norm and Frobenius norm. The global minimizer of the proposed nonconvex algorithm is rank-one matrix under mild conditions on parameters and noise level. The stability result is also shown under the assumption that the inputs lie in a compact set. Besides, the computation of our regularization model is carried out and any limit point of iterations converges to a stationary point of our model. Finally, we provide numerical experiments to show that our nonconvex regularization model outperforms convex relaxation models, such as nuclear norm minimization and some nonconvex methods, such as alternating minimization method and spectral method.
Blind Deconvolution Using an Improved L0 Sparse Representation

Ye Pengzhao,Feng Huajun,Li Qi,Xu Zhihai,Chen Yueting

DOI: https://doi.org/10.1117/12.2072142

2014-01-01

Abstract:In this paper, we present a method for single image blind deconvolution. Many common forms of blind deconvolution methods need to previously generate a salient image, while the paper presents a novel L0 sparse expression to directly solve the ill-positioned problem. It has no need to filter the blurred image as a restoration step and can use the gradient information as a fidelity term during optimization. The key to blind deconvolution problem is to estimate an accurate kernel. First, based on L2 sparse expression using gradient operator as a prior, the kernel can be estimated roughly and efficiently in the frequency domain We adopt the multi-scale scheme which can estimate blur kernel from coarser level to finer level. After the estimation of this level's kernel, L0 sparse representation is employed as the fidelity term during restoration. After derivation, L0 norm can be approximately converted to a sum term and L1 norm term which can be addressed by the Split-Bregman method. By using the estimated blur kernel and the TV deconvolution model, the final restoration image is obtained. Experimental results show that the proposed method is fast and can accurately reconstruct the kernel, especially when the blur is motion blur, defocus blur or the superposition of the two. The restored image is of higher quality than that of some of the art algorithms.
Lp (1≤p≤∞) BLIND ADAPTIVE DECONVOLUTION AND ITS APPLICATIONS

Wenyuan Xu,Mostafa Kaveh,Yuli You

DOI: https://doi.org/10.1016/s1474-6670(17)45346-8

1995-01-01

IFAC Proceedings Volumes

Abstract:The conditions for applying the convex cost functions, L1, Lp(P>1) and L∞ to the blind deconvolution of general non-minimum phase AR(u) models are studied. A simple and realizable constraint is proposed for the L∞ deconvolution. With this constraint, except for a gain, the model parameter is the unique solution of the L∞ deconvolution. The strong consistency of the estimator of the model parameter defined by the sample version of L∞ norm is presented. An adaptive algorithm is suggested for the iterative computation of the estimator. Simulation examples show the proposed approach works well for the blind equalization problem.
Non-blind image deconvolution using natural image gradient prior

Shuyin Tao,Wende Dong,Huajun Feng,Zhihai Xu,Qi Li

DOI: https://doi.org/10.1016/j.ijleo.2013.05.068

IF: 3.1

2013-01-01

Optik

Abstract:Since non-blind image deconvolution is inherently ill-posed, the results of unregularized methods are often contaminated by noise and ringing artifacts. To reach a stable solution, we adopt the natural image gradient prior to regularize the latent image and obtain an improved version of the Richardson–Lucy (RL) algorithm. We use both synthetic and real world blurred images to test the proposed method. Experimental results show that the negative artifacts are significantly suppressed and the restored images are of high quality.
Generalized variational framework with minimax optimization for parametric blind deconvolution

Qichao Cao,Deren Han,Xiangfeng Wang,Wenxing Zhang

DOI: https://doi.org/10.1088/1361-6420/ad2c30

IF: 2.408

2024-02-23

Inverse Problems

Abstract:Blind deconvolution (BD), which aims to separate unknown colvolved signals, is a fundamental problem in signal processing. Due to the ill-posedness and underdetermination of the convolution system, it is a challenging nonlinear inverse problem. This paper is devoted to the algorithmic studies of parametric BD, which is typically applied to recover images from ad hoc optical modalities. We propose a generalized variational framework for parametric BD with various priors and potential functions. By using the conjugate theory in convex analysis, the framework can be cast into a nonlinear saddle point problem. We employ the recent advances in minimax optimization to solve the parametric BD by the nonlinear primal-dual hybrid gradient method, with all subproblems admitting closed-form solutions. Numerical simulations on synthetic and real datasets demonstrate the compelling performance of the minimax optimization approach for solving parametric BD.

mathematics, applied,physics, mathematical
Blind Deconvolution using Convex Programming

Ali Ahmed,Benjamin Recht,Justin Romberg

DOI: https://doi.org/10.48550/arXiv.1211.5608

2018-06-24

Abstract:We consider the problem of recovering two unknown vectors, $\boldsymbol{w}$ and $\boldsymbol{x}$, of length $L$ from their circular convolution. We make the structural assumption that the two vectors are members of known subspaces, one with dimension $N$ and the other with dimension $K$. Although the observed convolution is nonlinear in both $\boldsymbol{w}$ and $\boldsymbol{x}$, it is linear in the rank-1 matrix formed by their outer product $\boldsymbol{w}\boldsymbol{x}^*$. This observation allows us to recast the deconvolution problem as low-rank matrix recovery problem from linear measurements, whose natural convex relaxation is a nuclear norm minimization program. We prove the effectiveness of this relaxation by showing that for "generic" signals, the program can deconvolve $\boldsymbol{w}$ and $\boldsymbol{x}$ exactly when the maximum of $N$ and $K$ is almost on the order of $L$. That is, we show that if $\boldsymbol{x}$ is drawn from a random subspace of dimension $N$, and $\boldsymbol{w}$ is a vector in a subspace of dimension $K$ whose basis vectors are "spread out" in the frequency domain, then nuclear norm minimization recovers $\boldsymbol{w}\boldsymbol{x}^*$ without error. We discuss this result in the context of blind channel estimation in communications. If we have a message of length $N$ which we code using a random $L\times N$ coding matrix, and the encoded message travels through an unknown linear time-invariant channel of maximum length $K$, then the receiver can recover both the channel response and the message when $L\gtrsim N+K$, to within constant and log factors.

Information Theory
Multichannel Sparse Blind Deconvolution on the Sphere

Yanjun Li,Yoram Bresler

DOI: https://doi.org/10.1109/tit.2019.2928576

IF: 2.5

2019-11-01

IEEE Transactions on Information Theory

Abstract:Multichannel blind deconvolution is the problem of recovering an unknown signal $f$ and multiple unknown channels $x_{i}$ from their circular convolution $y_{i}=x_{i} circledast f$ ( $i=1,2, {dots },N$ ). We consider the case where the $x_{i}$ 's are sparse, and convolution with $f$ is invertible. Our nonconvex optimization formulation solves for a filter $h$ on the unit sphere that produces sparse output $y_{i}circledast h$ . Under some technical assumptions, we show that all local minima of the objective function correspond to the inverse filter of $f$ up to an inherent sign and shift ambiguity, and all saddle points have strictly negative curvatures. This geometric structure allows successful recovery of $f$ and $x_{i}$ using a simple manifold gradient descent (MGD) algorithm. The same approach is also applicable to blind gain and phase calibration with a Fourier sensing matrix. Our algorithm and analysis require fewer assumptions than previous algorithms for the same problem. Our theoretical findings are complemented by numerical experiments, which demonstrate superior performance of the proposed approach over the previous methods. Empirically, our algorit-m has low computation cost (converging in a small number of iterations) and low memory footprint (solving only for the inverse filter of $f$ ).
Semiparametric Model And Superefficiency In Blind Deconvolution

Lq Zhang,S Amari,A Cichocki

DOI: https://doi.org/10.1016/S0165-1684(01)00146-3

IF: 4.729

2001-01-01

Signal Processing

Abstract:In this paper, we study convergence and efficiency of the batch estimator and natural gradient algorithm for blind deconvolution. First, the blind deconvolution problem is formulated in the framework of a semiparametric model, and a family of estimating functions is derived for blind deconvolution. To improve the learning efficiency of the online algorithm, explicit standardized estimating functions are given and within this framework the superefficiency of batch learning and online natural gradient learning is proven. (C) 2001 Elsevier Science B.V. All rights reserved.
Blind Image Deblurring Using Spectral Properties of Convolution Operators

Guangcan Liu,Shiyu Chang,Yi Ma

DOI: https://doi.org/10.1109/tip.2014.2362055

IF: 10.6

2014-01-01

IEEE Transactions on Image Processing

Abstract:Blind deconvolution is to recover a sharp version of a given blurry image or signal when the blur kernel is unknown. Because this problem is ill-conditioned in nature, effectual criteria pertaining to both the sharp image and blur kernel are required to constrain the space of candidate solutions. While the problem has been extensively studied for long, it is still unclear how to regularize the blur kernel in an elegant, effective fashion. In this paper, we show that the blurry image itself actually encodes rich information about the blur kernel, and such information can indeed be found by exploring and utilizing a well-known phenomenon, that is, sharp images are often high pass, whereas blurry images are usually low pass. More precisely, we shall show that the blur kernel can be retrieved through analyzing and comparing how the spectrum of an image as a convolution operator changes before and after blurring. Subsequently, we establish a convex kernel regularizer, which depends only on the given blurry image. Interestingly, the minimizer of this regularizer guarantees to give a good estimate to the desired blur kernel if the original image is sharp enough. By combining this powerful regularizer with the prevalent nonblind devonvolution techniques, we show how we could significantly improve the deblurring results through simulations on synthetic images and experiments on realistic images.
Semiparametric Approach to Multichannel Blind Deconvolution of Nonminimum Phase Systems

LQ Zhang,S Amari,A Cichocki

1999-01-01

Abstract:In this paper we discuss the semiparametric statistical model for blind deconvolution. First we introduce a Lie Group to the manifold of non-causal FIR filters. Then blind deconvolution problem is formulated in the framework of a semiparametric model, and a family of estimating functions is derived for blind deconvolution. A natural gradient learning algorithm is developed for training noncausal filters. Stability of the natural gradient algorithm is also analyzed in this framework.
Blind Deconvolution for Symmetric Point-spread Functions

Yifei Lou,Bin Zhang,Jing Wang,Ming Jiang

DOI: https://doi.org/10.1109/iembs.2005.1617223

2005-01-01

Abstract:Blind deconvolution is to restore a blurred image without full information of the associated point-spread function (PSF). One recent method is to formulate an equation with only the image as unknowns by eliminating the PSF because of its symmetric property. The original image is then recovered by solving the latter equation. We present a theoretical analysis for this method in this paper. After formulating the problem in terms of the Z-transforms, it is proved that the deconvolved solutions with this method are up to a constant under additional practical assumptions on the images. We also provide a preliminary numerical experiment with a practical phantom to demonstrate the feasibility of this method.
Rapid, Robust, and Reliable Blind Deconvolution Via Nonconvex Optimization

Xiaodong Li,Shuyang Ling,Thomas Strohmer,Ke Wei

DOI: https://doi.org/10.1016/j.acha.2018.01.001

IF: 2.974

2016-01-01

Applied and Computational Harmonic Analysis

Abstract:We study the question of reconstructing two signals f and g from their convolution y=f⁎g. This problem, known as blind deconvolution, pervades many areas of science and technology, including astronomy, medical imaging, optics, and wireless communications. A key challenge of this intricate non-convex optimization problem is that it might exhibit many local minima. We present an efficient numerical algorithm that is guaranteed to recover the exact solution, when the number of measurements is (up to log-factors) slightly larger than the information-theoretical minimum, and under reasonable conditions on f and g. The proposed regularized gradient descent algorithm converges at a geometric rate and is provably robust in the presence of noise. To the best of our knowledge, our algorithm is the first blind deconvolution algorithm that is numerically efficient, robust against noise, and comes with rigorous recovery guarantees under certain subspace conditions. Moreover, numerical experiments do not only provide empirical verification of our theory, but they also demonstrate that our method yields excellent performance even in situations beyond our theoretical framework.
Adaptive Multichannel Blind Deconvolution Using State-Space Models

andrzej cichocki,liqing zhang

DOI: https://doi.org/10.1109/HOST.1999.778746

1999-01-01

Abstract:Multichannel blind deconvolution is an important task for numerous applications, especially in biomedical signal processing, wireless communications and geophysics. In this paper both linear and nonlinear state space models for blind and semi-blind deconvolution are proposed. New unsupervised adaptive learning algorithms performing extended linear multichannel blind deconvolution are developed. For nonlinear mixture Hyper Radial Basis Function (HRBF) neural network is employed and associated supervised unsupervised learning rules for its parameters are developed. Computer simulation experiments confirm validity and good performance of the developed models and associated learning algorithms.
Multichannel Blind Deconvolution Using A Novel Filter Decomposition Method

Bin Xia,Liqing Zhang

DOI: https://doi.org/10.1007/11759966_178

2006-01-01

Abstract:In our previous work [11], we introduced a filter decomposition method for blind deconvolution in non-minimum phase system. To simplify the deconvolution procedure, we further study the demixing filter and modify the cascade structure of demixing filter. In this paper, we introduce a novel two-stage algorithm for blind deconvolution. In first stage, we present a permutable cascade structure which constructed by a causal filter and an anti-causal scalar filter. Then, we develop SOS-based algorithm for causal filter and derive a natural gradient algorithm for anti-causal scalar filter. At second stage, we apply an instantaneous ICA algorithm to eliminate the residual instantaneous mixtures. Computer simulations show the validity and effectiveness of this approach.
Spectral Semi-Blind Deconvolution Methods Based on Modified Φ Regularizations

Hu Zhu,Lizhen Deng,Guoxia Xu,Yixiang Chen,Yujie Li

DOI: https://doi.org/10.1016/j.optlastec.2018.01.046

2019-01-01

Abstract:Deconvolution method has been widely used for spectral resolution enhancement. In order to preserve the detailed information and suppress noise better, trimmed phi(HS) regularization and weighted phi(HS) regularization are proposed in this paper. Then the semi-blind deconvolution methods with trimmed co ns regularization (SBD-THS) and with weighted phi(HS )regularization (SBD-WHS) are presented. The results of deconvolving simulated degraded spectra and real experiment spectra demonstrate that SBD-THS and SBD-WHS can enhance spectral resolution effectively while estimating the parameter of blur kernel accurately. In particular, SBD-WHS can produce great performance on preserving local details and suppressing noise. (C) 2018 Elsevier Ltd. All rights reserved.
Fundamental Limits of Blind Deconvolution Part II: Sparsity-Ambiguity Trade-offs

Sunav Choudhary,Urbashi Mitra

DOI: https://doi.org/10.1109/TSP.2018.2815014

2015-03-11

Abstract:Blind deconvolution is an ubiquitous non-linear inverse problem in applications like wireless communications and image processing. This problem is generally ill-posed since signal identifiability is a key concern, and there have been efforts to use sparse models for regularizing blind deconvolution to promote signal identifiability. Part I of this two-part paper establishes a measure theoretically tight characterization of the ambiguity space for blind deconvolution and unidentifiability of this inverse problem under unconstrained inputs. Part II of this paper analyzes the identifiability of the canonical-sparse blind deconvolution problem and establishes surprisingly strong negative results on the sparsity-ambiguity trade-off scaling laws. Specifically, the ill-posedness of canonical-sparse blind deconvolution is quantified by exemplifying the dimension of the unidentifiable signal sets. An important conclusion of the paper is that canonical sparsity occurring naturally in applications is insufficient and that coding is necessary for signal identifiability in blind deconvolution. The methods developed herein are applied to a second-hop channel estimation problem to show that a family of subspace coded signals (including repetition coding and geometrically decaying signals) are unidentifiable under blind deconvolution.

Information Theory
Deconvolution Methods Based on Convex Regularization for Spectral Resolution Enhancement

Hu Zhu,Lizhen Deng,Haibo Li,Yujie Li

DOI: https://doi.org/10.1016/j.compeleceng.2018.02.004

IF: 4.152

2018-01-01

Computers & Electrical Engineering

Abstract:Spectral resolution enhancement is essential for spectral analysis and assignment. In this study, a regularization term in form of a convex function φHS is included in the spectral deconvolution model to enhance spectral resolution. Based on the regularization term, a non-blind deconvolution (NBD) method is proposed, and to improve feasibility in practice, a semi-blind deconvolution (SBD) method is also presented. Simulation and experimental results demonstrate that both methods enhance spectral resolution effectively. When the blur kernel is known accurately, NBD achieves better performance than SBD. In other cases, the latter achieves better results.
Research on Single-Channel Blind Deconvolution Algorithm of Single Mixed Image

Ting Liu,Tiantian Yin,Yina Guo

DOI: https://doi.org/10.1007/978-3-030-73103-8_62

2021-01-01

Abstract:Single-channel bland deconvolution which aims to separate and deconvolve individual sources from a mixture is a challenging problem due to the lack of the prior knowledge of mixing matrix. In this paper, we proposed a single-channel blind deconvolution (SCBD) approach to solve the problem of source separation and deconvolution. In this approach, a generative model for sources is built using a deep convolutional generative adversarial network (DCGAN), and both sources and mixing matrix are optimized. The experiment is conducted on image datasets to show that the algorithm has the best performance in single-channel bland deconvolution and achieves a peak-to-noise-ratio (PSNR) of 14.5 dB in separation and deconvolution.
Nonnegative Bounded Convolutional Sparse Learning Method for Envelope Feature Deconvolution.

Zhaohui Du,Xuefeng Chen,Han Zhang,Yixin Yang

DOI: https://doi.org/10.1109/tim.2020.2998564

IF: 5.6

2020-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:This article considers the problem of extracting periodic envelope features from observation signals modulated by subcritically damped mechanical systems. Due to insufficient envelope structure descriptions, popular two-stage blind deconvolution techniques incur a significant performance degradation in envelope feature deconvolution tasks. Leveraging sparse learning framework, a nonnegative bounded convolutional sparse learning model (NBconvSLM), is then proposed to address it in this article, and meanwhile, a nonconvex multiblock alternating direction method of multiplier (ADMM) solver is developed to rapidly achieve satisfying deconvolutional solutions. The main highlight of NBconvSLM is that nonnegative sparse regularizer is exploited to effectively describe envelope feature structure, and bounded regularizer is further introduced to sufficiently mitigate deconvolutional envelope amplitude enlargement problem. Regularizer’ roles are verified through a set of numerical experiments. Meanwhile, algorithmic performance and superiority are profoundly evaluated with respect to state-of-the-art deconvolutional techniques. Engineering application to generator bearing fault detection further corroborates algorithmic effectiveness in latent periodic feature recognition.

An Investigation on Semi-Blind Deconvolution by Using Nonlinear-Programming

Multi-frame Blind Deconvolution Using Sparse Priors

Identifiability of Multichannel Blind Deconvolution and Nonconvex Regularization Algorithm

Blind Deconvolution Using an Improved L0 Sparse Representation

Lp (1≤p≤∞) BLIND ADAPTIVE DECONVOLUTION AND ITS APPLICATIONS

Non-blind image deconvolution using natural image gradient prior

Generalized variational framework with minimax optimization for parametric blind deconvolution

Blind Deconvolution using Convex Programming

Multichannel Sparse Blind Deconvolution on the Sphere

Semiparametric Model And Superefficiency In Blind Deconvolution

Blind Image Deblurring Using Spectral Properties of Convolution Operators

Semiparametric Approach to Multichannel Blind Deconvolution of Nonminimum Phase Systems

Blind Deconvolution for Symmetric Point-spread Functions

Rapid, Robust, and Reliable Blind Deconvolution Via Nonconvex Optimization

Adaptive Multichannel Blind Deconvolution Using State-Space Models

Multichannel Blind Deconvolution Using A Novel Filter Decomposition Method

Spectral Semi-Blind Deconvolution Methods Based on Modified Φ Regularizations

Fundamental Limits of Blind Deconvolution Part II: Sparsity-Ambiguity Trade-offs

Deconvolution Methods Based on Convex Regularization for Spectral Resolution Enhancement

Research on Single-Channel Blind Deconvolution Algorithm of Single Mixed Image

Nonnegative Bounded Convolutional Sparse Learning Method for Envelope Feature Deconvolution.