A Non-Convex Relaxation Approach to Sparse Dictionary Learning

Jianping Shi,Xiang Ren,Guang Dai,Jingdong Wang,Zhihua Zhang
DOI: https://doi.org/10.1109/cvpr.2011.5995592
2011-01-01
Computer Vision and Pattern Recognition
Abstract:Dictionary learning is a challenging theme in computer vision. The basic goal is to learn a sparse representation from an overcomplete basis set. Most existing approaches employ a convex relaxation scheme to tackle this challenge due to the strong ability of convexity in computation and theoretical analysis. In this paper we propose a non-convex online approach for dictionary learning. To achieve the sparseness, our approach treats a so-called minimax concave (MC) penalty as a nonconvex relaxation of the ℓ0 penalty. This treatment expects to obtain a more robust and sparse representation than existing convex approaches. In addition, we employ an online algorithm to adaptively learn the dictionary, which makes the non-convex formulation computationally feasible. Experimental results on the sparseness comparison and the applications in image denoising and image inpainting demonstrate that our approach is more effective and flexible.
What problem does this paper attempt to address?