Image inpainting based on sparse representation using self-similar joint sparse coding
Lei Zhang,Minhui Chang,Rui Chen
DOI: https://doi.org/10.1007/s11042-023-14337-w
IF: 2.577
2023-01-11
Multimedia Tools and Applications
Abstract:In order to improve the sparse coding ability of over-complete dictionary and take advantage of the similarity between damaged pixels and their neighbors, we propose an inpainting method based on sparse representation using self-similar joint sparse coding. First, we perform singular value decomposition on the gradient vector of the image patches, and then divide the image patches into three categories: smooth patches, edge patches and texture patches according to the relationship between the primary direction and the secondary direction. Second, we use the KSVD method to train these three types of image patches respectively, and obtain three over-complete dictionaries that adapt to different local features. Third, we define a non-local self-similar matching function and use it to search for the most similar image patch to the current patch in the target region, and then use the similar patch and the current patch for joint sparse coding. Finally, we use the calculated sparse coding and the corresponding over-complete dictionary to reconstruct the current patch. A series of experimental results show that the self-similar joint sparse coding we proposed can not only improve the restoration effect of sparse representation methods to a certain extent, but also has good adaptability and can be combined with other sparse representation methods to improve their restoration effect.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering