Super resolution of single depth image based on multi-dictionary learning with edge feature regularization
Sihan Li,Anhong Wang,Hong Shangguan,Yingchun Wu,Donghong Li,Youcheng Wu,Jie Liang
DOI: https://doi.org/10.1007/s11042-019-08500-5
IF: 2.577
2020-01-11
Multimedia Tools and Applications
Abstract:Currently, the acquisition and application of depth images are attracting a lot of attention thanks to the rapid development of 3D video. However, the current depth cameras cannot obtain high quality depth images due to the limitations in the imaging system. In this paper, to address this issue, we propose a scheme for single depth image super resolution based on multi-dictionary learning with edge regularization model. In the training stage, we focus on the edge information that represents the structure of the image, and extract the edge part, the low frequency and high frequency parts from the high resolution depth image set respectively. After that, three dictionaries are learned for the three parts with the constraint of the same sparse representation. In the image synthesis stage, we employ an edge-preserving regularization model as a reconstruction constraint to preserve the sharp structure, and reconstruct the depth image via the dictionaries learned from the training stage. Experimental results show that our proposed method can achieve good results in edge preservation, and both PSNR and SSIM values of the reconstructed depth images are superior to the state-of-art methods.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering