Abstract:Depth map super resolution has been paid much attention in 3D applications due to the limitation of depth sensors. Few textures in objects with clear contours along them is the most important characteristic of depth map. An efficient image representation should be directional, multiscale and anisotropic. From this we propose a novel multiscale and multidirection depth map super resolution framework with semantic inference to improve the quality of depth maps. In this framework, a multiscale and multidirection depth map contour fusion scheme captures and assembles intrinsic geometrical structures through a multiview non-subsampled contourlet transform manner. This scheme not only isolates the discontinuities of contours but retains the smoothness along the contours. The semantic inference is also utilized to segment and label the depth map into objects/backgrounds-level which are coplanar. Furthermore, a semantic-aware label refinement strategy is introduced to correct the rarely inaccurate labels of the label map for upscaling the target pixel with pixels in the same object or background. Experimental results on benchmark depth map dataset demonstrate that the proposed multiscale and multidirection depth map super resolution framework with semantic inference has a significant improvement than the state-of-the-art algorithms both visually and quantitatively.

Single Depth Map Super-resolution with Local Self-similarity

Depth Image Super-resolution via Two-Branch Network

Single Depth Map Super-Resolution Via Joint Non-Local Self-Similarity Modeling and Local Multi-Directional Gradient-Guided Regularization

Joint Nonlocal Sparse Representation for Depth Map Super-Resolution

Depth map enhancement based on color and depth consistency

Single Depth Map Super-Resolution Via Joint Non-Local and Local Modeling

Depth Map Super-Resolution Via Learned Nonlocal Model and Enhanced Local Regularization

Depth Map Super-Resolution Based on Joint Dictionary Learning

Reconstructing Sparsely Represented High-resolution Depth Map from Corrupted Samples

Depth Map Super-Resolution Via Joint Local Gradient and Nonlocal Structural Regularizations

Guided Depth Map Super-Resolution Using Recumbent Y Network

Joint Example-Based Depth Map Super-Resolution

Depth Upsampling Method Via Markov Random Fields Without Edge-Misaligned Artifacts

Multiscale and Multidirection Depth Map Super Resolution with Semantic Inference

Edge-guided Single Facial Depth Map Super-Resolution Using CNN.

A Joint Learning-Based Method for Multi-view Depth Map Super Resolution

Depth Map Super-Resolution and Enhancement for Time-Of-Flight Cameras

Depth Maps Enhancement Using Nonlocal Self-similarity Based on the Sparse Representation

Deep Depth Graph Super Resolution Sampling Based on Depth Learning

Color Guided Depth Map Super-Resolution with Nonlocla Autoregres-Sive Modeling

From Deep Image Decomposition to Single Depth Image Super-Resolution