Abstract:Depth information is being widely used in many real-world applications. However, due to the limitation of depth sensing technology, the captured depth map in practice usually has much lower resolution than that of color image counterpart. In this paper, we propose to combine the internal smoothness prior and external gradient consistency constraint in graph domain for depth super-resolution. On one hand, a new graph Laplacian regularizer is proposed to preserve the inherent piecewise smooth characteristic of depth, which has desirable filtering properties. A specific weight matrix of the respect graph is defined to make full use of information of both depth and the corresponding guidance image. On the other hand, inspired by an observation that the gradient of depth is small except at edge separating regions, we introduce a graph gradient consistency constraint to enforce that the graph gradient of depth is close to the thresholded gradient of guidance. We reinterpret the gradient thresholding model as variational optimization with sparsity constraint. In this way, we remedy the problem of structure discrepancy between depth and guidance. Finally, the internal and external regularizations are casted into a unified optimization framework, which can be efficiently addressed by ADMM. Experimental results demonstrate that our method outperforms the state-of-the-art with respect to both objective and subjective quality evaluations.

Single Depth Map Super-Resolution Via Joint Non-Local Self-Similarity Modeling and Local Multi-Directional Gradient-Guided Regularization

Single Depth Map Super-Resolution Via Joint Non-Local and Local Modeling

Depth Map Super-Resolution Via Joint Local Gradient and Nonlocal Structural Regularizations

Depth Map Super-Resolution Via Learned Nonlocal Model and Enhanced Local Regularization

Depth Image Super-resolution via Two-Branch Network

Joint Nonlocal Sparse Representation for Depth Map Super-Resolution

Color-guided Depth Map Super-Resolution Via Joint Graph Laplacian and Gradient Consistency Regularization

Depth Super-Resolution Via Joint Color-Guided Internal and External Regularizations

Color Guided Depth Map Super-Resolution with Nonlocla Autoregres-Sive Modeling

Single Depth Map Super-resolution with Local Self-similarity

Depth Map Super-Resolution Via Local and Nonlocal Priors

Depth Map Super‐resolution Via Shape‐adaptive Non‐local Regression and Direction‐based Local Smoothness

Guided Depth Map Super-Resolution Using Recumbent Y Network

Depth Super-Resolution from RGB-D Pairs with Transform and Spatial Domain Regularization.

Image Guided Depth Map Superresolution Using Non-Local Total Generalized Variation

A Joint Learning-Based Method for Multi-view Depth Map Super Resolution

Super-Resolution for Monocular Depth Estimation with Multi-Scale Sub-Pixel Convolutions and a Smoothness Constraint.

Multi-Scale Frequency Reconstruction for Guided Depth Map Super-Resolution Via Deep Residual Network

Super resolution of single depth image based on multi-dictionary learning with edge feature regularization

Depth Image Super Resolution Via Semi Self-Taught Learning Framework

Single Depth Image Super-Resolution Using Convolutional Neural Networks