Abstract:Hole filling of depth maps is a core technology of the Kinect based visual system. In this paper, we propose a hole filling algorithm for Kinect depth maps based on separately repairing of the foreground and background. There are two-part processing in the proposed algorithm. Firstly, a fast pre-processing to the Kinect depth map holes is performed. In this part, we fill the background holes of Kinect depth maps with the deepest depth image which is constructed by combining the spatio-temporal information of the pixels in Kinect depth map with the corresponding color information in the Kinect color image. The second step is the enhancement for the pre-processing depth maps. We propose a depth enhancement algorithm based on the joint information of geometry and color. Since the geometry information is more robust than the color, we correct the depth by affine transform in prior to utilizing the color cues. Then we determine the filter parameters adaptively based on the local features of the color image which solves the texture copy problem and protects the fine structures. Since L1 norm optimization is more robust to data outliers than L2 norm optimization, we force the filtered value to be the solution for L1 norm optimization. Experimental results show that the proposed algorithm can protect the intact foreground depth, improve the accuracy of depth at object edges, and eliminate the flashing phenomenon of depth at objects edges. In addition, the proposed algorithm can effectively fill the big depth map holes generated by optical reflection.

Spatial-temporal depth de-noising for Kinect based on texture edge-assisted depth classification

Guided depth enhancement via a fast marching method

Guided inpainting and filtering for Kinect depth maps

Depth dithering based on texture edge-assisted classification

Depth Map Inpainting Using a Fully Convolutional Network

Depth map enhancement based on color and depth consistency

High Accuracy Hole Filling for Kinect Depth Maps

Kinect Depth Recovery Using a Color-Guided, Region-Adaptive, and Depth-Selective Framework

Real-time Depth Extraction and Multi-View Rendering Algorithm Based on Kinect

Depth-color fusion strategy for 3-D scene modeling with Kinect

Depth Upsampling Method Via Markov Random Fields Without Edge-Misaligned Artifacts

A weighted least squares algorithm for time-of-flight depth image denoising

Ddrnet: Depth Map Denoising And Refinement For Consumer Depth Cameras Using Cascaded Cnns

Iterative Error Removal for Time-of-Flight Depth Imaging

Data Driven Robust Image Guided Depth Map Restoration

Defogging Kinect: Simultaneous Estimation of Object Region and Depth in Foggy Scenes

Depth Map Denoising Using Graph-Based Transform and Group Sparsity

DELTAR: Depth Estimation from a Light-Weight ToF Sensor and RGB Image

Reconstructing Sparsely Represented High-resolution Depth Map from Corrupted Samples

Quick Matting for Videos Based on Depth Images of the Kinect

Calibration of depth cameras using denoised depth images