Abstract:With the development of 3D display and interactive multimedia systems, new 3D video applications, such as 3DTV and Free Viewpoint Video, are attracting significant interests. In order to enable these new applications, new data formats including captured 2D video sequences and corresponding depth maps have been proposed. Compared to conventional video frames, depth maps have very different characteristics. First, they typically consist of homogeneous areas partitioned by sharp edges representing depth discontinuities, while the sharp discontinuities play very important roles in view rendering. Second, there exists structure similarity between depth map and corresponding video, in which the edges in depth exhibit quite similar behaviors as the edges in the corresponding video. In conventional video coding techniques with transforms followed by quantization, there usually exist large artifacts along sharp edges and it costs significant more bits to represent the edges with higher accuracy. In order to suppress the coding artifacts while preserving edges, and to better compress depth information, we propose in this paper two new depth compression techniques: Trilateral Filter and Sparse Dyadic Mode. Both techniques utilize the structure similarity between depth and corresponding video while focusing on different aspects in depth compression. As a new in-loop filter, Trilateral Filter is designed to filter depth with coding artifacts based on the proximity of pixel positions, the similarity among depth samples, as well as the similarity among the collocated pixels in the video frame. While Sparse Dyadic Mode is used as an intra mode to reconstruct depth map with sparse representations of depth blocks and effective reference of edge information from video frames. With these two new coding tools, we can achieve up to about 1.5 dB gain on rendering quality as compared to depth sequences coded using MVC under the same coding rate.

3D-Spatial-texture Bilateral Filter for Depth-Based 3D Video

Depth filter design by jointly utilizing spatial-temporal depth and texture information

Bilateral normal filtering for mesh denoising.

Hierarchical Joint Bilateral Filtering for Depth Post-Processing

Efficient intra coding algorithm for depth map in 3D video

Efficient depth coding in 3D video to minimize coding bitrate and complexity

Joint Trilateral Filtering For Depth Map Compression

A new bilateral filter for post-removing the noise of synthesis view in 3D video.

Candidate Value-Based Boundary Filtering for Compressed Depth Images

Research of 3D Reconstruction and Filtering Algorithm Based on Depth Information of Kinect

An Asymmetric Edge Adaptive Filter for Depth Generation and Hole Filling in 3DTV

Depth super resolution using bilateral filter

Accurate Depth-of-Field Rendering Using Adaptive Bilateral Depth Filtering.

Bi-dimensional Variational Mode Decomposition for Surface Texture Analysis

Consistent Depth Maps Recovery from a Trinocular Video Sequence.

A Modified Joint Trilateral Filter Based Depth Map Refinement Method

New Depth Coding Techniques With Utilization of Corresponding Video

SynBF: A New Bilateral Filter for Postremoval of Noise from Synthesis Views in 3-D Video

Recursive Bilateral Filter for Encoder-Integrated Video Denoising.

Two-Pass Bilateral Smooth Filtering for Remote Sensing Imagery

Blind Assessment for Stereo Images Considering Binocular Characteristics and Deep Perception Map Based on Deep Belief Network