Abstract:Depth image compression is important for compact representation of 3D visual data in texture-plus-depth format, where texture and depth maps from one or more viewpoints are encoded and transmitted. A decoder can then synthesize a freely chosen virtual view via depth-image-based rendering using nearby coded texture and depth maps as reference. Further, depth information can be used in other image processing applications beyond view synthesis, such as object identification, segmentation, and so on. In this paper, we leverage on the observation that neighboring pixels of similar depth have similar motion to efficiently encode depth video. Specifically, we divide a depth block containing two zones of distinct values (e.g., foreground and background) into two arbitrarily shaped regions (sub-blocks) along the dividing boundary before performing separate motion prediction (MP). While such arbitrarily shaped sub-block MP can lead to very small prediction residuals (resulting in few bits required for residual coding), it incurs an overhead to transmit the dividing boundaries for sub-block identification at decoder. To minimize this overhead, we first devise a scheme called arithmetic edge coding (AEC) to efficiently code boundaries that divide blocks into sub-blocks. Specifically, we propose to incorporate the boundary geometrical correlation in an adaptive arithmetic coder in the form of a statistical model. Then, we propose two optimization procedures to further improve the edge coding performance of AEC for a given depth image. The first procedure operates within a code block, and allows lossy compression of the detected block boundary to lower the cost of AEC, with an option to augment boundary depth pixel values matching the new boundary, given the augmented pixels do not adversely affect synthesized view distortion. The second procedure operates across code blocks, and systematically identifies blocks along an object contour that should be coded using sub-block MP via a rate-distortion optimized trellis. Experimental results show an average overall bitrate reduction of up to 33% over classical H.264/AVC.

Adaptive Block Size Selection for Inter-Layer Backward View Synthesis Prediction

Inverse Transform Architecture for VC1 Adaptive Block Size

Asymmetric Bidirectional View Synthesis for Free Viewpoint and Three-Dimensional Video

Adaptive motion vector resolution prediction in block-based video coding

Smoothed Reference Inter-Layer Texture Prediction For Bit Depth Scalable Video Coding

Depth Assisted Adaptive Workload Balancing for Parallel View Synthesis

Interweaved Prediction for Video Coding.

A 16-Pixel Parallel Architecture with Block-Level/mode-level Co-Reordering Approach for Intra Prediction in 4k&#x00d7;2k H.264/AVC Video Encoder

Macroblock-Based Adaptive In-Scale Prediction for Scalable Video Coding.

Multiple Resolution Prediction With Deep Up-Sampling for Depth Video Coding

Adaptive Weighted Bi-Prediction Based on Template Similarity in Video Coding

A Predictive Block-Size Mode Selection for Inter Frame in H.264

Variable block size prediction for Wyner-Ziv video coding using structure similarity

A hybrid pixel-block based view synthesis for multiviewpoint 3D video

Arbitrarily shaped motion prediction for depth video compression using arithmetic edge coding

Hierarchical Block Size Decision for H.264/AVC Intra Prediction

Intra Coding for Depth Maps Using Adaptive Boundary Location

Bi-Intra Prediction for Versatile Video Coding

Synergistic Temporal-Spatial User-Aware Viewport Prediction for Optimal Adaptive 360-Degree Video Streaming

Enhanced Block Prediction In Stereoscopic Video Coding

Adaptive view synthesis optimization for low complexity 3D-HEVC encoding.