Abstract:Transmitting compactly represented geometry of a dynamic 3D scene from a sender can enable a multitude of imaging functionalities at a receiver, such as synthesis of virtual images at freely chosen viewpoints via depth-image-based rendering. While depth maps—projections of 3D geometry onto 2D image planes at chosen camera viewpoints-can nowadays be readily captured by inexpensive depth sensors, they are often corrupted by non-negligible acquisition noise. Given depth maps need to be denoised and compressed at the encoder for efficient network transmission to the decoder, in this paper, we consider the denoising and compression problems jointly, arguing that doing so will result in a better overall performance than the alternative of solving the two problems separately in two stages. Specifically, we formulate a rate-constrained estimation problem, where given a set of observed noise-corrupted depth maps, the most probable (maximum a posteriori (MAP)) 3D surface is sought within a search space of surfaces with representation size no larger than a prespecified rate constraint. Our rate-constrained MAP solution reduces to the conventional unconstrained MAP 3D surface reconstruction solution if the rate constraint is loose. To solve our posed rate-constrained estimation problem, we propose an iterative algorithm, where in each iteration the structure (object boundaries) and the texture (surfaces within the object boundaries) of the depth maps are optimized alternately. Using the MVC codec for compression of multiview depth video and MPEG free viewpoint video sequences as input, experimental results show that rate-constrained estimated 3D surfaces computed by our algorithm can reduce coding rate of depth maps by up to 32% compared with unconstrained estimated surfaces for the same quality of synthesized virtual views at the decoder.

A Novel Video Denoising Method Based on Surfacelet Transform

Mean Shift Denoising of Point-Sampled Surfaces

A Novel Segmentation Based Video-Denoising Method with Noise Level Estimation

A novel video fusion framework using surfacelet transform

Video Denoising Using Shape-Adaptive Sparse Representation over Similar Spatio-Temporal Patches

An automatic 2D to 3D conversion algorithm using multi-depth cues

3-D nonlocal means filter with noise estimation for hyperspectral imagery denoising

A new video denoising method using texture metric and adaptive structure variance

A Practical Video Denoising Method Based on Hierarchical Motion Estimation

Multi-view image denoising based on graphical model of surface patch

DSTnet: a new discrete shearlet transform-based CNN model for image denoising

A 2D image 3D reconstruction function adaptive denoising algorithm

VIDOSAT: High-dimensional Sparsifying Transform Learning for Online Video Denoising

A New Non-Local Video Denoising Scheme Using Low-Rank Representation and Total Variation Regularization

Multiscale Representation of Surfaces by Tight Wavelet Frames with Applications to Denoising

Nonlocal-based tensor-average-rank minimization and tensor transform-sparsity for 3D image denoising

Image Denoising Via Adaptive Soft-Thresholding Based on Non-Local Samples

Adaptive Denoising by Singular Value Decomposition

A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction

Provable deep video denoiser using spatial-temporal information for video snapshot compressive imaging: Algorithm and convergence analysis

Rate-constrained 3D surface estimation from noise-corrupted multiview depth videos