Abstract:The emergence of holographic media drives the standardization of Geometry-based Point Cloud Compression (G-PCC) to sustain networked service provisioning. However, G-PCC inevitably introduces visually annoying artifacts, degrading the quality of experience (QoE). This work focuses on restoring G-PCC compressed point cloud attributes, e.g., RGB colors, to which fully data-driven and rules-unrolling-based post-processing filters are studied. At first, as compressed attributes exhibit nested blockiness, we develop a learning-based sample adaptive offset (NeuralSAO), which leverages a neural model using multiscale feature aggregation and embedding to characterize local correlations for quantization error compensation. Later, given statistically Gaussian distributed quantization noise, we suggest the utilization of a bilateral filter with Gaussian kernels to weigh neighbors by jointly considering their geometric and photometric contributions for restoration. Since local signals often present varying distributions, we propose estimating the smoothing parameters of the bilateral filter using an ultra-lightweight neural model. Such a bilateral filter with learnable parameters is called NeuralBF. The proposed NeuralSAO demonstrates the state-of-art restoration quality improvement, e.g., >20% BD-BR (Bjøntegaard delta rate) reduction over G-PCC on solid points clouds. However, NeuralSAO is computationally intensive and may suffer from poor generalization. On the other hand, although NeuralBF only achieves half of the gains of NeuralSAO, it is lightweight and exhibits impressive generalization across various samples. This comparative study between the data-driven large-scale NeuralSAO and the rules-unrolling-based small-scale NeuralBF helps to understand the capacity (i.e., performance, complexity, generalization) of underlying filters in terms of the quality restoration for compressed point cloud attribute.

Learning-Based Image Restoration for Compressed Image through Neighboring Embedding

Learning-based image restoration for compressed images

Blind restoration of compressed degraded image based on block effect suppression

Image reconstruction based on back propagation learning in Compressed Sensing theory

Compressed Image Restoration via External-Image Assisted Band Adaptive PCA Model Learning

Compressed Image Restoration Via Artifacts-Free PCA Basis Learning and Adaptive Sparse Modeling.

Low-Rank Decomposition-Based Restoration of Compressed Images via Adaptive Noise Estimation.

Learning-based Compression for Noisy Images in the Wild

Quality Adaptive Low-Rank Based JPEG Decoding with Applications

Learned Image Compression Using Adaptive Block-Wise Encoding and Reconstruction Network

Deep learning-based compressed image artifacts reduction based on multi-scale image fusion

Neural Compression-Based Feature Learning for Video Restoration

Restoration by Compression

Image Deblocking Via Group Sparsity Optimization

Coding Prior Based High Efficiency Restoration for Compressed Video.

An Efficient Deep Convolutional Neural Networks Model for Compressed Image Deblocking.

Learning to Restore Compressed Point Cloud Attribute: A Fully Data-Driven Approach and A Rules-Unrolling-Based Optimization

Image Restoration by Estimating Frequency Distribution of Local Patches

Deep-learning with context sensitive quantization and interpolation for underwater image compression and quality image restoration

Emphasizing Crucial Features for Efficient Image Restoration

Learning Content-Weighted Deep Image Compression