Abstract:Point cloud-based immersive media representation format has provided many opportunities for extended reality applications and has become widely used in volumetric content capturing scenarios. The high data rate of the point cloud is one of the key problems preventing the adoption of this media format. MPEG Immersive media working group (MPEG-I) aims to create a point cloud compression methodology relying on the existing video coding hardware implementations to solve this problem. However, in the scope of the state-of-the-art video-based dynamic point cloud compression (V-PCC) standard under MPEG-I, the intrinsic 3D object's motion continuity is destroyed by the 2D projections, resulting in a significant loss of inter prediction coding efficiency. In this paper, we first propose a general model utilizing the 3D motion and 3D to 2D correspondence to calculate the 2D motion vector (MV). Then, under the V-PCC, we propose a geometry-based method using the accurate 3D reconstructed geometry from the 2D geometry video to estimate the 2D MV in the 2D attribute video. In addition, we propose an auxiliary-information-based method using the coarse 3D reconstructed geometry provided by the auxiliary information to estimate the 2D MV in both the 2D geometry and attribute videos. Furthermore, we provide the following two ways to use the estimated 2D MV to improve coding efficiency. The first one is normative. We propose adding the estimated MV into the advanced MV candidate list and find a better MV predictor for each prediction unit (PU). The second one is non-normative. We propose applying the estimated MV as an additional candidate of the centers for motion estimation. We implement the proposed algorithms in the V-PCC reference software. Experimental results show that the proposed methods present significant coding gains compared with the current state-of-the-art motion prediction algorithm.

Macropixel-constrained Collocated Position Search for Plenoptic Video Coding

Macropixel Based Fast Motion Estimation for Plenoptic Video Compression.

Plenoptic Image Coding Using Macropixel-Based Intra Prediction

Lenslet Image Compression Using Adaptive Macropixel Prediction

Microimage-based Two-step Search For Plenoptic 2.0 Video Coding

Imaging-Correlated Intra Prediction for Plenoptic 2.0 Video Coding

Fractional Pixel Motion Estimation Based on Prediction of Flat Regions for H.264

Efficient Content Adaptive Plenoptic Video Coding

Plenoptic 2.0 Intra Coding Using Imaging Principle

Plenoptic Point Cloud Compression Using Multiview Extension of High Efficiency Video Coding

Zoomable intra prediction for multi-focus plenoptic 2.0 video coding

Lenslet Image Compression Based on Image Reshaping and Macro-Pixel Intra Prediction

Macroblock-Level Adaptive Search Range Algorithm for Motion Estimation in Multiview Video Coding

Selective VS-MRF-ME and intra coding in H.264 based on spatiotemporal continuity of motion field

An Efficient Compression Coding System for Motion Images

Multi-view Video Coding Based on View Prediction

Pixel Gradient Based Zooming Method for Plenoptic Intra Prediction

Image Reshaping for Efficient Compression of Plenoptic Content

Plenoptic Image Compression via Simplified Subaperture Projection.

Advanced 3D Motion Prediction for Video-Based Dynamic Point Cloud Compression

Low Complexity Depth Coding Assisted by Coding Information From Color Video