Nonrigid Registration-Based Progressive Motion Compensation for Point Cloud Geometry Compression

Yiting Shao,Ge Li,Qi Zhang,Wei Gao,Shan Liu

DOI: https://doi.org/10.1109/tgrs.2023.3321289

IF: 8.2

2023-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:There is a critical requirement for efficiently compressing point cloud geometries representing 3-D moving objects in various applications. The Moving Picture Experts Group 3-D Graphics coding group (MPEG 3DG) set up an interexploration model for geometry-based point cloud compression (G-PCC interEM). However, the block-matching motion compensation (MC) scheme with a translational motion model has limited ability to handle dense point clouds with complex local motions. To overcome this problem, we propose a progressive nonrigid MC framework for point cloud geometry compression, where the point cloud registration technique is introduced and tailored with our designed rate-distortion cost. In the coarse-grained stage, a point cloud is represented as deformable point patches, and the patchwise nonrigid motion estimation (ME) task is formulated as a registration-based optimization problem that can be efficiently solved by the majorization-minimization (MM) method. In the fine-grained stage, we propose a block-based motion refinement to enhance the estimated motion field in the local region, followed by a multihypothesis MC scheme enabling smooth reference reconstruction with patchwise deformation and blockwise refined motions. Experiments demonstrate our proposed scheme out-performs several competitive platforms in terms of both coding performance and compensation quality. Compared with G-PCC interEM, our proposed framework achieves significant bitrate savings, i.e., 4.71% (32 frames) and 4.22% (200 frames), for point cloud lossless geometry compression.