Abstract:Deep learning has significantly advanced three-dimensional computer vision applied to point clouds. Nevertheless, the substantial consumption of time, storage, and energy substantially limits its deployment on edge devices with constrained resources. Extremely low bit quantization has received wide attention due to its extremely high compression ratio, but the problem of a significant drop in accuracy cannot be ignored. To alleviate the obvious accuracy degradation for extreme low-bit quantization, this paper proposes a novel compression framework for binary and ternary neural networks applied to point clouds, which introduces information geometry to model quantization to compensate the severe feature manifold distortion. It applies differential geometry on manifolds to study the implicit information of the point cloud feature data. Based on the theoretical analysis from the novel perspective of information geometry, two optimization modules are proposed to alleviate severe geometry distortions on differential manifolds. The first module, Scaling Recovery, provides layer-wise scaling parameters to reduce geometric distortion caused by quantization. The second module, Pooling Recovery, is specially designed to alleviate more severe pooling geometry distortions in point clouds. These two modules benefit both binary and ternary neural networks with ignored overheads. For ternary quantization, optimizations on convolution weights and gradients are additionally introduced. The proposed self-adaptive gradient estimation provides a more accurate approximation to the non-differential ternary staircase function. Convolution weight optimization is implemented on an information-geometry optimized model to achieve even higher accuracy and less memory consumption. Experimental results validate that the proposed models significantly outperform state-of-the-art methods and demonstrate better scalability. Overall, this compression framework has the potential to facilitate the deployment of deep learning models on edge devices with limited resources, opening up new opportunities for applications of three-dimensional computer vision.

A Tiny Machine Learning Model for Point Cloud Object Classification

BiPointNet: Binary Neural Network for Point Clouds

PointeNet: A Lightweight Framework for Effective and Efficient Point Cloud Analysis

T3DNet: Compressing Point Cloud Models for Lightweight 3D Recognition

S3I-PointHop: SO(3)-Invariant PointHop for 3D Point Cloud Classification

PointGL: A Simple Global-Local Framework for Efficient Point Cloud Analysis

PointViG: A Lightweight GNN-based Model for Efficient Point Cloud Analysis

PointGT: A Method for Point-Cloud Classification and Segmentation Based on Local Geometric Transformation

Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework

A novel GCN-based point cloud classification model robust to pose variances

Point-GN: A Non-Parametric Network Using Gaussian Positional Encoding for Point Cloud Classification

Towards Point Cloud Compression for Machine Perception: A Simple and Strong Baseline by Learning the Octree Depth Level Predictor

Point Cloud-Based 3D Object Classification With Non Local Attention and Lightweight Convolution Neural Networks

R-PointHop: A Green, Accurate, and Unsupervised Point Cloud Registration Method

GreenPCO: An Unsupervised Lightweight Point Cloud Odometry Method

Information Geometry based Extreme Low-bit Neural Network for Point Cloud

Class-aware tiny object recognition over large-scale 3D point clouds

PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies

Optimized CNNs for Rapid 3D Point Cloud Object Recognition

MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

3D Point Cloud Object Detection Method Based on Multi-Scale Dynamic Sparse Voxelization