Trimming the Fat: Efficient Compression of 3D Gaussian Splats through Pruning

Muhammad Salman Ali,Maryam Qamar,Sung-Ho Bae,Enzo Tartaglione

2024-07-29

Abstract:In recent times, the utilization of 3D models has gained traction, owing to the capacity for end-to-end training initially offered by Neural Radiance Fields and more recently by 3D Gaussian Splatting (3DGS) models. The latter holds a significant advantage by inherently easing rapid convergence during training and offering extensive editability. However, despite rapid advancements, the literature still lives in its infancy regarding the scalability of these models. In this study, we take some initial steps in addressing this gap, showing an approach that enables both the memory and computational scalability of such models. Specifically, we propose "Trimming the fat", a post-hoc gradient-informed iterative pruning technique to eliminate redundant information encoded in the model. Our experimental findings on widely acknowledged benchmarks attest to the effectiveness of our approach, revealing that up to 75% of the Gaussians can be removed while maintaining or even improving upon baseline performance. Our approach achieves around 50$\times$ compression while preserving performance similar to the baseline model, and is able to speed-up computation up to 600 FPS.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the scalability issue of 3D Gaussian Splatting (3DGS) models in terms of storage and computing resources. Although 3DGS models have significant advantages due to their rapid convergence and high editability, they still face challenges in storage and computational efficiency when dealing with large - scale scenes. Specifically:

1. **High storage requirements**: 3DGS models require a large number of Gaussians to represent the scene, which leads to large storage requirements and limits their application on resource - constrained devices (such as IoT devices, mobile VR/AR devices, etc.).
2. **Low computational efficiency**: Although 3DGS models are superior to NeRF methods in rendering speed, when dealing with large - scale scenes, the demand for computing resources is still high, affecting real - time performance.

To solve these problems, the author proposes an iterative pruning technique based on gradient information ("Trimming the fat"), aiming to remove redundant Gaussians in the model, thereby achieving compression. This method can not only significantly reduce the storage requirements of the model, but also maintain or improve the rendering quality and accelerate the computation. The experimental results show that through this method, up to 75% of Gaussians can be removed, while the model is compressed to about 1/50 of its original size, and the rendering speed is increased to more than 600 FPS.

### Main contributions
- **Pruning based on gradient information**: An a posteriori, iterative pruning technique based on gradient information is proposed, which can effectively remove redundant Gaussians while maintaining or improving the rendering quality.
- **Compatibility with other compression methods**: The compatibility of this pruning method with existing compression pipelines (such as the method of Niedermayr et al. [22]) is demonstrated, further improving the compression rate.
- **Significant compression effect**: The experimental results show that even when a large number of Gaussians are removed, this method can still maintain performance comparable to or even better than the baseline model, achieving a significant compression effect.

Through these improvements, the author hopes that 3DGS models can be widely used in more application scenarios, especially in resource - constrained environments.