GS-Hider: Hiding Messages into 3D Gaussian Splatting

Xuanyu Zhang,Jiarui Meng,Runyi Li,Zhipei Xu,Yongbing Zhang,Jian Zhang

2024-10-07

Abstract:3D Gaussian Splatting (3DGS) has already become the emerging research focus in the fields of 3D scene reconstruction and novel view synthesis. Given that training a 3DGS requires a significant amount of time and computational cost, it is crucial to protect the copyright, integrity, and privacy of such 3D assets. Steganography, as a crucial technique for encrypted transmission and copyright protection, has been extensively studied. However, it still lacks profound exploration targeted at 3DGS. Unlike its predecessor NeRF, 3DGS possesses two distinct features: 1) explicit 3D representation; and 2) real-time rendering speeds. These characteristics result in the 3DGS point cloud files being public and transparent, with each Gaussian point having a clear physical significance. Therefore, ensuring the security and fidelity of the original 3D scene while embedding information into the 3DGS point cloud files is an extremely challenging task. To solve the above-mentioned issue, we first propose a steganography framework for 3DGS, dubbed GS-Hider, which can embed 3D scenes and images into original GS point clouds in an invisible manner and accurately extract the hidden messages. Specifically, we design a coupled secured feature attribute to replace the original 3DGS's spherical harmonics coefficients and then use a scene decoder and a message decoder to disentangle the original RGB scene and the hidden message. Extensive experiments demonstrated that the proposed GS-Hider can effectively conceal multimodal messages without compromising rendering quality and possesses exceptional security, robustness, capacity, and flexibility. Our project is available at: <a class="link-external link-https" href="https://xuanyuzhang21.github.io/project/gshider" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper aims to address issues related to copyright protection and privacy protection in 3D Gaussian Splatting (3DGS). Specifically, due to the explicit 3D representation and extremely fast rendering speed of 3DGS, a new steganography framework is needed to ensure the security and fidelity of hidden information. Existing steganography methods mainly target traditional 3D meshes or point clouds, as well as implicit representations like NeRF, but these methods are not suitable for the unique properties of 3DGS. The paper proposes a new framework called GS-Hider, which can invisibly embed messages in 3D scenes and accurately extract hidden messages from 3DGS point cloud files.

The main contributions of the paper include:
1. **The first steganography framework designed for 3DGS**: Capable of invisibly embedding 3D scenes or images into the original scene and accurately extracting hidden messages through carefully designed modules.
2. **High fidelity and security**: Ensures the security of hidden information by coupling feature attributes and a dedicated message decoder, while maintaining the high fidelity of the original 3D scene.
3. **High capacity and versatility**: Achieves the ability to hide multiple 3D scenes within the same 3D scene for the first time, and can hide a single image in a 3D scene from a specific viewpoint.
4. **Extensive experimental validation**: Validates the security, robustness, fidelity, and flexibility of the method through extensive experiments.

This technology has broad application prospects in copyright protection, encrypted communication, and 3DGS compression.