3D Gaussian as a New Era: A Survey

Ben Fei,Jingyi Xu,Rui Zhang,Qingyuan Zhou,Weidong Yang,Ying He

DOI: https://doi.org/10.1109/TVCG.2024.3397828

2024-07-10

Abstract:3D Gaussian Splatting (3D-GS) has emerged as a significant advancement in the field of Computer Graphics, offering explicit scene representation and novel view synthesis without the reliance on neural networks, such as Neural Radiance Fields (NeRF). This technique has found diverse applications in areas such as robotics, urban mapping, autonomous navigation, and virtual reality/augmented reality, just name a few. Given the growing popularity and expanding research in 3D Gaussian Splatting, this paper presents a comprehensive survey of relevant papers from the past year. We organize the survey into taxonomies based on characteristics and applications, providing an introduction to the theoretical underpinnings of 3D Gaussian Splatting. Our goal through this survey is to acquaint new researchers with 3D Gaussian Splatting, serve as a valuable reference for seminal works in the field, and inspire future research directions, as discussed in our concluding section.

Computer Vision and Pattern Recognition,Graphics

What problem does this paper attempt to address?

The main purpose of this paper is to provide a comprehensive review of 3D Gaussian Splatting (3D-GS) technology and to explore its latest advancements in the fields of computer graphics and 3D vision. Specifically, the paper aims to address the following aspects:

1. **Theoretical Foundation**: Introduce the basic principles and technical details of 3D-GS, including how to represent 3D scenes through Gaussian distribution, and how to optimize rendering efficiency, image realism, cost, and physical properties.

2. **Application Scope**: Cover the diverse applications of 3D-GS in fields such as robotics, urban mapping, autonomous navigation, virtual reality/augmented reality, and provide detailed classification and summary.

3. **Current Challenges**: Identify the technical limitations in current research and propose future research directions to advance 3D-GS technology.

4. **System Framework**: Establish a unified and practical classification framework, dividing existing 3D-GS work into six main aspects and providing detailed application classification.

Through in-depth analysis of the above aspects, the paper hopes to provide references for new researchers and inspire future research directions. Additionally, the paper discusses the application of various datasets in different tasks to evaluate the performance of 3D-GS technology.