Abstract:Over the last few decades, image-based building surface reconstruction has garnered substantial research interest and has been applied across various fields, such as heritage preservation, architectural planning, etc. Compared to the traditional photogrammetric and NeRF-based solutions, recently, Gaussian fields-based methods have exhibited significant potential in generating surface meshes due to their time-efficient training and detailed 3D information preservation. However, most gaussian fields-based methods are trained with all image pixels, encompassing building and nonbuilding areas, which results in a significant noise for building meshes and degeneration in time efficiency. This paper proposes a novel framework, Masked Gaussian Fields (MGFs), designed to generate accurate surface reconstruction for building in a time-efficient way. The framework first applies EfficientSAM and COLMAP to generate multi-level masks of building and the corresponding masked point clouds. Subsequently, the masked gaussian fields are trained by integrating two innovative losses: a multi-level perceptual masked loss focused on constructing building regions and a boundary loss aimed at enhancing the details of the boundaries between different masks. Finally, we improve the tetrahedral surface mesh extraction method based on the masked gaussian spheres. Comprehensive experiments on UAV images demonstrate that, compared to the traditional method and several NeRF-based and Gaussian-based SOTA solutions, our approach significantly improves both the accuracy and efficiency of building surface reconstruction. Notably, as a byproduct, there is an additional gain in the novel view synthesis of building.

Enhancement of 3D Gaussian Splatting using Raw Mesh for Photorealistic Recreation of Architectures

Enhanced 3D Urban Scene Reconstruction and Point Cloud Densification using Gaussian Splatting and Google Earth Imagery

GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstruction

Efficient 3D reconstruction for urban scenes

Recent Advances in 3D Gaussian Splatting

Large-Scale 3D Terrain Reconstruction Using 3D Gaussian Splatting for Visualization and Simulation

PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction

GS-Octree: Octree-based 3D Gaussian Splatting for Robust Object-level 3D Reconstruction Under Strong Lighting

GaRField++: Reinforced Gaussian Radiance Fields for Large-Scale 3D Scene Reconstruction

DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshing

Optimizing 3D Gaussian Splatting for Sparse Viewpoint Scene Reconstruction

Surface Reconstruction from 3D Gaussian Splatting Via Local Structural Hints

AAGS: Appearance-Aware 3D Gaussian Splattingwith Unconstrained Photo Collections

SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstruction

360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roaming

LI-GS: Gaussian Splatting with LiDAR Incorporated for Accurate Large-Scale Reconstruction

The Potential of Neural Radiance Fields and 3D Gaussian Splatting for 3D Reconstruction from Aerial Imagery

Quadratic Gaussian Splatting for Efficient and Detailed Surface Reconstruction

2D Gaussian Splatting for Geometrically Accurate Radiance Fields

3D-HGS: 3D Half-Gaussian Splatting

MGFs: Masked Gaussian Fields for Meshing Building based on Multi-View Images