Abstract:High-quality surface reconstruction and texture reconstruction of large-scale scene play a pivotal role in the domains of ancient architecture, cultural heritage preservation, and 3D urban modeling. Given that point cloud data has emerged as a crucial medium for representing three-dimensional spatial information, its utilization for surface and texture reconstruction becomes indispensable. In this research, we propose a novel framework for reconstructing surface and texture from unstructured colorful point clouds without normal information to restore large-scale real-world scenes. Specifically, we first introduce an automatic virtual viewpoint selection method to generate virtual views by rendering the point cloud from multiple viewpoints. Subsequently, we construct a two-step network to facilitate accurate visibility prediction and texture inpainting for each virtual view. Then, the visibility information from multiple perspectives is integrated to solve an optimization problem incorporating visibility constraints, resulting in the generation of a 3D mesh. Subsequently, texture information from various perspectives is integrated, filtering techniques are applied to determine the optimal perspective for texturing, and a texture atlas is generated. Precise texture mapping is then performed, ultimately leading to the production of a comprehensive textured model. In contrast to alternative learning-based methodologies, our framework exclusively learns from two-dimensional images, encompassing the prediction of both visible and invisible points as well as the execution of image inpainting tasks. This approach exhibits exceptional versatility in managing large-scale point clouds while effectively leveraging the color and intensity attributes of the data for precise texture reconstruction. The experimental results demonstrate that our approach achieves a significant improvement of 2.06% in F-scores for outdoor surface reconstruction compared to the current state-of-the-art learning-based methods, while also outperforming them in texture reconstruction.

Real-Time Globally Consistent Dense 3D Reconstruction with Online Texturing.

A Real-Time and Globally Consistent Meshing Reconstruction Without GPU.

Generating High-Fidelity Texture in RGB-D Reconstruction Using Patches Density Regularization

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

Chunkfusion: A Learning-Based RGB-D 3D Reconstruction Framework Via Chunk-Wise Integration

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Efficient Convex Optimization-Based Texture Mapping for Large-Scale 3D Scene Reconstruction

Seamless Color Mapping For 3d Reconstruction With Consumer-Grade Scanning Devices

Robust 3D Reconstruction with an RGB-D Camera

Mobile3DRecon: Real-time Monocular 3D Reconstruction on a Mobile Phone

Seamless Texture Optimization for RGB-D Reconstruction

Coxgraph: Multi-Robot Collaborative, Globally Consistent, Online Dense Reconstruction System

ColorMesh: Surface and Texture Reconstruction of Large-Scale Scenes from Unstructured Colorful Point Clouds with Adaptive Automatic Viewpoint Selection

Real-time Underwater 3D Reconstruction Based on Monocular Image

GPU Accelerated Robust Scene Reconstruction

Real-Time Globally Consistent 3D Reconstruction with Semantic Priors

Real-time High-accuracy Three-Dimensional Reconstruction with Consumer RGB-D Cameras

Efficient Online Surface Correction for Real-time Large-Scale 3D Reconstruction

Robust And Efficient Cpu-Based Rgb-D Scene Reconstruction

Real-time 3D Scene Reconstruction with Dynamically Moving Object Using a Single Depth Camera

Texture Mapping for 3D Reconstruction with RGB-D Sensor