Abstract:As the most comprehensive document types for the recording and display of real-world information regarding construction projects, 3D realistic models are capable of recording and displaying simultaneously textures and geometric shapes in the same 3D scene. However, at present, the documentation for much of construction infrastructure faces significant challenges. Based on TLS, GNSS/IMU, mature photogrammetry, a UAV platform, computer vision technologies, and AI algorithms, this study proposes a workflow for 3D modeling of complex structures with multiple-source data. A deep learning LoFTR network was used first for image matching, which can improve matching accuracy. Then, a NeuralRecon network was employed to generate a 3D point cloud with global consistency. GNSS information was used to reduce search space in image matching and produce an accurate transformation matrix between the image scene and the global reference system. In addition, to enhance the effectiveness and efficiency of the co-registration of the two-source point clouds, an RPM-net was used. The proposed workflow processed the 3D laser point cloud and UAV low-altitude multi-view image data to generate a complete, accurate, high-resolution, and detailed 3D model. Experimental validation on a real high formwork project was carried out, and the result indicates that the generated 3D model has satisfactory accuracy with a registration error value of 5 cm. Model comparison between the TLS, image-based, data fusion 1 (using the common method), and data fusion 2 (using the proposed method) models were conducted in terms of completeness, geometrical accuracy, texture appearance, and appeal to professionals. The results denote that the generated 3D model has similar accuracy to the TLS model yet also provides a complete model with a photorealistic appearance that most professionals chose as their favorite.

3D Reconstruction of Aircraft Structures Via 2D Multi-View Images

Pose Estimation and Neural Implicit Reconstruction Towards Non-Cooperative Spacecraft Without Offline Prior Information

A Surrogate Modeling Framework for Aircraft Assembly Deformation Using Triplet Attention-Enhanced Conditional Autoencoder

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Visual Odometry Based 3D-Reconstruction

PlaneMVS: 3D Plane Reconstruction from Multi-View Stereo

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

Ihuman3d: Intelligent Human Body 3D Reconstruction Using a Single Flying Camera.

UniPlane: Unified Plane Detection and Reconstruction from Posed Monocular Videos

Multi-Sensor Data Fusion for 3D Reconstruction of Complex Structures: A Case Study on a Real High Formwork Project

3D Human Reconstruction in the Wild with Collaborative Aerial Cameras

Large-Scale Aircraft Pose Estimation System Based on Depth Cameras

Planar Reconstruction of Indoor Scenes from Sparse Views and Relative Camera Poses

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion

Two-stage Synthetic Supervising and Multi-view Consistency Self-supervising based Animal 3D Reconstruction by Single Image

6D Pose Estimation of Aircraft Based on Multi-Model Data

Three-Dimensional Geometry Reconstruction Method from Multi-View ISAR Images Utilizing Deep Learning

Reconstructing 3D human pose and shape from a single image and sparse IMUs

Density-Invariant Registration of Multiple Scans for Aircraft Measurement

CNN-Based Camera Pose Estimation and Localization of Scan Images for Aircraft Visual Inspection

Structure‐PoseNet for identification of dense dynamic displacement and three‐dimensional poses of structures using a monocular camera