Abstract:Real-time 3D reconstruction is one of the current popular research directions of computer vision, and it has become the core technology in the fields of virtual reality, industrialized automatic systems, and mobile robot path planning. Currently, there are three main problems in the real-time 3D reconstruction field. Firstly, it is expensive. It requires more varied sensors, so it is less convenient. Secondly, the reconstruction speed is slow, and the 3D model cannot be established accurately in real time. Thirdly, the reconstruction error is large, which cannot meet the requirements of scenes with accuracy. For this reason, we propose a real-time 3D reconstruction method based on monocular vision in this paper. Firstly, a single RGB-D camera is used to collect visual information in real time, and the YOLACT++ network is used to identify and segment the visual information to extract part of the important visual information. Secondly, we combine the three stages of depth recovery, depth optimization, and deep fusion to propose a three-dimensional position estimation method based on deep learning for joint coding of visual information. It can reduce the depth error caused by the depth measurement process, and the accurate 3D point values of the segmented image can be obtained directly. Finally, we propose a method based on the limited outlier adjustment of the cluster center distance to optimize the three-dimensional point values obtained above. It improves the real-time reconstruction accuracy and obtains the three-dimensional model of the object in real time. Experimental results show that this method only needs a single RGB-D camera, which is not only low cost and convenient to use, but also significantly improves the speed and accuracy of 3D reconstruction.

Improved 3D Reconstruction Using Group-Based Sparse Representation in Integral Imaging

In-Hand 3D Object Reconstruction from a Monocular RGB Video

Piecewise Planar Super-Resolution for 3D Scene

Visual Odometry Based 3D-Reconstruction

Robust 3D Reconstruction with an RGB-D Camera

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

Behind the Veil: Enhanced Indoor 3D Scene Reconstruction with Occluded Surfaces Completion

Panoramic Imaging and 3D Reconstruction Based on Sparse Image Volume

Robust Fusion of Multi-Source Images for Accurate 3D Reconstruction of Complex Urban Scenes

3-D Reconstruction of Image Sequence Based on Independent Three-View

Three-Dimensional Geometry Reconstruction Method from Multi-View ISAR Images Utilizing Deep Learning

Near-Field 3D Sparse SAR Direct Imaging with Irregular Samples

3D Reconstruction of Indoor Scenes Via Image Registration

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion

3D Scene Reconstruction with Sparse LiDAR Data and Monocular Image in Single Frame

Real-time High-accuracy Three-Dimensional Reconstruction with Consumer RGB-D Cameras

360Recon: An Accurate Reconstruction Method Based on Depth Fusion from 360 Images

2L3: Lifting Imperfect Generated 2D Images into Accurate 3D

3D reconstruction of objects with occlusion and surface reflection using a dual monocular structured light system.

Real-Time 3D Reconstruction Method Based on Monocular Vision