Abstract:Real-time 3D reconstruction is one of the current popular research directions of computer vision, and it has become the core technology in the fields of virtual reality, industrialized automatic systems, and mobile robot path planning. Currently, there are three main problems in the real-time 3D reconstruction field. Firstly, it is expensive. It requires more varied sensors, so it is less convenient. Secondly, the reconstruction speed is slow, and the 3D model cannot be established accurately in real time. Thirdly, the reconstruction error is large, which cannot meet the requirements of scenes with accuracy. For this reason, we propose a real-time 3D reconstruction method based on monocular vision in this paper. Firstly, a single RGB-D camera is used to collect visual information in real time, and the YOLACT++ network is used to identify and segment the visual information to extract part of the important visual information. Secondly, we combine the three stages of depth recovery, depth optimization, and deep fusion to propose a three-dimensional position estimation method based on deep learning for joint coding of visual information. It can reduce the depth error caused by the depth measurement process, and the accurate 3D point values of the segmented image can be obtained directly. Finally, we propose a method based on the limited outlier adjustment of the cluster center distance to optimize the three-dimensional point values obtained above. It improves the real-time reconstruction accuracy and obtains the three-dimensional model of the object in real time. Experimental results show that this method only needs a single RGB-D camera, which is not only low cost and convenient to use, but also significantly improves the speed and accuracy of 3D reconstruction.

3D Reconstruction From Monocular Images Based on Deep Convolutional Networks

3D Reconstruction from a Single Still Image Based on Monocular Vision of an Uncalibrated Camera

Real-Time 3D Reconstruction Method Based on Monocular Vision

Three-dimensional Monocular Image Reconstruction of Indoor Scene Based on Neural Network

Efficient 3D Reconstruction Using Monocular Vision

3D Reconstruction of Typical Entities Based on Multi-Perspective Images

3D Reconstruction from A Single Image

3D Reconstruction Using Deep Learning: a Survey.

3D Reconstruction From Traditional Methods to Deep Learning

Dense Reconstruction from Monocular Slam with Fusion of Sparse Map-Points and Cnn-Inferred Depth.

A 3D reconstruction method of image sequence based on deep learning

DeepHuman: 3D Human Reconstruction from a Single Image

Visual Enhanced 3D Point Cloud Reconstruction from A Single Image

Towards 3D Scene Reconstruction from Locally Scale-Aligned Monocular Video Depth

Indoor Scene Reconstruction From Monocular Video Combining Contextual and Geometric Priors

CNN-MonoFusion: Online Monocular Dense Reconstruction Using Learned Depth from Single View

Single Image Based Three-Dimensional Scene Reconstruction Using Semantic and Geometric Priors

Towards Accurate Reconstruction of 3D Scene Shape From A Single Monocular Image

Monocular 3D Reconstruction of Human Body

An Efficient Dense Reconstruction Algorithm from LiDAR and Monocular Camera