Abstract:Real-time 3D reconstruction is one of the current popular research directions of computer vision, and it has become the core technology in the fields of virtual reality, industrialized automatic systems, and mobile robot path planning. Currently, there are three main problems in the real-time 3D reconstruction field. Firstly, it is expensive. It requires more varied sensors, so it is less convenient. Secondly, the reconstruction speed is slow, and the 3D model cannot be established accurately in real time. Thirdly, the reconstruction error is large, which cannot meet the requirements of scenes with accuracy. For this reason, we propose a real-time 3D reconstruction method based on monocular vision in this paper. Firstly, a single RGB-D camera is used to collect visual information in real time, and the YOLACT++ network is used to identify and segment the visual information to extract part of the important visual information. Secondly, we combine the three stages of depth recovery, depth optimization, and deep fusion to propose a three-dimensional position estimation method based on deep learning for joint coding of visual information. It can reduce the depth error caused by the depth measurement process, and the accurate 3D point values of the segmented image can be obtained directly. Finally, we propose a method based on the limited outlier adjustment of the cluster center distance to optimize the three-dimensional point values obtained above. It improves the real-time reconstruction accuracy and obtains the three-dimensional model of the object in real time. Experimental results show that this method only needs a single RGB-D camera, which is not only low cost and convenient to use, but also significantly improves the speed and accuracy of 3D reconstruction.

Three-Dimensional Reconstruction Based on Quadrotors with Binocular Vision

Visual Odometry Based 3D-Reconstruction

3d Reconstruction Based On Stereovision

Design Of 3d Reconstruction System On Quadrotor Fusing Lidar And Camera

Efficient 3D reconstruction for urban scenes

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Robust 3D Reconstruction with an RGB-D Camera

Long-Range 3D Reconstruction Based on Flexible Configuration Stereo Vision Using Multiple Aerial Robots

An adaptive 3D reconstruction method for asymmetric dual-angle multispectral stereo imaging system on UAV platform

A Method for the 3D Reconstruction Based on Edge Detection and Feature Extraction.

Efficient 3D Reconstruction Using Monocular Vision

Real-Time 3D Reconstruction Method Based on Monocular Vision

Vision System of Mobile Robot Combining Binocular and Depth Cameras

Virtual Reality Aided High-Quality 3D Reconstruction by Remote Drones

3D Reconstruction of Scenes from Synchronized Laser Range Data and Stereo Visual Image Data

3D Reconstruction Based on Parallel Binocular Stereo Vision

High-precision Occlusion-Resistant Quad-Vision Camera 3D Reconstruction System

Real-Time Dense Construction with Deep Multiview Stereo Using Camera and IMU Sensors

3D Terrain Reconstruction Based on Binocular Vision

Real-time dense 3D Reconstruction from monocular video data captured by low-cost UAVs

Large-Scale, Real-Time 3D Scene Reconstruction Using Visual and IMU Sensors