Abstract:Speckle projection profilometry (SPP), as a promising structured light projection technique, can achieve global unambiguous 3D measurement by projecting a single random speckle pattern. In addition, the projected speckle pattern is usually etched into the microstructure of highly integrated Vertical-Cavity Surface-Emitting Laser (VCSEL), which makes the hardware system compact enough to be mounted on mobile devices such as robots. However, since the stereo matching algorithm used in SPP involves high computational overhead, it usually runs in real-time on specially customized hardware platforms such as ASIC/FPGA, rather than general-purpose mobile platforms. In this paper, we propose a real-time and accurate 3D measurement method using a monocular 3D sensor based on the infrared speckle projection. Similar to Kinect v1, our sensor mainly consists of an IR dot projector and one IR camera for projecting and capturing speckle images synchronously. Low-cost and high-quality speckle projection is achieved by customizing the projection pattern of VCSEL and using the beam copy function of Diffractive Optical Elements (DOE). Based on the 3D imaging principle of monocular 3D sensors, a reference plane calibration method is proposed to obtain a high-quality reference speckle image for improving the monocular matching accuracy. Then, benefited from the local memory mechanism and multiple operating synchronizations on the OpenCL environment, an optimized semi-global matching (SGM) algorithm using GPU is presented to achieve efficient and accurate depth reconstruction dynamically. Within the measurement range of 0.8m (length) x 0.5m (width) x 1m (depth), the proposed method can achieve real-time and single-shot 3D imaging with an accuracy of 1.277 mm at 75 FPS on GTX 1060 and 15 FPS on ARM Mail G52(mobile platform).

High-Speed Optical 3D Measurement Sensor for Industrial Application

Embedded Three-Dimensional Shape Measurement System with Microprojector

High Speed Image Acquisition System for 3D Reconstruction

High-speed Laser Centerline Extraction and Heterogeneous Measurement Architectures for Low-Cost Hardware

Fast Stereo 3d Imaging Based On Random Speckle Projection And Its Fpga Implementation

Research of Fast 3d Imaging Based on Multiple Mode

Full High-Definition Real-Time Depth Estimation for Three-Dimensional Video System

A MEMS-based real-time structured light 3-D measuring architecture on FPGA

Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

High-Speed Phase Structured Light Integrated Architecture on FPGA

Real-time and Accurate Monocular 3D Sensor Using the Reference Plane Calibration and an Optimized SGM Based on Opencl Acceleration

Efficient and Fast Implementation of Embedded Time-of-Flight Ranging System Based on FPGAs

FPGA implementation of full HD real-time depth estimation

Real-time 3D Video System Based on FPGA

Prototype Design of a Time-of-flight Camera Based on Xilinx Zynq7000 SoC Platform

High-resolution Real-Time 3D Absolute Coordinates Measurement Using a Fast Three-Step Phase-Shifting Algorithm

FPGA-Based High-Speed and Resource-Efficient 3D Reconstruction for Structured Light System

FPGA-based Acceleration of Structured Light Depth Estimation

FPGA Design and Implementation of Kinect-Like Depth Sensing

Time-encoded single-pixel 3D imaging

A wide-spectrum and high-speed CMOS system based on FPGA