High-speed 3D measurements at 20,000Hz with deep convolutional neural networks

Shijie Feng,Chao Zuo,Qian Chen
DOI: https://doi.org/10.1117/12.2537914
2019-01-01
Abstract:Nowadays, the speed of ultra-fast photography can exceed one quadrillion. However, it can record only two-dimensional images which lack the depth information, greatly limiting our ability to perceive and to understand the complex real-world objects. Inspired by recent successes of deep learning methods in computer vision, we present a novel high-speed three-dimensional (3D) surface imaging approach named micro deep learning profilometry (mu DLP) using the structured light illumination. With a properly trained deep neural network, the phase information is predicted from a single fringe image and then can be converted into the 3D shape. Our experiments demonstrate that mu DLP can faithfully retrieve the geometry of dynamic objects at 20,000 frames per second. Moreover, comparative results show that mu DLP has superior performance in terms of the phase accuracy, reconstruction efficiency, and the ease of implementation over widely used Fourier-transform-based fast 3D imaging techniques, verifying that mu DLP is a powerful high-speed 3D surface imaging approach.
What problem does this paper attempt to address?