Abstract:We introduce an innovative concept for 3D imaging that utilizes a structured light principle. While our design is specifically tailored for collaborative scenarios involving mobile transport robots, it is also applicable to similar contexts. Our system pairs a standard camera with a projector that employs a diffractive optical element (DOE) and a collimated laser beam to generate a coded light pattern. This allows a three-dimensional measurement of objects from a single camera shot. The main objective of the 3D-sensor is to facilitate the development of automatic, dynamic and adaptive logistics processes capable of managing diverse and unpredictable events. The key novelty of our proposed system for triangulation-based 3D reconstruction is the unique coding of the light pattern, ensuring robust and efficient 3D data generation, even within challenging environments such as industrial settings. Our pattern relies on a perfect submap, a matrix featuring pseudorandomly distributed dots, where each submatrix of a fixed size is distinct from the others. Based on the size of the working space and known geometrical parameters of the optical components, we establish vital design constraints like minimum pattern size, uniqueness window size, and minimum Hamming distance for the design of an optimal pattern. We empirically examine the impact of these pattern constraints on the quality of the 3D data and compare our proposed encoding with some single-shot patterns found in existing literature. Additionally, we provide detailed explanations on how we addressed several challenges during the fabrication of the DOE, which are crucial in determining the usability of the application. These challenges include reducing the 0th diffraction order, accommodating a large horizontal field of view, achieving high point density, and managing a large number of points. Lastly, we propose a real-time processing pipeline that transforms an image of the captured dot pattern into a high-resolution 3D point cloud using a computationally efficient pattern decoding methodology.

Metasurface-driven full-space structured light for three-dimensional imaging

Machine-learning Reprogrammable Metasurface Imager.

Metasurface‐Based Structured Light Sensing Without Triangulation

Multi-wavelength structured light based on metasurfaces for 3D imaging

Metasurface- and PCSEL-Based Structured Light for Monocular Depth Perception and Facial Recognition

360° structured light with learned metasurfaces

Addressable Structured Light System Using Metasurface Optics and an Individually Addressable VCSEL Array

Monocular Metasurface for Structured Light Generation and 3D Imaging with a Large Field-of-View

Structured-Light 3D Imaging Based on Vector Iterative Fourier Transform Algorithm

Metasurface for Structured Light Projection over 120° Field of View

Single-shot three-dimensional imaging with a metasurface depth camera

Neural 360$^\circ$ Structured Light with Learned Metasurfaces

Single-shot 3D imaging with point cloud projection based on metadevice

Active 3D positioning and imaging modulated by single fringe projection with compact metasurface device

MEMS-mirror-based Dynamic Structured Light Projection System for Three-Dimensional Measurement with High Precision

All-solid-state spatial light modulator with independent phase and amplitude control for three-dimensional LiDAR applications

Metasurface-enabled 3D imaging via local bright spot gray scale matching using the structured light dot array

Single-shot structured light with diffractive optic elements for real-time 3D imaging in collaborative logistic scenarios

Metasurface for imaging and AR/VR devices

Metasurface-enhanced light detection and ranging technology

Reconfigurable Metalens with Phase-Change Switching between Beam Acceleration and Rotation for 3D Depth Imaging