Abstract:In recent years, with the development of new materials, transparent objects are playing an increasingly important role in many fields, from industrial manufacturing to military technology. However, transparent objects sensing still remains a challenging problem in the area of computational imaging and optical engineering. As an indispensable part of 3-D modeling, transparent object sensing is a long-standing research topic, which aims to reconstruct the surface shape of a given transparent object using various kinds of measurement methods. In this paper, we put forward a new method for the sensing of such objects. Specifically, we focus on the sensing of thin transparent objects, including thin films and various kinds of nano-materials. The proposed method consists of two main steps. Firstly, we use a deep convolutional neural network to predict the original distribution of the objects from its recorded intensity pattern. Secondly, the predicted results are used as initial estimates, and the iterative projection phase retrieval algorithm is performed with the enhanced priors to obtain finer reconstruction results. The numerical experiment results turned out that, with the two steps, our method is able to reconstruct the surface shape of a given thin transparent object with a high speed and simple experimental setup. Moreover, the proposed method shows a new path of transparent object sensing with the combination of state-of-art deep learning technique and conventional computational imaging algorithm. It indicates that, following the same framework, the performance of such method can be significantly improved with more advanced hardware and software implementation.

Transparent Object Reconstruction via Coded Transport of Intensity

Full 3D Reconstruction of Transparent Objects

Non-Line-of-Sight Reconstruction using Efficient Transient Rendering

Computational imaging without a computer: seeing through random diffusers at the speed of light

Robust And Accurate Transient Light Transport Decomposition Via Convolutional Sparse Coding

NeuralTO: Neural Reconstruction and View Synthesis of Translucent Objects

Optical Image Reconstruction of Non-Scattering and Low Scattering Heterogeneities in Turbid Media Based on the Diffusion Approximation Model

Approximation and blind reconstruction of volumetric light field

Differentiable refraction-tracing for mesh reconstruction of transparent objects

Bright-Field Microscopy of Transparent Objects: A Ray Tracing Approach

Reconstruction Of The Optical Parameters Of A Stratified Tissue

Tabletop Transparent Scene Reconstruction via Epipolar-Guided Optical Flow with Monocular Depth Completion Prior

Point-based light transport for participating media with refractive boundaries

Time-Resolved Far Infrared Light Transport Decomposition for Thermal Photometric Stereo

Transparent Object Sensing With Enhanced Prior From Deep Convolutional Neural Network

Non-invasive dynamic or wide-field imaging through opaque layers and around corners

Single View Refractive Index Tomography with Neural Fields

Recovering Scene Geometry Under Wavy Fluid Via Distortion And Defocus Analysis

Seeing invisible objects with intelligent optics

Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Container