Abstract:Refractive Index Tomography is the inverse problem of reconstructing the continuously-varying 3D refractive index in a scene using 2D projected image measurements. Although a purely refractive field is not directly visible, it bends light rays as they travel through space, thus providing a signal for reconstruction. The effects of such fields appear in many scientific computer vision settings, ranging from refraction due to transparent cells in microscopy to the lensing of distant galaxies caused by dark matter in astrophysics. Reconstructing these fields is particularly difficult due to the complex nonlinear effects of the refractive field on observed images. Furthermore, while standard 3D reconstruction and tomography settings typically have access to observations of the scene from many viewpoints, many refractive index tomography problem settings only have access to images observed from a single viewpoint. We introduce a method that leverages prior knowledge of light sources scattered throughout the refractive medium to help disambiguate the single-view refractive index tomography problem. We differentiably trace curved rays through a neural field representation of the refractive field, and optimize its parameters to best reproduce the observed image. We demonstrate the efficacy of our approach by reconstructing simulated refractive fields, analyze the effects of light source distribution on the recovered field, and test our method on a simulated dark matter mapping problem where we successfully recover the 3D refractive field caused by a realistic dark matter distribution.

Polynomial Approximation Method for Tomographic Reconstruction of Three-Dimensional Refractive Index Fields with Limited Data

Applying Weierstrass approximation theorem for trigonometric polynomials to limited-view tomographic image reconstruction

System Model Enabling Fast Tomographic Phase Microscopy with Total Variation Regularisation.

Single View Refractive Index Tomography with Neural Fields

Fast three-dimensional phase retrieval in propagation-based x-ray tomography

Accurate Image Reconstruction from Few-View and Limited-Angle Data in Diffraction Tomography.

Tomographic 3D Display and Imaging Optimization

Reconstruction of Refractive Index Discontinuities from Truncated Phase-Contrast Tomography Projections

Quantitative Parameter Reconstruction from Optical Coherence Tomographic Data

A Novel Phase Retrieval And Reconstruction Method In Optical Diffraction Tomography

Tomographic Reconstruction Using the Distorted Rytov Iterative Method with Phaseless Data

A High-Precision Reconstruction Algorithm of 3D Data Fields Based on Quasi-interpolation

A modified algebraic reconstruction technique taking refraction into account with an application in terahertz tomography

An Extremely Sparse Tomography Reconstruction of a Multispectral Temperature Field without Any a Priori Knowledge

An improved reconstruction algorithm for 3-D diffraction tomography using spherical-wave sources

Linear Partial Derivative Matrix for Iterative Algorithm to Reconstruct Refractive Index from Refraction Angle Data

Reconstruction refinement of hybrid background-oriented schlieren tomography

Optical Image Reconstruction of Non-Scattering and Low Scattering Heterogeneities in Turbid Media Based on the Diffusion Approximation Model

Frequency Domain Optical Tomography in Human Tissue

A Wavelet-Based Multiresolution Regularized Least Squares Reconstruction Approach for Optical Tomography

Numerically Robust Minimal-Scan Reconstruction Algorithms for Diffraction Tomography Via Radon Transform Inversion.