A Frequency Analysis of Light Transport

Frédo Durand

DOI: https://doi.org/10.1364/cosi.2011.jtud1

2011-01-01

Abstract:The simulation of light in complex 3D scenes is challenging because of the number of rays that must be simulated. We use a Fourier analysis of the 4D set of rays for insights and acceleration.

What problem does this paper attempt to address?

Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging

Di Wu,Gordon Wetzstein,Christopher Barsi,Thomas Willwacher,Matthew O’Toole,Nikhil Naik,Qionghai Dai,Kyros Kutulakos,Ramesh Raskar

DOI: https://doi.org/10.1007/978-3-642-33718-5_39

2012-01-01

Abstract:Light transport has been analyzed extensively, in both the primal domain and the frequency domain; the latter provides intuition of effects introduced by free space propagation and by optical elements, and allows for optimal designs of computational cameras for tailored, efficient information capture. Here, we relax the common assumption that the speed of light is infinite and analyze free space propagation in the frequency domain considering spatial, temporal, and angular light variation. Using this analysis, we derive analytic expressions for cross-dimensional information transfer and show how this can be exploited for designing a new, time-resolved bare sensor imaging system.
Ultra-fast Lensless Computational Imaging through 5D Frequency Analysis of Time-resolved Light Transport

Di Wu,Gordon Wetzstein,Christopher Barsi,Thomas Willwacher,Qionghai Dai,Ramesh Raskar

DOI: https://doi.org/10.1007/s11263-013-0686-0

IF: 13.369

2014-01-01

International Journal of Computer Vision

Abstract:Light transport has been analyzed extensively, in both the primal domain and the frequency domain. Frequency analyses often provide intuition regarding effects introduced by light propagation and interaction with optical elements; such analyses encourage optimal designs of computational cameras that efficiently capture tailored visual information. However, previous analyses have relied on instantaneous propagation of light, so that the measurement of the time dynamics of light–scene interaction, and any resulting information transfer, is precluded. In this paper, we relax the common assumption that the speed of light is infinite. We analyze free space light propagation in the frequency domain considering spatial, temporal, and angular light variation. Using this analysis, we derive analytic expressions for information transfer between these dimensions and show how this transfer can be exploited for designing a new lensless imaging system. With our frequency analysis, we also derive performance bounds for the proposed computational camera architecture and provide a mathematical framework that will also be useful for future ultra-fast computational imaging systems.
A Light-Ray Approach to Fractional Fourier Optics

Éric Fogret,Pierre Pellat-Finet

2023-04-07

Abstract:A light ray in space is characterized by two vectors: (i) a transverse spatial-vector associated with the point where the ray intersects a given spherical cap; (ii) an angular-frequency vector which defines the ray direction of propagation. Given a light ray propagating from a spherical emitter to a spherical receiver, a linear equation is established that links its representative vectors on the emitter and on the receiver. The link is expressed by means of a matrix which is not homogeneous, since it involves both spatial and angular variables (having distinct physical dimensions). Indeed, the matrix becomes a homogeneous rotation-matrix after scaling the previous variables with appropriate dimensional coefficients. When applied to diffraction, in the framework of a scalar theory, the scaling operation results directly in introducing fractional-order Fourier transformations as mathematical expressions of Fresnel diffraction phenomena. Linking angular-frequency vectors and spatial frequencies results in an interpretation of the notion of a spherical angular-spectrum. Accordance of both inhomogeneous and homogeneous ray-matrices with Huygens-Fresnel principle is examined. The proposed ray-matrix representation of diffraction is also applied to coherent imaging through a lens.

Optics
Temporal frequency probing for 5D transient analysis of global light transport

Matthew O'Toole,Felix Heide,Lei Xiao,Matthias B. Hullin,Wolfgang Heidrich,Kiriakos N. Kutulakos

DOI: https://doi.org/10.1145/2601097.2601103

IF: 6.2

2014-07-27

ACM Transactions on Graphics

Abstract:We analyze light propagation in an unknown scene using projectors and cameras that operate at transient timescales. In this new photography regime, the projector emits a spatio-temporal 3D signal and the camera receives a transformed version of it, determined by the set of all light transport paths through the scene and the time delays they induce. The underlying 3D-to-3D transformation encodes scene geometry and global transport in great detail, but individual transport components ( e.g ., direct reflections, inter-reflections, caustics, etc .) are coupled nontrivially in both space and time. To overcome this complexity, we observe that transient light transport is always separable in the temporal frequency domain . This makes it possible to analyze transient transport one temporal frequency at a time by trivially adapting techniques from conventional projector-to-camera transport. We use this idea in a prototype that offers three never-seen-before abilities: (1) acquiring time-of-flight depth images that are robust to general indirect transport, such as interreflections and caustics; (2) distinguishing between direct views of objects and their mirror reflection; and (3) using a photonic mixer device to capture sharp, evolving wavefronts of "light-in-flight".

computer science, software engineering
The finite-element method for the propagation of light in scattering media: frequency domain case

M Schweiger,S R Arridge

DOI: https://doi.org/10.1118/1.598008

Abstract:A frequency domain light transport model to simulate the transillumination of a scattering object with radio frequency intensity modulated light is presented. The model is based on the diffusion approximation to the radiative transfer equation and uses a finite-element model to allow for complex geometries and an inhomogeneous distribution of absorption and scattering. It calculates the complex photon density within the object and the complex exitance on the boundary of the object. The model is validated against an analytic Green's function model for a circular geometry in the homogeneous case, and its accuracy is investigated for a range of mesh resolutions, optical parameters, and modulation frequencies.
Fast Computation of Single Scattering in Participating Media with Refractive Boundaries Using Frequency Analysis

Yulin Liang,Beibei Wang,Lu Wang,Nicolas Holzschuch

DOI: https://doi.org/10.1109/tvcg.2019.2909875

IF: 5.2

2020-10-01

IEEE Transactions on Visualization and Computer Graphics

Abstract:Many materials combine a refractive boundary and a participating media on the interior. If the material has a low opacity, single scattering effects dominate in its appearance. Refraction at the boundary concentrates the incoming light, resulting in an important phenomenon called volume caustics. This phenomenon is hard to simulate. Previous methods used point-based light transport, but attributed point samples inefficiently, resulting in long computation time. In this paper, we use frequency analysis of light transport to allocate point samples efficiently. Our method works in two steps: in the first step, we compute volume samples along with their covariance matrices, encoding the illumination frequency content in a compact way. In the rendering step, we use the covariance matrices to compute the kernel size for each volume sample: small kernel for high-frequency single scattering, large kernel for lower frequencies. Our algorithm computes volume caustics with fewer volume samples, with no loss of quality. Our method is both faster and uses less memory than the original method. It is roughly twice as fast and uses one fifth of the memory. The extra cost of computing covariance matrices for frequency information is negligible.

computer science, software engineering
Augmenting Light Field to model Wave Optics effects

Se Baek Oh,George Barbastathis,Ramesh Raskar

DOI: https://doi.org/10.48550/arXiv.0907.1545

2009-07-09

Abstract:The ray-based 4D light field representation cannot be directly used to analyze diffractive or phase--sensitive optical elements. In this paper, we exploit tools from wave optics and extend the light field representation via a novel "light field transform". We introduce a key modification to the ray--based model to support the transform. We insert a "virtual light source", with potentially negative valued radiance for certain emitted rays. We create a look-up table of light field transformers of canonical optical elements. The two key conclusions are that (i) in free space, the 4D light field completely represents wavefront propagation via rays with real (positive as well as negative) valued radiance and (ii) at occluders, a light field composed of light field transformers plus insertion of (ray--based) virtual light sources represents resultant phase and amplitude of wavefronts. For free--space propagation, we analyze different wavefronts and coherence possibilities. For occluders, we show that the light field transform is simply based on a convolution followed by a multiplication operation. This formulation brings powerful concepts from wave optics to computer vision and graphics. We show applications in cubic-phase plate imaging and holographic displays.

Computer Vision and Pattern Recognition
Light transport with the equation of radiative transfer: The Fourier Continuation – Discrete Ordinates (FC–DOM) Method

E.L. Gaggioli,O.P. Bruno,D.M. Mitnik

DOI: https://doi.org/10.1016/j.jqsrt.2019.106589

IF: 2.342

2019-10-01

Journal of Quantitative Spectroscopy and Radiative Transfer

Abstract:<p>We present a method for the treatment of the time dependent radiative transfer equation under the discrete ordinate approximation. The novelty of the proposed approach stems, in part, from the incorporation of a spectral method for the calculation of the spatial differential operators based on the Fourier Continuation procedure introduced recently by Bruno and co–authors. This is a spatially dispersionless and high order method, which can handle arbitrary geometries, including those encountered in the forward model of light transport in optical tomography. We validate our theoretical results by comparison with analytic and experimental outcomes of the fluence measurements on tissue-like phantoms. The method makes it possible to calculate the time of flight of photons in random media efficiently and with high accuracy.</p>

optics,spectroscopy
Numerical Simulation of Light Propagation Through Composite and Anisotropic Media Using Supercomputers

Roman Galev,Alexey Kudryavtsev,Sergey Trashkeev

DOI: https://doi.org/10.1007/978-3-319-71255-0_18

2017-01-01

Abstract:Laser beam propagation through and absorption in composite and anisotropic media is simulated by solving numerically Maxwell’s equations with the FDTD method. Laser treatment of materials, light beam transformation in micron-sized optical fiber systems and liquid crystalline materials, generation of optical vortices (beams with non-zero orbital angular momentum) due to interaction with liquid crystal disclinations are considered. Typical grids used for simulations consist of tens and hundreds of millions of cells. The numerical code is parallelized using geometrical domain decomposition and the MPI library for data transfer between nodes of a computational cluster.
Time and frequency transfers in optical spacetime

Adrien Bourgoin,Pierre Teyssandier,Paolo Tortora,Marco Zannoni

2024-03-22

Abstract:Solving the null geodesic equations for a ray of light is a difficult task even considering a stationary spacetime. The problem becomes even more difficult if the electromagnetic signal propagates through a flowing optical medium. Indeed, because of the interaction between light and matter, the signal does not follow a null geodesic path of the spacetime metric anymore. However, having a clear description of how the time and frequency transfers are affected in this very situation is of a prime importance in astronomy. As a matter of fact, ranging to satellites and Moon, very long baseline interferometry, global navigation satellite systems, and radio occultation experiments are few examples of techniques involving light propagation in flowing optical media. By applying the time transfer functions formalism to optical spacetime, we show that the time and frequency transfers can be determined iteratively up to any desired order within the quasi-Minkowskian path approximation. We present some applications in the context of radio occultation experiments and discuss possible future applications to the modeling of tropospheric delays.

General Relativity and Quantum Cosmology
Frequency and Wavelength of Light for Relativistically Rotating Frames

Robert D. Klauber

DOI: https://doi.org/10.48550/arXiv.gr-qc/0108036

2002-07-24

Abstract:Non-time-orthogonal frame analysis is applied to determine the frequency and wavelength of light as observed i) in a relativistically rotating frame when emission is from a source fixed in the non-rotating frame, ii) in a non-rotating frame when emission is from a source fixed in the rotating frame, and iii) when both source and observer are fixed in the rotating frame and the source emission direction varies with respect to the rotating frame. Appropriate Doppler effects are demonstrated, and second order differences from translating (time-orthogonal) frame analysis are noted.

General Relativity and Quantum Cosmology
Frequency-domain Finite-Volume Simulations

Klaus Krohne,Dirk Baumann,Christophe Fumeaux,Er-Ping Li,Ruediger Vahldieck

DOI: https://doi.org/10.1109/eumc.2007.4405150

2007-01-01

Abstract:This paper presents recent investigations that aim at providing an efficient frequency-domain solution of models that are obtained from a finite-volume space discretization. Traditionally, the finite-volume method is used in conjunction with a time-domain solver, however, when applied to resonant devices, such as filters and diplexers, a frequency-domain solution is attractive. Since direct solutions of the involved systems suffer from a prohibitively high computational load, the application of model order reduction techniques is advantageous. Reduced order representations of models that are obtained from different variants of the method are investigated by means of an example.
Interactive rendering of acquired materials on dynamic geometry using frequency analysis

Mahdi Mohammad Bagher,Cyril Soler,Kartic Subr,Laurent Belcour,Nicolas Holzschuch

DOI: https://doi.org/10.1109/TVCG.2012.298

Abstract:Shading acquired materials with high-frequency illumination is computationally expensive. Estimating the shading integral requires multiple samples of the incident illumination. The number of samples required may vary across the image, and the image itself may have high- and low-frequency variations, depending on a combination of several factors. Adaptively distributing computational budget across the pixels for shading is a challenging problem. In this paper, we depict complex materials such as acquired reflectances, interactively, without any precomputation based on geometry. In each frame, we first estimate the frequencies in the local light field arriving at each pixel, as well as the variance of the shading integrand. Our frequency analysis accounts for combinations of a variety of factors: the reflectance of the object projecting to the pixel, the nature of the illumination, the local geometry and the camera position relative to the geometry and lighting. We then exploit this frequency information (bandwidth and variance) to adaptively sample for reconstruction and integration. For example, fewer pixels per unit area are shaded for pixels projecting onto diffuse objects, and fewer samples are used for integrating illumination incident on specular objects.
Monte Carlo Methods for Volumetric Light Transport Simulation

Jan Novák,Iliyan Georgiev,Johannes Hanika,Wojciech Jarosz

DOI: https://doi.org/10.1111/cgf.13383

IF: 2.5

2018-05-01

Computer Graphics Forum

Abstract:The wide adoption of path‐tracing algorithms in high‐end realistic rendering has stimulated many diverse research initiatives. In this paper we present a coherent survey of methods that utilize Monte Carlo integration for estimating light transport in scenes containing participating media. Our work complements the volume‐rendering state‐of‐the‐art report by Cerezo et al. [CPP*05]; we review publications accumulated since its publication over a decade ago, and include earlier methods that are key for building light transport paths in a stochastic manner. We begin by describing analog and non‐analog procedures for free‐path sampling and discuss various expected‐value, collision, and track‐length estimators for computing transmittance. We then review the various rendering algorithms that employ these as building blocks for path sampling. Special attention is devoted to null‐collision methods that utilize fictitious matter to handle spatially varying densities; we import two “next‐flight” estimators originally developed in nuclear sciences. Whenever possible, we draw connections between image‐synthesis techniques and methods from particle physics and neutron transport to provide the reader with a broader context.

computer science, software engineering
Creating and Controlling Complex Light

Nicholas Bender,Hasan Yılmaz,Yaron Bromberg,Hui Cao

DOI: https://doi.org/10.1063/1.5132960

2019-11-15

Abstract:Random light fields -- commonly known as speckles -- demonstrate Rayleigh intensity statistics and only possess local correlations: which occur within the individual speckle grains. In this work, we develop an experimental method for customizing the intensity probability density function (PDF) of speckle patterns while simultaneously introducing non-local spatial correlations among the speckle grains. The various families of tailored speckle patterns -- created by our method -- can exhibit radically different topologies, statistics, and variable degrees of spatial order. Irrespective of their distinct statistical properties, however, all of these speckles are created by appropriately encoding high-order correlations into the phase front of a monochromatic laser beam with a spatial light modulator. In addition to our experimental demonstration, we explore both the theoretical and practical limitations on the extent to which the intensity PDF and the spatial intensity correlations can be manipulated concurrently in a speckle pattern. This work provides a versatile methodology for creating complex light fields and controlling their statistical properties with varied applications in microscopy, imaging, and optical manipulation.

Optics
Light transport through amorphous photonic materials with localization and bandgap regimes

Frank Scheffold,Jakub Haberko,Sofia Magkiriadou,Luis S. Froufe-Pérez

DOI: https://doi.org/10.1103/PhysRevLett.129.157402

2022-09-06

Abstract:We propose a framework that unifies the description of light transport in three-dimensional amorphous dielectric materials that exhibit both localization and a photonic bandgap. To this end, we argue that coherent reflection near and in the bandgap attenuates the generation of diffuse or localized photons. Using the self-consistent theory of localization and considering the density of states of photons, we can quantitatively describe all transport regimes: Transparency, light diffusion, localization, and bandgap. Comparing the model with numerical data on optical transport in hyperuniform dielectric networks confirms our findings.

Optics,Disordered Systems and Neural Networks,Mesoscale and Nanoscale Physics,Soft Condensed Matter
Light Propagation in Inhomogeneous Universes I: Methodology and Preliminary Results

Premana Premadi,Hugo Martel,Richard Matzner

DOI: https://doi.org/10.1086/305104

1997-08-14

Abstract:We describe a numerical algorithm which simulates the propagation of light in inhomogeneous universes, using the multiple lens-plane method. The deformation and deflection of light beams as they interact with each lens plane are computed using the filled-beam approximation. We use a N-body code to simulate large-scale structure formation in the universe. We extend the length resolution of the simulations to sub-Megaparsec scales by using a Monte-Carlo method for locating galaxies according to the underlying distribution of background matter. The observed galaxy 2-point correlation function and morphology-density relation are reproduced. This algorithm constitutes a major improvement over previous methods. We test this algorithm for three different CDM models: an Einstein-de Sitter model, an open model, and a flat model with a nonzero cosmological constant. In each case, we compute the shear and magnification caused by the presence of inhomogeneities. Our results are the following: (1) The magnification is totally dominated by the convergence; the shear contributes less than one part in 10^4. (2) Most of the cumulative shear and magnification is contributed by matter located at intermediate redshifts z=1-2. (3) The redshift where the largest contribution to shear and magnification occurs is model-dependent. (4) The bulk of the shear and magnification does not originate from direct hits with galaxies, but rather from the tidal influence of nearby and more distant galaxies, and background matter. (5) The average contributions of background matter and nearby galaxies to the shear is comparable for models with small Omega0. For the Einstein-de Sitter model, the contribution of the background matter exceeds the one of nearby galaxies by nearly one order of magnitude.

Astrophysics
Frequency Descriptor based Light Field Depth Estimation

Junke Li,Xin Jin

DOI: https://doi.org/10.1109/VCIP47243.2019.8965944

2019-01-01

Abstract:Depth estimation plays an important role in light field data processing. However, conventional focus measurement based approaches fail at the angular patches containing occlusion boundaries. In this paper, a novel depth estimation algorithm is proposed based on frequency descriptors. On the basis of the imaging process analysis, we propose to first perform the occlusion discrimination and edge orientation extraction in the frequency domain for the spatial patch from the central sub-aperture image. Then, according to the occlusion orientation, a variable-block-size angular patch is selected in the normal direction to construct the frequency descriptors for focus measurement in the focal stack. Experimental results demonstrate superior performance of the proposed method in robustness and depth accuracy.
Correlating light fields through disordered media across multiple degrees of freedom

Louisiane Devaud,Bernhard Rauer,Simon Mauras,Stefan Rotter,Sylvain Gigan

DOI: https://doi.org/10.1103/PhysRevResearch.6.033265

2024-09-17

Abstract:Speckle patterns are inherent features of coherent light propagation through complex media. As a result of interference, they are sensitive to multiple experimental parameters such as the configuration of disorder or the propagating wavelength. Recent developments in wavefront shaping have made it possible to control speckle pattern statistics and correlations, for example using the concept of the transmission matrix. In this article, we address the problem of correlating scattered fields across multiple degrees of freedom. We highlight the common points between the specific techniques already demonstrated, and we propose a general framework based on the singular value decomposition of a linear combination of multiple transmission matrices. Following analytical predictions, we experimentally illustrate the technique on spectral and temporal correlations, and we show that both the amplitude and the phase of the field correlations can be tuned. Our work opens up new perspectives in speckle correlation manipulation, with potential applications in coherent control.

Optics,Disordered Systems and Neural Networks
Tracing of frequency-dependent rays in heterogeneous media

Song Lin-Ping,Zhang Shu-Yi,LP Song,SY Zhang

1999-01-01

Abstract:We present a method for computation of frequency-dependent rays which are governed by the exact eikonal equation. First, the phase velocity related with a frequency-dependent ray can be analytically expressed through an iterative perturbation method. Then, a triangular grid-based network ray tracing method is developed and used to calculate traveltime field in a discretized medium. The results of simulated data are shown.

A Frequency Analysis of Light Transport

Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging

Ultra-fast Lensless Computational Imaging through 5D Frequency Analysis of Time-resolved Light Transport

A Light-Ray Approach to Fractional Fourier Optics

Temporal frequency probing for 5D transient analysis of global light transport

The finite-element method for the propagation of light in scattering media: frequency domain case

Fast Computation of Single Scattering in Participating Media with Refractive Boundaries Using Frequency Analysis

Augmenting Light Field to model Wave Optics effects

Light transport with the equation of radiative transfer: The Fourier Continuation – Discrete Ordinates (FC–DOM) Method

Numerical Simulation of Light Propagation Through Composite and Anisotropic Media Using Supercomputers

Time and frequency transfers in optical spacetime

Frequency and Wavelength of Light for Relativistically Rotating Frames

Frequency-domain Finite-Volume Simulations

Interactive rendering of acquired materials on dynamic geometry using frequency analysis

Monte Carlo Methods for Volumetric Light Transport Simulation

Creating and Controlling Complex Light

Light transport through amorphous photonic materials with localization and bandgap regimes

Light Propagation in Inhomogeneous Universes I: Methodology and Preliminary Results

Frequency Descriptor based Light Field Depth Estimation

Correlating light fields through disordered media across multiple degrees of freedom

Tracing of frequency-dependent rays in heterogeneous media