Synthetic Light-in-Flight

Patrick Cornwall,Manuel Ballester,Stefan Forschner,Muralidhar Madabhushi Balaji,Aggelos Katsaggelos,Florian Willomitzer

2024-07-11

Abstract:Light-in-flight (LiF) measurements allow to resolve and visualize the path that light travels through an arbitrary volumetric scene. Traditional LiF methods involve expensive high-speed electronics or narrow-pulse light sources. We present a novel computational LiF approach that only requires continuous-wave (CW) lasers and off-the-shelf CMOS cameras to capture the full LiF information about the scene. From multiple CW scene measurements at different optical wavelengths, we create multiple "synthetic fields," each at a "synthetic wave" which is the beat wave of two respective optical waves. Due to their robustness to speckle, the synthetic fields can be computationally combined into a "synthetic light pulse," which precisely sections the volumetric scene. Moreover, the complex synthetic fields can be freely manipulated in the computer after their acquisition, which allows for spatial and temporal shaping of different sets of pulses from the same set of measurements to maximize the decoded information output for each scene. In addition, the relative speed at which the pulse travels through the scene can be used to characterize physical scene properties such as depth or indices of refraction.

Optics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: How to achieve high - resolution imaging of the propagation path of Light - in - Flight (LiF) without the need for expensive high - speed devices (such as ultrashort - pulse lasers or high - speed detectors). Specifically, the author proposes a new computational method - "Synthetic Light - in - Flight" (SLiF), using only continuous - wave (CW) lasers and ordinary CMOS cameras to capture complete LiF information.

### Specific description of the problem

Traditional LiF methods usually rely on expensive high - speed electronic devices or narrow - pulse light sources, which limits their wide application. This paper aims to develop a new LiF imaging technique that can:

1. **Reduce costs**: Avoid using expensive ultrashort - pulse lasers and high - speed detectors.
2. **Improve flexibility**: Freely manipulate and shape synthetic light pulses by computational means to maximize the information in the decoding scenario.
3. **Expand the application range**: Make LiF imaging technology applicable to a wider range of scenarios, including three - dimensional volume scenarios, scattering media, and scenarios with different refractive indices.

### Solution

The solution proposed by the author is based on the following points:

- **Synthetic Wavelength Imaging (SWI)**: Utilize the interference effect between coherent light fields of different wavelengths to generate synthetic wavelength images. These synthetic wavelength images can be used to extract distance or time - of - flight information.
- **Synthetic Fields**: Generate a synthetic light field \(E(\Lambda)\) by computationally mixing optical fields \(E(\lambda_1)\) and \(E(\lambda_2)\) of different wavelengths, where \(\Lambda=\frac{\lambda_1\cdot\lambda_2}{|\lambda_1 - \lambda_2|}\).
- **Synthetic Pulses**: Superimpose multiple synthetic light fields to form a synthetic light pulse \(P(\Lambda_1,\ldots,\Lambda_N)=\tilde{E}(\Lambda_1)+\tilde{E}(\Lambda_2)+\cdots+\tilde{E}(\Lambda_N)\). These pulses can be freely manipulated in time and space through computational phase alignment and amplitude adjustment.

### Experimental verification

The paper shows the experimental results of the SLiF method in multiple scenarios, including:

- **Propagation of light pulses in 3D - printed objects**: Observe the propagation process of synthetic light pulses on the surface of a 3D - printed rabbit model.
- **Propagation of light pulses in scattering media**: Study the interaction between synthetic light pulses and embedded objects (such as mirrors or foreign objects) in scattering media.
- **Measurement of material properties**: Measure the refractive index and thickness changes of different materials through the delay of synthetic light pulses.

### Conclusion

This paper proposes an innovative SLiF imaging method that can achieve high - resolution LiF imaging without expensive equipment. This method not only reduces costs but also improves flexibility and application range, providing new tools and possibilities for future scientific research and technology development.

### Formula summary

- Synthetic wavelength formula:
\[
\Lambda=\frac{\lambda_1\cdot\lambda_2}{|\lambda_1 - \lambda_2|}
\]
- Synthetic light field formula:
\[
E(\Lambda)=E(\lambda_1)\cdot E^*(\lambda_2)=A_{\lambda_1}A_{\lambda_2}\cdot e^{i(\phi(\lambda_1)-\phi(\lambda_2))}=A_\Lambda\cdot e^{i\phi(\Lambda)}
\]
- Synthetic light pulse formula: