Abstract:Light-matter interactions modify both the intensity and polarization state of light. Changes in polarization, represented by a Mueller matrix, encode detailed scene information. Existing optical ellipsometers capture Mueller-matrix images; however, they are often limited to capturing static scenes due to long acquisition times. Here, we introduce Event Ellipsometer, a method for acquiring a Mueller-matrix video for dynamic scenes. Our imaging system employs fast-rotating quarter-wave plates (QWPs) in front of a light source and an event camera that asynchronously captures intensity changes induced by the rotating QWPs. We develop an ellipsometric-event image formation model, a calibration method, and an ellipsometric-event reconstruction method. We experimentally demonstrate that Event Ellipsometer enables Mueller-matrix video imaging at 30fps, extending ellipsometry to dynamic scenes.
What problem does this paper attempt to address?
### What problems does this paper attempt to solve?
This paper aims to solve the limitations encountered by traditional ellipsometers when capturing dynamic scenes. Specifically, the traditional method requires mechanical rotation of polarization optical elements and capturing images frame by frame, resulting in a long acquisition time and being unable to effectively handle dynamic scenes. In addition, traditional intensity sensors have difficulty in capturing high - dynamic - range (HDR) scenes and usually require multiple exposures.
To overcome these problems, the authors propose the **Event Ellipsometer**, a new Mueller matrix imaging method based on event cameras and fast - rotating quarter - wave plates (QWP). This method can capture Mueller matrix videos of dynamic scenes at a speed of 30 frames per second (fps) and can handle high - dynamic - range scenes without the need for additional multi - exposure measurements.
### Main contributions
1. **Proposed a new imaging method**: By combining event cameras and fast - rotating quarter - wave plates, Mueller matrix video imaging of dynamic scenes is achieved.
2. **Developed an event - ellipsometric imaging model**: Established the mathematical relationship from the event stream to the Mueller matrix, and proposed calibration methods and robust reconstruction algorithms.
3. **Experimentally verified the effectiveness of the method**: Demonstrated the high precision of this method on known materials and successfully applied it to a variety of practical scenarios, such as photoelastic analysis, dynamic human body capture, HDR imaging, and transparent tape detection.
### Specific problem description
The main challenges faced by traditional ellipsometers when handling dynamic scenes include:
- **Long - time acquisition**: Traditional methods need to capture multiple images under different polarization states, resulting in a long acquisition time and being unable to process dynamic scenes in real - time.
- **Limited spatial resolution**: Single - shot Mueller matrix imaging techniques usually sacrifice spatial resolution or are only applicable to planar targets.
- **Difficulty in handling high - dynamic - range (HDR) scenes**: Traditional intensity sensors have difficulty in capturing HDR scenes and require multiple exposures.
By introducing event cameras and fast - rotating quarter - wave plates, the Event Ellipsometer solves the above problems and achieves efficient, high - resolution, real - time Mueller matrix video imaging.
### Mathematical formula representation
In the paper, the authors used multiple mathematical formulas to describe their method. Here are the Markdown - format representations of several key formulas:
1. **Relationship between Stokes vector and Mueller matrix**:
\[
I_t = [L(0)Q(\theta_{2,t})MQ(\theta_{1,t})L(0)s]_0
\]
where \(I_t\) is the time - varying intensity received by the sensor, \(M\) is the Mueller matrix of the scene, and \(Q(\theta)\) and \(L(0)\) are the Mueller matrices of the quarter - wave plate and the linear polarizer with a rotation angle of \(\theta\), respectively.
2. **Relationship between the time difference of event triggering and the change in light intensity**:
\[
\frac{\partial \log I_t}{\partial t} = \frac{\partial I_t}{\partial t} \frac{1}{I_t} = \frac{\partial A_t}{\partial t} \hat{M} \left(A_t \hat{M}\right)^{-1}
\]
3. **Solution of the least - squares problem**:
\[
\minimize_{\hat{M}} \|WDB \hat{M}\|_2^2
\]
where \(W\) is the weight matrix, \(D\) is the weight matrix that adjusts the influence of each event, and \(B\) is the system matrix.
Through these formulas, the authors described in detail how to reconstruct the Mueller matrix from the event stream and ensure the physical validity of the results.