Light-field Microscopy with a Consumer Light-field Camera

Lois Mignard-Debise,Ivo Ihrke

DOI: https://doi.org/10.48550/arXiv.1508.03590

2015-12-07

Abstract:We explore the use of inexpensive consumer light- field camera technology for the purpose of light-field mi- croscopy. Our experiments are based on the Lytro (first gen- eration) camera. Unfortunately, the optical systems of the Lytro and those of microscopes are not compatible, lead- ing to a loss of light-field information due to angular and spatial vignetting when directly recording microscopic pic- tures. We therefore consider an adaptation of the Lytro op- tical system. We demonstrate that using the Lytro directly as an oc- ular replacement, leads to unacceptable spatial vignetting. However, we also found a setting that allows the use of the Lytro camera in a virtual imaging mode which prevents the information loss to a large extent. We analyze the new vir- tual imaging mode and use it in two different setups for im- plementing light-field microscopy using a Lytro camera. As a practical result, we show that the camera can be used for low magnification work, as e.g. common in quality control, surface characterization, etc. We achieve a maximum spa- tial resolution of about 6.25{\mu}m, albeit at a limited SNR for the side views.

Graphics,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### What problems does this paper attempt to solve?

This paper aims to explore how to use consumer - level light - field cameras (such as Lytro) for light - field microscopic imaging. Specifically, the author attempts to combine the Lytro camera with a microscope to achieve a low - cost and easy - to - use light - field microscope system. However, because the optical systems of the Lytro camera and the microscope are incompatible, direct connection will lead to information loss (such as spatial and angular vignetting). Therefore, the main objectives of the paper are to solve the following problems:

1. **Optical system incompatibility**: The Lytro camera is designed for imaging macroscopic objects, while the microscope requires high resolution and a large numerical aperture (NA), and the f - numbers between them do not match, resulting in a decline in imaging quality.

2. **Information loss**: When the Lytro camera is directly used as the eyepiece of the microscope, image edge information will be lost due to spatial vignetting. In addition, angular vignetting will also reduce the collection of directional light - field information.

3. **Achieving low - magnification imaging**: In order to obtain sufficient field of view and resolution in microscopic imaging, a method needs to be found to adapt to the characteristics of the Lytro camera so that it can work at low magnifications, thus being suitable for application scenarios such as quality control and surface feature analysis.

To solve these problems, the author proposes two solutions:

- **The first solution**: By adding an additional lens system to adjust the magnification between the microscope and the Lytro camera, the two can cooperate better and reduce the vignetting effect.

- **The second solution**: Use a standard SLR lens instead of a microscope and place the Lytro camera behind it to achieve unit - magnification light - field imaging.

Through these two solutions, the author shows how to use consumer - level light - field cameras to achieve low - cost light - field microscopic imaging and reaches a certain spatial resolution (about 6.25 µm), although the signal - to - noise ratio is limited.

### Summary

This paper mainly solves the problem of incompatibility between the optical systems of consumer - level light - field cameras and microscopes, proposes and verifies two improvement solutions, enabling the Lytro camera to play a role in microscopic imaging, especially in low - magnification applications.