Deep learning-based color holographic microscopy

Tairan Liu,Zhensong Wei,Yair Rivenson,Kevin de Haan,Yibo Zhang,Yichen Wu,Aydogan Ozcan
DOI: https://doi.org/10.1002/jbio.201900107
2019-07-16
Abstract:We report a framework based on a generative adversarial network (GAN) that performs high-fidelity color image reconstruction using a single hologram of a sample that is illuminated simultaneously by light at three different wavelengths. The trained network learns to eliminate missing-phase-related artifacts, and generates an accurate color transformation for the reconstructed image. Our framework is experimentally demonstrated using lung and prostate tissue sections that are labeled with different histological stains. This framework is envisaged to be applicable to point-of-care histopathology, and presents a significant improvement in the throughput of coherent microscopy systems given that only a single hologram of the specimen is required for accurate color imaging.
Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Optics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to achieve high - fidelity color holographic microscopy imaging in coherent imaging systems. Traditional methods usually need to collect holograms of multiple different wavelengths to reconstruct composite color images, which is not only a complex process, time - consuming, but also has a large data storage requirement. In addition, these methods may also introduce the problem of inaccurate colors when reconstructing color images, which is unacceptable for histopathology and diagnostic applications. To solve these problems, the paper proposes a deep - learning method based on the generative adversarial network (GAN). It can perform high - quality color image reconstruction using only one hologram (the sample is irradiated by light of three different wavelengths at the same time). This method can eliminate artifacts caused by missing phases and generate accurate color conversions. Verified by experiments, this framework is applicable to different histological staining specimens of lung and prostate tissue sections, showing its potential application value in point - of - care histopathology, especially showing significant advantages in improving the imaging throughput of coherent microscopic systems.