Human Iris 3D Imaging using a micro-Plenoptic Camera

Hao Chen,Volker Sick,Maria A. Woodward,David Burke

DOI: https://doi.org/10.1364/boda.2017.bow3a.6

2017-01-01

Abstract:A micro-plenoptic system was developed to image the 3D structure of the human iris in single-exposure photographs. 3D iris patterns were effectively captured. Iris depth varied from 20~80 μm in a 4.9×3.9 mm2 area.

What problem does this paper attempt to address?

Human Iris Three-Dimensional Imaging at Micron Resolution by a Micro-Plenoptic Camera.

Hao Chen,Maria A. Woodward,David T. Burke,V. Swetha E. Jeganathan,Hakan Demirci,Volker Sick

DOI: https://doi.org/10.1364/boe.8.004514

IF: 3.4

2017-01-01

Biomedical Optics Express

Abstract:A micro-plenoptic system was designed to capture the three-dimensional (3D) topography of the anterior iris surface by simple single-shot imaging. Within a depth-of-field of 2.4 mm, depth resolution of 10 µm can be achieved with accuracy (systematic errors) and precision (random errors) below 20%. We demonstrated the application of our micro-plenoptic imaging system on two healthy irides, an iris with naevi, and an iris with melanoma. The ridges and folds, with height differences of 10~80 µm, on the healthy irides can be effectively captured. The front surface on the iris naevi was flat, and the iris melanoma was 50 ± 10 µm higher than the surrounding iris. The micro-plenoptic imaging system has great potential to be utilized for iris disease diagnosis and continuing, simple monitoring.
A 3D Iris Scanner From a Single Image Using Convolutional Neural Networks

Daniel P. Benalcazar,Jorge E. Zambrano,Diego Bastias,Claudio A. Perez,Kevin W. Bowyer

DOI: https://doi.org/10.1109/access.2020.2996563

IF: 3.9

2020-01-01

IEEE Access

Abstract:A 3D model of the human iris provides an additional degree of freedom in iris recognition, which could help identify people in larger databases, even when only a piece of the iris is available. Previously, we reported developing a 3D iris scanner that uses 2D images of the iris from multiple perspectives to reconstruct a 3D model of the iris. This paper focuses on the development of a 3D iris scanner from a single image by means of a Convolutional Neural Network (CNN). The method is based on a depth-estimation CNN for the 3D iris model. A dataset of 26,520 real iris images from 120 subjects, and a dataset of 72,000 synthetic iris images with their aligned depthmaps were created. With these datasets, we trained and compared the depth estimation capabilities of available CNN architectures. We analyzed the performance of our method to estimate the iris depth in multiple ways: using real step pyramid printed 3D models, comparing the results to those of a test set of synthetic images, comparing the results to those of the OCT scans from both eyes of one subject, and generating the 3D rubber sheet from the 3D iris model proving the correspondence with the resulting 2D rubber sheet and binary codes. On a preliminary test the proposed 3D rubber sheet model increased iris recognition performance by 48% with respect to the standard 2D iris code. Other contributions include assessing the scanning resolution, reducing the acquisition and processing time to produce the 3D iris model, and reducing the complexity of the image acquisition system.

computer science, information systems,telecommunications,engineering, electrical & electronic
All-in-Focus Iris Camera With a Great Capture Volume

Kunbo Zhang,Zhenteng Shen,Yunlong Wang,Zhenan Sun

DOI: https://doi.org/10.48550/arXiv.2011.09908

2020-11-19

Image and Video Processing

Abstract:Imaging volume of an iris recognition system has been restricting the throughput and cooperation convenience in biometric applications. Numerous improvement trials are still impractical to supersede the dominant fixed-focus lens in stand-off iris recognition due to incremental performance increase and complicated optical design. In this study, we develop a novel all-in-focus iris imaging system using a focus-tunable lens and a 2D steering mirror to greatly extend capture volume by spatiotemporal multiplexing method. Our iris imaging depth of field extension system requires no mechanical motion and is capable to adjust the focal plane at extremely high speed. In addition, the motorized reflection mirror adaptively steers the light beam to extend the horizontal and vertical field of views in an active manner. The proposed all-in-focus iris camera increases the depth of field up to 3.9 m which is a factor of 37.5 compared with conventional long focal lens. We also experimentally demonstrate the capability of this 3D light beam steering imaging system in real-time multi-person iris refocusing using dynamic focal stacks and the potential of continuous iris recognition for moving participants.
Ultrafast 3D Histological Imaging Based on a Minutes-Time Scale Tissue Clearing and Multidirectional Selective Plane Illumination Microscopy

Jiajia Chen,Zhenhong Du,Chenhao Xu,Xiao,Wei Gong,Ke Si

DOI: https://doi.org/10.1364/ol.463705

2022-01-01

Abstract:Conventional histopathological examinations are time-consuming and labor-intensive, and are insufficient to depict 3D pathological features intuitively. Here we report an ultrafast 3D histological imaging scheme based on optimized selective plane illumination microscopy (mSPIM), a minutes-time scale clearing method (FOCM), and a deep learning-based image enhancement algorithm (SRACNet) to realize histological preparation and imaging of clinical tissues. Our scheme enables 1-minute clearing and fast imaging (up to 900 mm2/min) of 200 µm-thick mouse kidney slices at micron-level resolution. With hematoxylin and eosin analog, we demonstrated the detailed 3D morphological connections between glomeruli and the surrounding tubules, which is difficult to identify in conventional 2D histology. Further, by the preliminary verification on human kidney tissues, this study will provide new, to the best of our knowledge, feasible histological solutions and inspirations in future 3D digital pathology.
Three-Dimensional In Vivo Imaging Of Human Anterior Eye Segment With Optical Coherence Tomography

Jiaxu Hong,Xiaoyu Liu,Wen Wen,Yubo Fan,Xinghuai Sun,Jianjiang Xu

2011-01-01

Abstract:Objects: A novel computer method for three-dimensional in vivo imaging of human anterior eye segment is described with optical coherence tomography. Methods: A laser beam was projected at an oblique angle on the cornea and scanned to acquire 18 optical section images at 10-degree intervals across the corneal area. Tissue's edges were detected using Canny detector, and Track Points arithmetic was designed to extract the single-pixel edges, which were smoothed by curve fitness. According to the characters of rotating image, which appeared displaced because of the motion blur of patients, the classical hat-head method was improved to build 3D model for OCT images sequence. Three B-Spine interpolation and curve fitness would be used to obtain the outlines if they were lost in original OCT images. The optical section images were segmented to construct a series of anterior eye. Imaging was performed in normal subject and patients. Results: A series of digital 3D model of anterior eye was reconstructed, which allowed enhanced visualization of the micro-structures, including the section of anterior eye segment at any rotating degree, the contours of corneal thickness and curvature, and the depths and angles of anterior chamber. Conclusion: A method for in vivo three-dimensional anterior eye imaging was developed, which has potential as a tool for objective, noninvasive and real-time evaluation of diseases.
Clinical 3D Imaging of the Anterior Segment With Ultrasound Biomicroscopy

Richard W Helms,Ahmed Tahseen Minhaz,David L Wilson,Faruk H Örge

DOI: https://doi.org/10.1167/tvst.10.3.11

2021-03-01

Abstract:Purpose: Ultrasound biomicroscopy (UBM) is an important ophthalmic imaging modality due to its ability to see behind pigmented iris and to visualize anterior chamber when the eye's transparency is compromised. We created a three-dimensional UBM (3D-UBM) system and acquired example images to illustrate its potential. Methods: A commercial 50-MHz two-dimensional UBM (2D-UBM) system was attached to a precision translation stage and translated across the eye to acquire an image volume. The stage was mounted on a surgical microscope, which enabled safe, stable positioning. Image processing steps included image alignment, noise reduction, and calibration. 3D visualization included alignment of the optic axis, multiplanar reformatting at arbitrary orientations, and volume rendering with optimized transfer functions. Scans were performed on cadaver and rabbit eyes. Results: 3D-UBM allowed visualization of the anterior segment tissues within a 3D anatomical context, unlike 2D-UBM. En face views and interactive slicer operations suggested an ability to plan and assess treatments, including lens placement and microcatheter cannulation of Schlemm's canal. Interactive software allowed us to make accurate measurements of tissue structures (e.g., iridocorneal angles, cyst volumes). In addition, unique measurements of ciliary tissues included single ciliary process volumes of 0.234 ± 0.093 mm3 with surface areas of 3.02 ± 1.07 mm2 and ciliary muscle volume of 67.87 mm3. Conclusions: 3D-UBM imaging of the anterior segment can be used to enable unique visualization and quantification of anterior segment structures. Translational relevance: 3D-UBM provides informative 3D imaging of tissues in the eye that are invisible to light to potentially provide physicians with improved diagnosis, treatment planning, and treatment assessment as compared to conventional 2D-UBM.
Three-dimensional Hessian Matrix-Based Quantitative Vascular Imaging of Rat Iris with Optical-Resolution Photoacoustic Microscopy in Vivo

Huangxuan Zhao,Guangsong Wang,Riqiang Lin,Xiaojing Gong,Liang Song,Tan Li,Wenjia Wang,Kunya Zhang,Xiuqing Qian,Haixia Zhang,Lin Li,Zhicheng Liu,Chengbo Liu

DOI: https://doi.org/10.1117/1.jbo.23.4.046006

IF: 3.758

2018-01-01

Journal of Biomedical Optics

Abstract:For the diagnosis and evaluation of ophthalmic diseases, imaging and quantitative characterization of vasculature in the iris are very important. The recently developed photoacoustic imaging, which is ultrasensitive in imaging endogenous hemoglobin molecules, provides a highly efficient label-free method for imaging blood vasculature in the iris. However, the development of advanced vascular quantification algorithms is still needed to enable accurate characterization of the underlying vasculature. We have developed a vascular information quantification algorithm by adopting a three-dimensional (3-D) Hessian matrix and applied for processing iris vasculature images obtained with a custom-built optical-resolution photoacoustic imaging system (OR-PAM). For the first time, we demonstrate in vivo 3-D vascular structures of a rat iris with a the label-free imaging method and also accurately extract quantitative vascular information, such as vessel diameter, vascular density, and vascular tortuosity. Our results indicate that the developed algorithm is capable of quantifying the vasculature in the 3-D photoacoustic images of the iris in-vivo, thus enhancing the diagnostic capability of the OR-PAM system for vascular-related ophthalmic diseases in vivo.
Delineating the anatomy of the ciliary body using hybrid optical and photoacoustic imaging

George J Tserevelakis,Stella Avtzi,Miltiadis K Tsilimbaris,Giannis Zacharakis

DOI: https://doi.org/10.1117/1.JBO.22.6.060501

2017-06-01

Abstract:We demonstrate the application of an extended field of view hybrid microscope, integrating distinct optical and photoacoustic (PA) contrast modes, for the precise three-dimensional anatomy delineation of the ciliary body/iris structures in healthy rabbit eyes ex vivo. The glutaraldehyde-induced autofluorescence and the intrinsic PA signals provided by each of the employed imaging modalities were characterized by a high spatial complementarity, offering thus rich morphological information regarding the pars plana and pars plicata ciliary body portions, the iris, as well as, the attached zonule fiber strands. The bimodal microscopy approach presented could find application on studies involving the ocular accommodation mechanism or pathological ciliary body conditions, as a powerful diagnostic technique contributing to the understanding of ocular physiology and function.
Fast 3-D Imaging of Brain Organoids With a New Single-Objective Planar-Illumination Two-Photon Microscope

Irina Rakotoson,Brigitte Delhomme,Philippe Djian,Andreas Deeg,Maia Brunstein,Christian Seebacher,Rainer Uhl,Clément Ricard,Martin Oheim

DOI: https://doi.org/10.3389/fnana.2019.00077

2019-08-20

Frontiers in Neuroanatomy

Abstract:Human inducible pluripotent stem cells (hiPSCs) hold a large potential for disease modeling. hiPSC-derived human astrocyte and neuronal cultures permit investigations of neural signaling pathways with subcellular resolution. Combinatorial cultures, and three-dimensional (3-D) embryonic bodies (EBs) enlarge the scope of investigations to multi-cellular phenomena. The highest level of complexity, brain organoids that—in many aspects—recapitulate anatomical and functional features of the developing brain permit the study of developmental and morphological aspects of human disease. An ideal microscope for 3-D tissue imaging at these different scales would combine features from both confocal laser-scanning and light-sheet microscopes: a micrometric optical sectioning capacity and sub-micrometric spatial resolution, a large field of view and high frame rate, and a low degree of invasiveness, i.e., ideally, a better photon efficiency than that of a confocal microscope. In the present work, we describe such an instrument that uses planar two-photon (2P) excitation. Its particularity is that—unlike two- or three-lens light-sheet microscopes—it uses a single, low-magnification, high-numerical aperture objective for the generation and scanning of a virtual light sheet. The microscope builds on a modified Nipkow-Petráň spinning-disk scheme for achieving wide-field excitation. However, unlike the Yokogawa design that uses a tandem disk, our concept combines micro lenses, dichroic mirrors and detection pinholes on a single disk. This new design, advantageous for 2P excitation, circumvents problems arising with the tandem disk from the large wavelength difference between the infrared excitation light and visible fluorescence. 2P fluorescence excited by the light sheet is collected with the same objective and imaged onto a fast sCMOS camera. We demonstrate 3-D imaging of TO-PRO3-stained EBs and of brain organoids, uncleared and after rapid partial transparisation with triethanolamine formamide (RTF) and we compare the performance of our instrument to that of a confocal laser-scanning microscope (CLSM) having a similar numerical aperture. Our large-field 2P-spinning disk microscope permits one order of magnitude faster imaging, affords less photobleaching and permits better depth penetration than a confocal microscope with similar spatial resolution.

neurosciences,anatomy & morphology
Infrared Imaging: IR Artificial Compound Eye (advanced Optical Materials 4/2020)

Feng Liu,Hao Bian,Fan Zhang,Qing Yang,Chao Shan,Minjing Li,Xun Hou,Feng Chen

DOI: https://doi.org/10.1002/adom.202070013

IF: 9

2020-01-01

Advanced Optical Materials

Abstract:A three-dimensional thin-shell infrared artificial compound eye (IR ACE) micro-optical component was realized by femtosecond laser-assisted micro-manufacturing and nano-imprinting with thermoplastic IR-selective material. The resultant IR ACE sample integrates more than one thousand high-quality micro facet lenslets over its extremely large viewing angle. The outstanding IR spectrum selectivity of such minimized component makes it competitive in IR imaging and target positioning. For further information see article number 1901767 by Qing Yang, Feng Chen and co-workers.
Ultrahigh-resolution Imaging of the Human Retina with Scan Modulation Visible Light Optical Coherence Tomography (conference Presentation)

Hao F. Zhang,Ian Rubinoff,Yuanbo Wang,Zeinab Ghassabi,Hiroshi Ishikawa,Joel Schuman,Roman Kuranov

DOI: https://doi.org/10.1117/12.2545207

2020-01-01

Abstract:We investigated clinical imaging of the human retina with visible-light optical coherence tomography (vis-OCT) with a 1 µm axial resolution. Imaging was performed with rectangular modulation of the scanning beam that reduced image speckle noise and preserved fine anatomical features. B-scans acquired with scan modulation revealed new anatomical features and demonstrated increased contrast to noise ratio (CNR) over regularly acquired B-scans.
Fast 3D Imaging in Optical Microscopy

Hsi-Hsun Chen,Xiaomin Zhai,Wei Tang Lin,Yuan Luo

DOI: https://doi.org/10.1117/2.1201501.005670

2015-01-01

SPIE Newsroom

Abstract:Optical microscopy approaches that provide acquisition of 3D information from a volumetric object are attractive for a number of biomedical applications. For example, conventional widefield microscopy requires depth focusing to obtain 3D signals within a biological sample volume. With confocal scanning microscopy,1 micrometer—or sub-micrometer—level resolution can be achieved, and contrast can be improved by using a small aperture to reject out-of-focus light. Efforts to improve the scanning speeds of these techniques, by optimizing scanning algorithms,2, 3 are ongoing. Such methods, however, are complicated and do not eliminate the need for moving parts. In addition, the complex designs that are involved increase the cost of the devices and reduce their robustness. Digital holographic microscopy (DHM)4 has recently been used to retrieve 3D information for biological samples. With DHM, a high-resolution CCD camera is used to record holograms. Each hologram consists of a 2D slice of the object, and the holograms are superimposed and stored in computer memory. Although with this approach volumetric image data for an object can be reconstructed from the stored information, it requires complex computational reconstruction techniques and has stringent optical and mechanical design requirements for imaging. We have developed a spatial-spectral imaging method that can be used to acquire resolved images from multiple depths simultaneously. We are able to leverage a strong Bragg filtering property of a wavefront—with respect to angle (spatial) and wavelength (spectral)5—in our volume holographic imaging (VHI) approach to capture multi-plane images in real time, without scanning. Furthermore, a key volume hologram component in VHI offers a 3D pupil, rather than a conventional 2D diffractive element. By incorporating VHI with different recording strategies, we have engineered this functionally unique 3D pupil Figure 1. (a) Schematic illustration of a volume holographic imaging (VHI) experimental setup, which includes two phase-coded multiplexed gratings. (b) Schematic diagram that illustrates the functional recording method for a spatial filter-encoded volume hologram (VH). An internal angle ( ) is introduced during multiplexing. fO : Focal length of the objective lens. fC : Focal length of the collector lens.
Integrated Photoacoustic Microscopy, Optical Coherence Tomography, and Fluorescence Microscopy for Multimodal Chorioretinal Imaging.

Chao Tian,Wei Zhang,Van Phuc Nguyen,Ziyi Huang,Xueding Wang,Yannis M. Paulus

DOI: https://doi.org/10.1117/12.2290594

2018-01-01

Abstract:Current clinically available retinal imaging techniques have limitations, including limited depth of penetration or requirement for the invasive injection of exogenous contrast agents. Here, we developed a novel multimodal imaging system for high-speed, high-resolution retinal imaging of larger animals, such as rabbits. The system integrates three state-of-the-art imaging modalities, including photoacoustic microscopy (PAM), optical coherence tomography (OCT), and fluorescence microscopy (FM). In vivo experimental results of rabbit eyes show that the PAM is able to visualize laser-induced retinal burns and distinguish individual eye blood vessels using a laser exposure dose of ~80 nJ, which is well below the American National Standards Institute (ANSI) safety limit 160 nJ. The OCT can discern different retinal layers and visualize laser burns and choroidal detachments. The novel multi-modal imaging platform holds great promise in ophthalmic imaging.
Design of 1300 Nm Spectral Domain Optical Coherence Tomography Angiography System for Iris Microvascular Imaging

Gongpu Lan,Jingjiang Xu,Zhilin Hu,Yanping Huang,Yingzhao Wei,Xing Yuan,Huazong Liu,Jia Qin,Yicheng Wang,Qun Shi,Jun Zeng,Yue Shi,Jinping Feng,Haishu Tan,Lin An,Xunbin Wei

DOI: https://doi.org/10.1088/1361-6463/abf577

2021-01-01

Abstract:Developing a high-resolution non-invasive optical coherence tomography angiography (OCTA) method for iris vasculature imaging is essential for diagnosing a wide range of ocular pathologies. However, the current iris-OCTA devices are still limited in imaging quality and penetration depth for dark-colored eyes ranging from brown to dark brown. A spectral domain iris-OCTA system is presented in this paper incorporating a 1300 nm wavelength for deeper tissue penetration, a linear-wavenumber spectrometer for better detection sensitivity, and an iris scan objective lens for better optical focusing across the entire iris over a 12 x 12 mm(2) scan field. The -6 dB fall-off range is similar to 3 mm, and the maximum sensitivity fall-off is -28.57 dB at 6.94 mm. The axial resolution is 15.1 +/- 3.2 mu m. The 40 mm focal-length iris scan objective is optimized based on the ocular parameters from 100 Asian participants' left eyes, and it has a diffraction-limited lateral resolution (14.14 mu m) for the iris, in general. OCT distortions were calibrated based on the average ocular parameters, and the maximum residual distortions in both the lateral and axial directions were <0.1 mm (2.0%) for all of the eyes. A pilot study on a constricted pupil was performed to demonstrate high-contrast, wide-field en face iris microvascular imaging by either a horizontal or vertical fast-scan protocol in a dark brown eye. The iris vessels are radially aligned, and each vessel is more visible when it has an angle of similar to 65 degrees-90 degrees with respect to the fast-scan direction. A new circular fast-scan protocol could improve image quality for better visualization of the iris features or integration with image-registration algorithms and an eye-tracking system for eye-motion compensation.
Snapshot projection optical tomography

Yongjin Sung

DOI: https://doi.org/10.1103/PhysRevApplied.13.054048

2020-05-21

Abstract:We present a plenoptic microscopy configuration for 3D snapshot imaging, which is dual telecentric and can directly record true projection images corresponding with different viewing angles. It also allows blocking high-angle stray rays without sacrificing the light collection efficiency. This configuration named as snapshot projection optical tomography (SPOT) arranges an objective lens and a microlens array (MLA) in a 4-f telecentric configuration and places an aperture stop at the back focal plane of a relay lens. We develop a forward imaging model for SPOT, which can also be applied to existing light field microscopy techniques using an MLA as tube lens. Using the developed system, we demonstrate snapshot 3D imaging of various fluorescent beads and a biological cell, which confirms the capability of SPOT for imaging specimens with an extended fluorophore distribution as well as isolated fluorochromes. The transverse and vertical resolutions are measured to be 0.8 $\mu$m and 1.6 $\mu$m, respectively.

Optics,Image and Video Processing,Biological Physics
Design, fabrication and testing of a compact large-field-of-view infrared compound eye imaging system by precision glass molding

Lin Zhang,Luyang Zhou,Wenchen Zhou,Shuqing Zhang,Allen Y. Yi

DOI: https://doi.org/10.1016/j.precisioneng.2020.06.017

IF: 3.315

2020-11-01

Precision Engineering

Abstract:<p>Bionic artificial compound eyes inspire a promising field of miniaturized imaging systems. In this research, a novel infrared (IR) three-dimensional (3D) compound eye imaging system, consisting of a double-side molded 3D microlens array and an aperture array, was designed and fabricated by combining modulated slow-tool-servo diamond turning and precision glass molding. To facilitate the complex profiles on the mold inserts, two novel slow-tool-servo strategies were adopted, namely virtual-axis based diamond broaching and adaptive diamond turning. This microlens array consists of 3 × 3 channels for a field of view of 48° × 48° with a thickness of 1.8 mm. The freeform microlens array on a flat surface was employed to steer and focus the incident light from all three dimensions to a two-dimension (2D) infrared imager. Using raytracing, the profiles of the freeform microlenses of each channel were optimized to obtain the best imaging performance. To avoid crosstalk among adjacent channels, a 3D printed three-dimensional micro aperture array was mounted between the microlens array and the IR imager. The imaging tests of the infrared compound-eye imaging system using the molded chalcogenide glass lenses showed that the asymmetrical freeform lenslets were capable of steering and forming images within the designed field of view. Compared to a conventional infrared camera, this novel microlens array can achieve a considerably larger field-of-view while maintaining low manufacturing cost without sacrificing image quality.</p>

English Else
IR Artificial Compound Eye

Feng Liu,Hao Bian,Fan Zhang,Qing Yang,Chao Shan,Minjing Li,Xun Hou,Feng Chen

DOI: https://doi.org/10.1002/adom.201901767

IF: 9

2020-01-01

Advanced Optical Materials

Abstract:In this work, a 3D IR artificial compound eye (ACE) optical component is fabricated using thermoplastic IR polymer material. The femtosecond laser-assisted wet etching and the 3D nano-imprinting techniques are proposed for fabricating this thin shell multi-aperture component. The prepared component is close-packed with over 1000 high-quality micro-facet-lenslets (ommatidia) on the semispherical thin shell dome with base radius of 2.7 mm and sag height of 2.1 mm, enabling enlarged field of view to 148 degrees. The ommatidia with diameter of 150 mu m and numerical aperture of 0.35 are demonstrated to have a practical spatial resolution up to 160 lp mm(-1). IR imaging experiments (both in passive and active scenarios) confirm its outstanding optical properties and uniformity, and demonstrate the probability of thermal target imaging with such component in the near-infrared band. The proposed fabrication strategy shows remarkable efficiency and advantage in massive replication, and such ACE component predicts its potential in emerging applications, such as IR imaging, target tracking, and so on.
High-speed 3D Imaging with 25-Camera Multifocus Microscope

Eduardo Hirata-Miyasaki,Antone A. Bajor,Gustav M. Petterson,Maximilian L. Senftleben,Kaitlyn E Fouke,Thomas G.W. Graham,Demis D John,Jennifer R. Morgan,Gal Haspel,Sara Abrahamsson

DOI: https://doi.org/10.1101/2024.09.23.614351

2024-09-24

Abstract:We here report an aberration corrected 25 plane camera array Multifocus microscope (M25) for high speed, high resolution widefield optical microscopy in three spatial dimensions (3D). We demonstrate live imaging of 25 plane 3D volumes of up to 180x180x50um at >100 volumes per second. 3D data is recorded simultaneously by an array of 25 small, sensitive, synchronized machine vision cameras. M25 employs aberration corrected Multifocus microscopy, an optical method where diffractive Fourier optics are used for multiplexing and refocusing light, with a simplified design for chromatic dispersion correction where a corrective diffractive grating is placed on each camera in the array. This elegant architecture for chromatic correction will be applicable in a broad range of diffractive imaging applications. M25 is a powerful optical tool for high speed 3D microscopy in that it allows both non invasive, label free bright field and highly sensitive fluorescence microscopy. We showcase M25 capabilities in 3D particle tracking, bright field and fluorescence imaging in D. melanogaster, and locomotion and neural activity studies in C. elegans.

Neuroscience
Volumetric particle image velocimetry with a single plenoptic camera

Timothy W Fahringer,Kyle P Lynch,Brian S Thurow

DOI: https://doi.org/10.1088/0957-0233/26/11/115201

IF: 2.398

2015-09-29

Measurement Science and Technology

Abstract:A novel three-dimensional (3D), three-component (3C) particle image velocimetry (PIV) technique based on volume illumination and light field imaging with a single plenoptic camera is described. A plenoptic camera uses a densely packed microlens array mounted near a high resolution image sensor to sample the spatial and angular distribution of light collected by the camera. The multiplicative algebraic reconstruction technique (MART) computed tomography algorithm is used to reconstruct a volumetric intensity field from individual snapshots and a cross-correlation algorithm is used to estimate the velocity field from a pair of reconstructed particle volumes. This work provides an introduction to the basic concepts of light field imaging with a plenoptic camera and describes the unique implementation of MART in the context of plenoptic image data for 3D/3C PIV measurements. Simulations of a plenoptic camera using geometric optics are used to generate synthetic plenoptic particle images, which are subsequently used to estimate the quality of particle volume reconstructions at various particle number densities. 3D reconstructions using this method produce reconstructed particles that are elongated by a factor of approximately 4 along the optical axis of the camera. A simulated 3D Gaussian vortex is used to test the capability of single camera plenoptic PIV to produce a 3D/3C vector field, where it was found that lateral displacements could be measured to approximately 0.2 voxel accuracy in the lateral direction and 1 voxel in the depth direction over a voxel volume. The feasibility of the technique is demonstrated experimentally using a home-built plenoptic camera based on a 16-megapixel interline CCD camera and a array of microlenses and a pulsed Nd:YAG laser. 3D/3C measurements were performed in the wake of a low Reynolds number circular cylinder and compared with measurements made using a conventional 2D/2C PIV system. Overall, single camera plenoptic PIV is shown to be a viable 3D/3C velocimetry technique.

engineering, multidisciplinary,instruments & instrumentation
In Vivo Ocular Microvasculature Imaging in Rabbits with 3D Ultrasound Localization Microscopy

Shuang Lei,Changlu Zhang,Benpeng Zhu,Zeping Gao,Qi Zhang,Jiamei Liu,Yongchuan Li,Hairong Zheng,Teng Ma

DOI: https://doi.org/10.1016/j.ultras.2023.107022

IF: 4.2

2023-05-11

Ultrasonics

Abstract:Morphological and hemodynamic changes in the ocular vasculature are important signs of various ocular diseases. The evaluation of the ocular microvasculature with high resolution is valuable in comprehensive diagnoses. However, it is difficult for current optical imaging techniques to visualize the posterior segment and retrobulbar microvasculature due to the limited penetration depth of light, particularly when the refractive medium is opaque. Thus, we have developed a 3D ultrasound localization microscopy (ULM) imaging method to visualize the ocular microvasculature in rabbits with micron-scale resolution. We used a 32 × 32 matrix array transducer (center frequency: 8 MHz) with a compounding plane wave sequence and microbubbles. Block-wise singular value decomposition spatiotemporal clutter filtering and block-matching 3D denoising were implemented to extract the flowing microbubble signals at different imaging depths with high signal-to-noise ratios. The center points of microbubbles were localized and tracked in 3D space to achieve the micro-angiography. The in vivo results demonstrate the ability of 3D ULM to visualize the microvasculature of the eye in rabbits, where vessels down to 54 μm were successfully revealed. Moreover, the microvascular maps indicated the morphological abnormalities in the eye with retinal detachment. This efficient modality shows potential for use in the diagnosis of ocular diseases.

acoustics,radiology, nuclear medicine & medical imaging

Human Iris 3D Imaging using a micro-Plenoptic Camera

Human Iris Three-Dimensional Imaging at Micron Resolution by a Micro-Plenoptic Camera.

A 3D Iris Scanner From a Single Image Using Convolutional Neural Networks

All-in-Focus Iris Camera With a Great Capture Volume

Ultrafast 3D Histological Imaging Based on a Minutes-Time Scale Tissue Clearing and Multidirectional Selective Plane Illumination Microscopy

Three-Dimensional In Vivo Imaging Of Human Anterior Eye Segment With Optical Coherence Tomography

Clinical 3D Imaging of the Anterior Segment With Ultrasound Biomicroscopy

Three-dimensional Hessian Matrix-Based Quantitative Vascular Imaging of Rat Iris with Optical-Resolution Photoacoustic Microscopy in Vivo

Delineating the anatomy of the ciliary body using hybrid optical and photoacoustic imaging

Fast 3-D Imaging of Brain Organoids With a New Single-Objective Planar-Illumination Two-Photon Microscope

Infrared Imaging: IR Artificial Compound Eye (advanced Optical Materials 4/2020)

Ultrahigh-resolution Imaging of the Human Retina with Scan Modulation Visible Light Optical Coherence Tomography (conference Presentation)

Fast 3D Imaging in Optical Microscopy

Integrated Photoacoustic Microscopy, Optical Coherence Tomography, and Fluorescence Microscopy for Multimodal Chorioretinal Imaging.

Design of 1300 Nm Spectral Domain Optical Coherence Tomography Angiography System for Iris Microvascular Imaging

Snapshot projection optical tomography

Design, fabrication and testing of a compact large-field-of-view infrared compound eye imaging system by precision glass molding

IR Artificial Compound Eye

High-speed 3D Imaging with 25-Camera Multifocus Microscope

Volumetric particle image velocimetry with a single plenoptic camera

In Vivo Ocular Microvasculature Imaging in Rabbits with 3D Ultrasound Localization Microscopy