Diffuser-based computational imaging funduscope

Yunzhe Li,Gregory N. McKay,Nicholas J. Durr,Lei Tian,Gregory McKay,Nicholas Durr

DOI: https://doi.org/10.1364/OE.395112

IF: 3.8

2020-06-20

Optics Express

Abstract:Yunzhe Li, Gregory N. McKay, Nicholas J. Durr, Lei Tian Poor access to eye care is a major global challenge that could be ameliorated by low-cost, portable, and easy-to-use diagnostic ... [Opt. Express 28, 19641-19654 (2020)]

optics

What problem does this paper attempt to address?

Deep Learning Colorful Ptychographic Iterative Engine Lens-Less Diffraction Microscopy

Yinxu Bian,Yannan Jiang,Jiaxiong Wang,Shenmin Yang,Weijie Deng,Xiaofei Yang,Renbing Shen,Hua Shen,Cuifang Kuang

DOI: https://doi.org/10.1016/j.optlaseng.2021.106843

IF: 5.666

2022-01-01

Optics and Lasers in Engineering

Abstract:The ptychographic iterative engine (PIE) is an algorithm for coherent lens-less diffraction imaging. It facilitates the development of low-cost large field of view (FOV) lens-less microscopy, as it can expand the FOV extensively by moving the light source or the bio-medical pathological sample slide. In a PIE setup, the illumination light needs to have high/partially coherence. Thus, to get a colorful microscopy image, more than 3 illumination light sources with different dominant wavelengths are required in a traditional PIE setup. In this manuscript, an improved PIE based on computational deep learning color-transferring method is proposed to achieve colorful large FOV lens-less microscopy imaging. In our method, only one high/partially coherent light source is used, where the image data are three times less than those images under multiple illuminations for colorful PIE microscopy. It is believable that our colorful PIE microscopy enhanced by the deep color-transferring method would be helpful for the development of low-cost large FOV lens-less microscopes.
In vivo fundus imaging and computational refocusing with a diffuser-based fundus camera

Corey Simmerer,Marisa Morakis,Lei Tian,Lia Gomez-Perez,T.Y. Alvin Liu,Nicholas J. Durr

2024-06-11

Abstract:Access to eye care can be expanded with high-throughput, easy-to-use, and portable diagnostic tools. Phase mask encoded imaging could improve these aspects of the fundus camera by enabling computational refocusing without any moving parts. This approach circumvents the need to adjust lenses to compensate for refractive errors. We developed a computational fundus camera by introducing a holographic diffuser at the plane conjugate to the ocular pupil, resulting in a laterally shift-invariant point spread function. We demonstrate computational refocusing of a model eye fundus over a large range of defocus errors. We also show computationally refocused, color, in vivo, human fundus images with a $\geq$35-degree field-of-view (FOV). This technology could eventually be combined with the wavefront-sensing capabilities of phase mask encoded imaging to create a compact ophthalmic imaging system that simultaneously captures a fundus image and performs aberrometry.

Optics,Medical Physics
High-performance Imaging with an Advanced Non-Imaging Lens Based on Full-Path Optical Diffraction Calculation in Two-Dimensional Space

Yingli Liu,Yijie Dai,Fanqi Shen,Lin Yang,Zhanghao Ding,Zhenrong Zheng,Rengmao Wu,Liu Xu

DOI: https://doi.org/10.1364/oe.449685

IF: 3.8

2022-01-01

Optics Express

Abstract:High-performance image-forming systems often require high system complexity due to the overdetermined nature of optical aberration correction. What we present here is a novel computational imaging modality which can achieve high-performance imaging using a simple non-image-forming optical system. The presented optical system contains an aspherical non-imaging lens which is designed with the optimal transfer of light radiation between an object and a detector. All spatial frequencies of the object collected by the non-imaging lens are delivered to the detector. No image is formed on the detector, and a full-path optical diffraction calculation method is developed to recover a high-quality image of the object from multiple intensity measurements. The effectiveness and high performance of the proposed imaging modality is verified by the examples.
Computational Diffraction-Limited Imaging with a Non-Imaging Spatial Information Transfer Lens

Yingli Liu,Zhihui Ding,Fengxu Guo,Cheng Guo,Shengnan Jia,Haifeng Li,Rengmao Wu,Xu Liu

DOI: https://doi.org/10.1364/prj.523318

IF: 7.6

2024-01-01

Photonics Research

Abstract:The demand for low-cost, high-performance miniaturized optical imaging systems requires creating a new imaging paradigm. In this paper, we propose an imaging paradigm that achieves diffraction-limited imaging with a non-imaging spatial information transfer lens. The spatial information transfer lens realizes a perfect match between the space-bandwidth product (SBP) of the lens and that of the image sensor so that the collected spatial information from the object can be totally recorded and fully resolved by the image sensor. A backward wave propagation model is developed to reconstruct the object by propagating the light wave modulated by the information transfer lens back from the image space to object space. The proposed imaging paradigm breaks the point-to-point imaging structure and removes the focusing-distance constraint, allowing a flexible arrangement of the object and the image sensor along the optical axis with a compact form factor of the optical system. We experimentally demonstrate the versatility and effectiveness of the proposed imaging paradigm. The proposed imaging paradigm is low-cost, simple in configuration, flexible in arrangement, and diffraction limited with great potential applications in biomedical imaging. (c) 2024 Chinese Laser Press
Telemedicine Screening of Retinal Diseases with a Handheld Portable Non-Mydriatic Fundus Camera

Kai Jin,Haitong Lu,Zhaoan Su,Chuming Cheng,Juan Ye,Dahong Qian

DOI: https://doi.org/10.1186/s12886-017-0484-5

IF: 2.086

2017-01-01

BMC Ophthalmology

Abstract:BACKGROUND:We modified and reconstructed a high image quality portable non-mydriatic fundus camera and compared it with the tabletop fundus camera to evaluate the efficacy of the new camera in detecting retinal diseases.METHODS:We designed and built a novel portable handheld fundus camera with telemedicine system. The image quality of fundus cameras was compared to that of existing commercial tabletop cameras by taking photographs of 364 eyes from the 254 patients. In all 800 fundus images taken by two camera types, 400 images per camera, were graded with the four image clarity classifications.RESULTS:Using the portable fundus camera, 63% (252/400) images were graded as excellent overall quality, 20.5% (82/400) were good, 11.75% (47/400) were fair, and 4.75% (19/400) were inadequate. Using the tabletop fundus camera, 70.75% (283/400) images were graded as excellent overall quality, 20.4% (51/400) were good, 13.25% (53/400) were fair, and 3.25% (13/400) were inadequate. Common retinal diseases were easily identified from fundus images obtained from the portable fundus camera.CONCLUSION:The new type of non-mydriatic portable fundus camera was qualified to have professional quality of fundus images. The revolutionary screening camera provides a foundational platform which can potentially improve the accessibility of retinal screening programmes.
Integrating a Fundus Camera with High-Frequency Ultrasound for Precise Ocular Lesion Assessment

Alfa Rossi,Yushun Zeng,Mojtaba Rahimi,Taeyoon Son,Michael J Heiferman,Chen Gong,Xin Sun,Mohammad Soleimani,Ali R Djalilian,Mark S Humayun,Qifa Zhou,Xincheng Yao

DOI: https://doi.org/10.3390/bios14030127

2024-02-29

Abstract:Ultrasound A-scan is an important tool for quantitative assessment of ocular lesions. However, its usability is limited by the difficulty of accurately localizing the ultrasound probe to a lesion of interest. In this study, a transparent LiNbO3 single crystal ultrasound transducer was fabricated, and integrated with a widefield fundus camera to guide the ultrasound local position. The electrical impedance, phase spectrum, pulse-echo performance, and optical transmission spectrum of the ultrasound transducer were validated. The novel fundus camera-guided ultrasound probe was tested for in vivo measurement of rat eyes. Anterior and posterior segments of the rat eye could be unambiguously differentiated with the fundus photography-guided ultrasound measurement. A model eye was also used to verify the imaging performance of the prototype device in the human eye. The prototype shows the potential of being used in the clinic to accurately measure the thickness and echogenicity of ocular lesions in vivo.
A portable widefield fundus camera with high dynamic range imaging capability

Alfa Rossi,Mojtaba Rahimi,David Le,Taeyoon son,Michael J. Heiferman,R. V. Paul Chan,Xincheng Yao

DOI: https://doi.org/10.48550/arXiv.2212.13257

IF: 4.506

2022-12-20

Medical Physics

Abstract:Fundus photography is indispensable for clinical detection and management of eye diseases. Limited image contrast and field of view (FOV) are common limitations of conventional fundus cameras, making it difficult to detect subtle abnormalities at the early stages of eye diseases. Further improvements of image contrast and FOV coverage are important to improve early disease detection and reliable treatment assessment. We report here a portable fundus camera, with a wide FOV and high dynamic range (HDR) imaging capabilities. Miniaturized indirect ophthalmoscopy illumination was employed to achieve the portable design for nonmydriatic, widefield fundus photography. Orthogonal polarization control was used to eliminate illumination reflectance artifact. With independent power controls, three fundus images were sequentially acquired and fused to achieve HDR function for local image contrast enhancement. A 101{\deg} eye-angle (67{\deg} visual-angle) snapshot FOV was achieved for nonmydriatic fundus photography. The effective FOV can be readily expanded up to 190{\deg} eye-angle (134{\deg} visual-angle) with the aid of a fixation target, without the need of pharmacologic pupillary dilation. The effectiveness of HDR imaging was validated with both normal healthy and pathologic eyes, compared to a conventional fundus camera.
High-Resolution Ex-Vivo Imaging of Retina with a Laptop-Based Portable Endoscope

Yanni Ge,Kai Jin,Yao Wang,Yufeng Xu,Haitong Lu,Juan Ye

DOI: https://doi.org/10.1155/2022/1903516

2022-01-01

Journal of Ophthalmology

Abstract:Purpose. Ophthalmic endoscopy is useful in vitreoretinal surgery with opaque anterior segments or anatomically challenging structures. However, standard ophthalmic endoscopy devices are usually large and costly. Thus, the development of a portable endoscope is necessary. Methods. The portable endoscope consisted of a probe, an illumination system, a high-resolution camera module, and a universal serial bus (USB). It was connected to a laptop and applied for intraocular imaging of porcine eyes in vitro. Basic parameters and pictures of the same tissue target were compared with those of the standard Endo Optiks E4 system. Results. The retinal images were displayed on the laptop screen, which clearly showed the overall appearance of the central and peripheral retina, and the details of the retinal vasculature and ciliary body. Compared with a standard endoscope, our portable endoscope is smaller and more affordable. It can be taken anywhere for intraocular imaging and vitreoretinal surgery. Conclusion. A laptop-based portable endoscope is a promising device in vitreoretinal surgery. It provides high-resolution images of intraocular tissues that should make a noticeable difference in intraocular surgery with disordered anterior segments. With its portability and high-resolution imaging, it may promote the application of endoscopes in ophthalmology.
Smartphone-based Fundus Imaging System

Cong Jing,Zu Ming-ming,Li Hong-tao,Cui Xiao-yu,Chen Shuo,Xi Peng

DOI: https://doi.org/10.3788/co.20191201.0097

2019-01-01

Abstract:Fundus photography is used to examine the status of retinas, providing important diagnostic information about retinal diseases. Traditional fundus imaging systems are usually disadvantageous for their large size, difficulty of operation, high cost, etc.. With the recent rapid development of smartphones, their cameras, storage and transmission systems, have improved significantly, making them capable of being used for fundus imaging. Thus, the development and design of the fundus imaging system based on smartphones can overcome the shortcomings of traditional fundus imaging. In this study, the imaging and illumination optical path of the smartphone-based fundus imaging system was designed and the size was minimized as a smartphone accessary using 3D printing. Based on the results from the smartphone-based retinal imaging system, the working distance between the proposed system and an artificial eye was approximately 17 mm and the system was placed in a smartphone accessory with a size of 88 mm x 79 mm x 42 mm. Zemax was used to further optimize the design for better image quality. The distortion of the optimized imaging system is less than 0.2% and the curvature of field is less than 10 mu m. The proposed system is portable, noninvasive and cost effective, which is expected to be applied in community hospitals in the near future.
Developing portable widefield fundus camera for teleophthalmology: Technical challenges and potential solutions

Xincheng Yao,Taeyoon Son,Jiechao Ma

DOI: https://doi.org/10.1177/15353702211063477

2021-12-08

Experimental Biology and Medicine

Abstract:A portable, low cost, widefield fundus camera is essential for developing affordable teleophthalmology. However, conventional trans-pupillary illumination used in traditional fundus cameras limits the field of view (FOV) in a snapshot image, and frequently requires pharmacologically pupillary dilation for reliable examination of eye conditions. This minireview summarizes recent developments in alternative illumination approaches for widefield fundus photography. Miniaturized indirect illumination has been used to enable compact design for developing low cost, portable, widefield fundus camera. Contact mode trans-pars-planar illumination has been validated for ultra-widefield fundus imaging of infant eyes. Contact-free trans-pars-planar illumination has been explored for widefield imaging of adult eyes. Trans-palpebral illumination has been also demonstrated in a smartphone-based widefield fundus imager to foster affordable teleophthalmology.

medicine, research & experimental
Low-cost single-shot complex optical field imaging with a simplified aperture

Ruifeng Zhang,Huayu Li,Yunxu Sun,Liang Fei,Xiangru Liu,Chengqing Ning,Xiaochuan Xu,Zhengjun Liu,Wei Liu

DOI: https://doi.org/10.1016/j.optlaseng.2024.108028

IF: 5.666

2024-04-01

Optics and Lasers in Engineering

Abstract:We report a new computational imaging methodology for complex optical field based on a single-frame diffraction intensity pattern acquisition with a simplified aperture and an extremely low-cost industrial machine vision camera. The current design of the apertures for the recovery of complex optical field was suffering from specific coding associated with the use of spatial light modulator or digital micromirror device, where it is difficult to make the optical implementations compact and cost-effective. In this work, we demonstrate that a simplified aperture without any pattern-like coding is efficient to establish the physical constraint for computational reconstruction. The aperture attached to the object defines the imaging region of interest (ROI) with coherent trans-illumination, and only one snapshot of the diffraction intensity pattern is required for recovering the ROI's complex field. Proof-of-concept numerical simulations and optical experiments have been carried out to validate the feasibility, noise robustness, resolution, and potential biological imaging applications of the proposed computational method.

optics
Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Min Guo,Yue Li,Yijun Su,Talley Lambert,Damian Dalle Nogare,Mark W. Moyle,Leighton H. Duncan,Richard Ikegami,Anthony Santella,Ivan Rey-Suarez,Daniel Green,Anastasia Beiriger,Jiji Chen,Harshad Vishwasrao,Sundar Ganesan,Victoria Prince,Jennifer C. Waters,Christina M. Annunziata,Markus Hafner,William A. Mohler,Ajay B. Chitnis,Arpita Upadhyaya,Ted B. Usdin,Zhirong Bao,Daniel Colon-Ramos,Patrick La Riviere,Huafeng Liu,Yicong Wu,Hari Shroff

DOI: https://doi.org/10.1038/s41587-020-0560-x

IF: 46.9

2020-01-01

Nature Biotechnology

Abstract:The contrast and resolution of images obtained with optical microscopes can be improved by deconvolution and computational fusion of multiple views of the same sample, but these methods are computationally expensive for large datasets. Here we describe theoretical and practical advances in algorithm and software design that result in image processing times that are tenfold to several thousand fold faster than with previous methods. First, we show that an 'unmatched back projector' accelerates deconvolution relative to the classic Richardson-Lucy algorithm by at least tenfold. Second, three-dimensional image-based registration with a graphics processing unit enhances processing speed 10- to 100-fold over CPU processing. Third, deep learning can provide further acceleration, particularly for deconvolution with spatially varying point spread functions. We illustrate our methods from the subcellular to millimeter spatial scale on diverse samples, including single cells, embryos and cleared tissue. Finally, we show performance enhancement on recently developed microscopes that have improved spatial resolution, including dual-view cleared-tissue light-sheet microscopes and reflective lattice light-sheet microscopes.
Preclinical imaging of iridocorneal angle and fundus using a modified integrated flexible handheld probe

Xun Jie Jeesmond Hong,Vengalathunadakal K Shinoj,Vadakke Matham Murukeshan,Mani Baskaran,Tin Aung

DOI: https://doi.org/10.1117/1.JMI.4.2.026001

Abstract:A flexible handheld imaging probe consisting of a [Formula: see text] charge-coupled device camera, light-emitting diode light sources, and near-infrared laser source is designed and developed. The imaging probe is designed with specifications to capture the iridocorneal angle images and posterior segment images. Light propagation from the anterior chamber of the eye to the exterior is considered analytically using Snell's law. Imaging of the iridocorneal angle region and fundus is performed on ex vivo porcine samples and subsequently on small laboratory animals, such as the New Zealand white rabbit and nonhuman primate, in vivo. The integrated flexible handheld probe demonstrates high repeatability in iridocorneal angle and fundus documentation. The proposed concept and methodology are expected to find potential application in the diagnosis, prognosis, and management of glaucoma.
Temporal compressive edge imaging enabled by a lensless diffuser camera

Ze Zheng,Baolei Liu,Jiaqi Song,Lei Ding,Xiaolan Zhong,Lingqian Chang,Xiaojun Wu,David McGloin,Fan Wang

DOI: https://doi.org/10.1364/ol.515429

IF: 3.6

2024-05-29

Optics Letters

Abstract:Ze Zheng, Baolei Liu, Jiaqi Song, Lei Ding, Xiaolan Zhong, Lingqian Chang, Xiaojun Wu, David McGloin, Fan Wang Lensless imagers based on diffusers or encoding masks enable high-dimensional imaging from a single-shot measurement and have been applied ... [Opt. Lett. 49, 3058-3061 (2024)]

optics
A Miniaturized Large-Field Fundus Optical System Based on Aspheric Imaging and Non-Coaxial Illumination

Shuo Liu,Aiming Ge,Jiangbo Wu,Qiuyang Wang

DOI: https://doi.org/10.3390/app14146216

2024-01-01

Abstract:Many diseases produce pathological changes in the fundus; analyzing the retinopathy of the fundus could help diagnose diseases in time. A fundus camera is a medical imaging device that specializes in taking fundus images to diagnose hypertension, coronary heart disease, diabetes, and others. The fundus optical imaging system is the core part of it. Nevertheless, the conventional fundus optical imaging system is large and not suitable for mobile examination and follow-up use. So, it has not been widely used in medical institutions. In this paper, a miniaturized fundus optical imaging system based on aspheric technology and non-coaxial illumination is proposed. The length of the imaging system is only 34.6 mm, the field of view is 50°, and the MTF curve is greater than 0.2 at 100 lp/mm, which can resolve the structure of 5 um. The illumination system adopts a non-coaxial annular array illumination structure to avoid occlusion of the imaging system. Our study effectively tackles the pressing predicament of fundus optical system miniaturization. This innovative paradigm harbors the potential to revolutionize fundus image data acquisition, propelling the field of fundus diagnosis forward and efficiently catering to crucial applications, improving the versatility of fundus examination, and providing technical support for the intelligent diagnosis system.
Fundus image enhancement through direct diffusion bridges

Sehui Kim,Hyungjin Chung,Se Hie Park,Eui-Sang Chung,Kayoung Yi,Jong Chul Ye

2024-09-19

Abstract:We propose FD3, a fundus image enhancement method based on direct diffusion bridges, which can cope with a wide range of complex degradations, including haze, blur, noise, and shadow. We first propose a synthetic forward model through a human feedback loop with board-certified ophthalmologists for maximal quality improvement of low-quality in-vivo images. Using the proposed forward model, we train a robust and flexible diffusion-based image enhancement network that is highly effective as a stand-alone method, unlike previous diffusion model-based approaches which act only as a refiner on top of pre-trained models. Through extensive experiments, we show that FD3 establishes \add{superior quality} not only on synthetic degradations but also on in vivo studies with low-quality fundus photos taken from patients with cataracts or small pupils. To promote further research in this area, we open-source all our code and data used for this research at <a class="link-external link-https" href="https://github.com/heeheee888/FD3" rel="external noopener nofollow">this https URL</a>

Image and Video Processing,Computer Vision and Pattern Recognition
Computational imaging without a computer: seeing through random diffusers at the speed of light

Yi Luo,Yifan Zhao,Jingxi Li,Ege Çetintaş,Yair Rivenson,Mona Jarrahi,Aydogan Ozcan

DOI: https://doi.org/10.1186/s43593-022-00012-4

2022-01-26

eLight

Abstract:Abstract Imaging through diffusers presents a challenging problem with various digital image reconstruction solutions demonstrated to date using computers. Here, we present a computer-free, all-optical image reconstruction method to see through random diffusers at the speed of light. Using deep learning, a set of transmissive diffractive surfaces are trained to all-optically reconstruct images of arbitrary objects that are completely covered by unknown, random phase diffusers. After the training stage, which is a one-time effort, the resulting diffractive surfaces are fabricated and form a passive optical network that is physically positioned between the unknown object and the image plane to all-optically reconstruct the object pattern through an unknown, new phase diffuser. We experimentally demonstrated this concept using coherent THz illumination and all-optically reconstructed objects distorted by unknown, random diffusers, never used during training. Unlike digital methods, all-optical diffractive reconstructions do not require power except for the illumination light. This diffractive solution to see through diffusers can be extended to other wavelengths, and might fuel various applications in biomedical imaging, astronomy, atmospheric sciences, oceanography, security, robotics, autonomous vehicles, among many others.

English Else
Snapshot multi-dimensional computational imaging through a liquid crystal diffuser

Yunsong Lei,Qi Zhang,Yinghui Guo,Mingbo Pu,Fang Zou,Xiong Li,Xiaoliang Ma,Xiangang Luo

DOI: https://doi.org/10.1364/prj.476317

IF: 7.6

2023-03-03

Photonics Research

Abstract:Yunsong Lei, Qi Zhang, Yinghui Guo, Mingbo Pu, Fang Zou, Xiong Li, Xiaoliang Ma, Xiangang Luo Multi-dimensional optical imaging systems that simultaneously gather intensity, depth, polarimetric, and spectral information have numerous ... [Photon. Res. 11, B111-B124 (2023)]

optics

Diffuser-based computational imaging funduscope

Deep Learning Colorful Ptychographic Iterative Engine Lens-Less Diffraction Microscopy

In vivo fundus imaging and computational refocusing with a diffuser-based fundus camera

High-performance Imaging with an Advanced Non-Imaging Lens Based on Full-Path Optical Diffraction Calculation in Two-Dimensional Space

Computational Diffraction-Limited Imaging with a Non-Imaging Spatial Information Transfer Lens

Telemedicine Screening of Retinal Diseases with a Handheld Portable Non-Mydriatic Fundus Camera

Integrating a Fundus Camera with High-Frequency Ultrasound for Precise Ocular Lesion Assessment

A portable widefield fundus camera with high dynamic range imaging capability

High-Resolution Ex-Vivo Imaging of Retina with a Laptop-Based Portable Endoscope

Smartphone-based Fundus Imaging System

Developing portable widefield fundus camera for teleophthalmology: Technical challenges and potential solutions

Low-cost single-shot complex optical field imaging with a simplified aperture

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Preclinical imaging of iridocorneal angle and fundus using a modified integrated flexible handheld probe

Temporal compressive edge imaging enabled by a lensless diffuser camera

A Miniaturized Large-Field Fundus Optical System Based on Aspheric Imaging and Non-Coaxial Illumination

Fundus image enhancement through direct diffusion bridges

Computational imaging without a computer: seeing through random diffusers at the speed of light

Snapshot multi-dimensional computational imaging through a liquid crystal diffuser