Programmable high-speed confocal reflectance microscopy enabled by a digital micromirror device

Danielis Rutkauskas,Egidijus Auksorius

DOI: https://doi.org/10.1364/ol.511601

IF: 3.6

2024-01-30

Optics Letters

Abstract:Danielis Rutkauskas, Egidijus Auksorius The digital micromirror device (DMD) has been used to achieve parallel scanning in confocal microscopy significantly increasing acquisition ... [Opt. Lett. 49, 686-689 (2024)]

optics

What problem does this paper attempt to address?

Digital micromirror device-based laser-illumination Fourier ptychographic microscopy.

Cuifang Kuang,yousi ma,renping zhou,Justin Lee,George Barbastathis,Ramachandra R Dasari,Zahid Yaqoob,Peter T C So

DOI: https://doi.org/10.1364/OE.23.026999

IF: 3.8

2015-01-01

Optics Express

Abstract:We report a novel approach to Fourier ptychographic microscopy (FPM) by using a digital micromirror device (DMD) and a coherent laser source (532 nm) for generating spatially modulated sample illumination. Previously demonstrated FPM systems are all based on partially-coherent illumination, which offers limited throughput due to insufficient brightness. Our FPM employs a high power coherent laser source to enable shot-noise limited high-speed imaging. For the first time, a digital micromirror device (DMD), imaged onto the back focal plane of the illumination objective, is used to generate spatially modulated sample illumination field for ptychography. By coding the on/off states of the micromirrors, the illumination plane wave angle can be varied at speeds more than 4 kHz. A set of intensity images, resulting from different oblique illuminations, are used to numerically reconstruct one high-resolution image without obvious laser speckle. Experiments were conducted using a USAF resolution target and a fiber sample, demonstrating high-resolution imaging capability of our system. We envision that our approach, if combined with a coded-aperture compressive-sensing algorithm, will further improve the imaging speed in DMD-based FPM systems. (C) 2015 Optical Society of America
Speckle-free Laser Projection Structured Illumination Microscopy Based on a Digital Micromirror Device

Xiaoyan Li,Shunyu Xie,Wenjie Liu,Luhong Jin,Yingke Xu,Luhao Zhang,Xiang Hao,Yubing Han,Cuifang Kuang,Xu Liu

DOI: https://doi.org/10.1364/oe.447135

IF: 3.8

2021-01-01

Optics Express

Abstract:In the structured illumination microscopy (SIM) family, interferometric implementations using traditional physical gratings or advanced liquid crystal on silicon spatial light modulators are popular but have the disadvantages of expensive and limited speed. A promising alternative of a digital micromirror device (DMD) has improved the situation for its lower cost and higher speed, furthermore, it has contributed to the proposal of a simple and compact projection DMD-SIM. However, the projection DMD-SIM method is accused of erroneously measuring the resolution because of the scattering characteristic of gold beads, despite the inferior experimental resolution that is because of the low fringe contrast and the resulting low signal-to-noise ratio (SNR). As an improvement, we use a high-brightness laser for illumination to achieve higher SNR, and the accompanying problems of speckle and inhomogeneity originating from the laser’s high coherence are solved by a high-frequency phase-randomization deformable mirror in conjunction with a square-core multimode fiber, which does not limit the image acquisition speed and with fewer energy losses compared to the existing methods. Also, in terms of the problem of low SNR, we apply a parallel-iteration Richardson–Lucy deconvolution algorithm for SIM reconstruction to further improve the imaging performance based on ensuring the resolution. Based on these advances, we image fluorescent nanoparticles and other non-biological and biological fluorescent samples, and the experimental results demonstrate the improved imaging performance of our modified system.
Reflex Spatial Light Modulator Based on Micromirror Array Device

王小磊,刘向东,张懿,曹星烨,刘旭

DOI: https://doi.org/10.3785/j.issn.1008-973x.2008.10.016

2008-01-01

Abstract:Spatial light modulating based on a single-chip digital micromirror device(DMD) projection system containing a micromirror array was improved to accurately control DMD in the space and time.The computer can control the DMD projection system and the projection system output digital video signal can indirectly control the micromirror array of DMD through improving the software and hardware of the DMD projection system.The system combined the static image in the time,and a compatible and program controllable reflex spatial light modulator system containing static controlling and dynamic controlling was realized.Results show that the modulator can control single pixel of DMD;the highest frequency of modulation is 60 Hz;changing the frequency and duty cycle can realize the spatial light modulator step control.
DMD-based compact SIM system with hexagonal-lattice-structured illumination

Qingqing Liu,Dakai Zhou,Jinfeng Zhang,Cheng Ji,Kuangwei DU,Youhua Chen,Wenjie Liu,Cuifang Kuang

DOI: https://doi.org/10.1364/AO.494214

IF: 1.9

2023-01-01

Applied Optics

Abstract:In this study, we developed a novel, compact, and efficient structured illumination microscopy (SIM) system, to our best knowledge. A binary hexagonal lattice pattern was designed and implemented on a digital micromirror device (DMD), resulting in a projection-based structured-light generation. By leveraging the combination of the highspeed switching capability of the DMD with a high-speed CMOS camera, the system can capture 1024 x 1024 pixels images at a 200 fps frame rate when provided with sufficient illumination power. The loading of the hexagonal lattice pattern reduces the number of images required for reconstruction to seven, and by utilizing the DMD modulating characteristics on the illumination path, there is no need to use bulky mechanical structures for phase shifting. We designed a compact system with 110 mm x 150 mm x 170 mm dimensions that displayed a 1.61 resolution enhancement for fluorescent particle and biological sample imaging. & COPY; 2023 Optica Publishing Group
Diffraction Phase Microscopy Realized with an Automatic Digital Pinhole

Cheng Zheng,Renjie Zhou,Cuifang Kuang,Guangyuan. Zhao,Zhimin Zhang,Xu Liu

DOI: https://doi.org/10.1016/j.optcom.2017.05.038

IF: 2.4

2017-01-01

Optics Communications

Abstract:We report a novel approach to diffraction phase microscopy (DPM) with automatic pinhole alignment. The pinhole, which serves as a spatial low-pass filter to generate a uniform reference beam, is made out of a liquid crystal display (LCD) device that allows for electrical control. We have made DPM more accessible to users, while maintaining high phase measurement sensitivity and accuracy, through exploring low cost optical components and replacing the tedious pinhole alignment process with an automatic pinhole optical alignment procedure. Due to its flexibility in modifying the size and shape, this LCD device serves as a universal filter, requiring no future replacement. Moreover, a graphic user interface for real-time phase imaging has been also developed by using a USB CMOS camera. Experimental results of height maps of beads sample and live red blood cells (RBCs) dynamics are also presented, making this system ready for broad adaption to biological imaging and material metrology.
Quantitative Phase Imaging Based on Wavefront Correction of a Digital Micromirror Device

Jing Hu,Xiwei Xie,Yibing Shen

DOI: https://doi.org/10.1364/ol.402673

IF: 3.6

2020-01-01

Optics Letters

Abstract:The strong need in materials and biological science has prompted the development of high-speed quantitative phase imaging. However, for phase retrieval applying digital micromirror devices (DMDs), the accuracy of the retrieved phase will be disturbed by the DMD-induced aberrations. Here, we propose a phase retrieval method based on measuring and correcting errors caused by phase non-uniformity of the device. Using only four binary amplitude masks and corresponding diffraction intensities, the proposed method achieves rapid convergence and high-quality reconstruction. The experiments prove the practical feasibility for general samples and the effective improvement of the retrieved phase accuracy.
High-Resolution Dmd-Fpm System Based On Ring Pattern Phase Retrieval Algorithm

Xiao Tao,Jinlei Zhang,Youquan Liu,Chang Wang,Wentao Zhang,Chenning Tao,Shengqian Chang,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2319648

2018-01-01

Abstract:We report an approach to enhance the resolution of the microscopy imaging by using the fourier ptychographic microscopy (FPM) method with a laser source and Spatial Light Modulator (SLM) to generate modulated sample illumination. The performance of the existed FPM system is limited by low illumination efficiency of the LED array. In our prototype setup, digital micromirror device (DMD) is introduced to replace the LED array as a reflective spatial light modulator and is placed at the front focal plane of the 4F system. A ring pattern sample illumination is generated by coding the micromirrors on the DMD, and converted to multi-angular illumination through the relay illumination system. A series of intensity sample images can be obtained by changing the size of the ring pattern and then used to reconstruct high resolution image through the ring pattern phase retrieval algorithm. Finally, our method is verified by an experiment using a resolution chart. The results also show that our method have higher reconstruction resolution and faster imaging speed.
Digital micromirror devices: principles and applications in imaging

Vivek Bansal,Peter Saggau

DOI: https://doi.org/10.1101/pdb.top074302

2013-05-01

Abstract:A digital micromirror device (DMD) is an array of individually switchable mirrors that can be used in many advanced optical systems as a rapid spatial light modulator. With a DMD, several implementations of confocal microscopy, hyperspectral imaging, and fluorescence lifetime imaging can be realized. The DMD can also be used as a real-time optical processor for applications such as the programmable array microscope and compressive sensing. Advantages and disadvantages of the DMD for these applications as well as methods to overcome some of the limitations will be discussed in this article. Practical considerations when designing with the DMD and sample optical layouts of a completely DMD-based imaging system and one in which acousto-optic deflectors (AODs) are used in the illumination pathway are also provided.
Phase Imaging Based on Random Coding Modulation of Digital Micro-Mirror Device

Xie Xiwei,Hu Jing,Shen Yibing

DOI: https://doi.org/10.3788/aos202040.2311001

2020-01-01

Acta Optica Sinica

Abstract:Digital micro-mirror devices (DMDs) as spatial light modulators, have the advantages of high modulation speed and accuracy and can perform amplitude or phase modulation for illumination light, which are widely used in phase imaging systems. In this paper, a DMD is used for the random coding modulation of illumination light amplitude. We simulate the influences of the smallest modulation unit and switch ratio on phase imaging when random coding patterns are loaded on the DMD. Then we use a difference mapping iterative algorithm for light field reconstruction. Furthermore, it is experimentally verified that based on the parameters obtained via numerical simulation, we can retrieve amplitude and phase with a higher iteration speed and a fewer measurement times. In addition, for an object with the field of view of 4.3 mm X 4.3 mm, the reconstruction resolution reaches 6.9 mu m.
Confocal Fluorescence Microendoscopy Using A Digital Micro-Mirror Device

Zhifeng Feng,Liqiang Wang,Huilong Duan

DOI: https://doi.org/10.1117/12.869800

2010-01-01

Abstract:A design of confocal fluorescence microendoscopy utilizing a digital micro-mirror device (DMD) is described. Laser beams of the microendoscope are coupled into the body through a telescopic optics system, rather than through fibers or fiber bundles which are widely used in existing microendoscopes. Each micro-mirror of the DMD is used as a confocal pinhole. The DMD not only couples the laser beams into the body by a random time-varying speckle pattern and performs the scanning mechanism of the body tissue with different positions, but also couples the fluorescent signal emitted from the markers out to the CCD camera. Because of the CCD's integration feature and DMD's rapid parallel scanning feature, a complete predetermined depth tomography image accumulated by different scanning patterns of DMD can be acquired through only one CCD exposure procedure. The objective lens to realize high resolution and high sensitivity fluorescence imaging is the other function of the telescopic optics, with a numerical aperture of 0.35. The resolution of confocal microendoscope is superior to 228 lp/mm determined by 1951USAF resolution test target. Images of a tendon specimen are also shown to demonstrate practical application of the design. The confocal microendoscope using a DMD permits the acquisition of high-resolution real-time confocal images of epithelial tissue in vivo organ and realizes the aim of non-invasive diagnosis and treatment.
Digital Micromirror Device-Based Common-Path Quantitative Phase Imaging

Cheng Zheng,Renjie Zhou,Cuifang Kuang,Guangyuan Zhao,Zahid Yaqoob,Peter T. C. So

DOI: https://doi.org/10.1364/ol.42.001448

IF: 3.6

2017-01-01

Optics Letters

Abstract:We propose a novel common-path quantitative phase imaging (QPI) method based on a digital micromirror device (DMD). The DMD is placed in a plane conjugate to the objective back-aperture plane for the purpose of generating two plane waves that illuminate the sample. A pinhole is used in the detection arm to filter one of the beams after sample to create a reference beam. Additionally, a transmission-type liquid crystal device, placed at the objective back-aperture plane, eliminates the specular reflection noise arising from all the “off” state DMD micromirrors, which is common in all DMD-based illuminations. We have demonstrated high sensitivity QPI, which has a measured spatial and temporal noise of 4.92 nm and 2.16 nm, respectively. Experiments with calibrated polystyrene beads illustrate the desired phase measurement accuracy. In addition, we have measured the dynamic height maps of red blood cell membrane fluctuations, showing the efficacy of the proposed system for live cell imaging. Most importantly, the DMD grants the system convenience in varying the interference fringe period on the camera to easily satisfy the pixel sampling conditions. This feature also alleviates the pinhole alignment complexity. We envision that the proposed DMD-based common-path QPI system will allow for system miniaturization and automation for a broader adaption.
Kilohertz binary phase modulator for pulsed laser sources using a digital micromirror device

Maximilian Hoffmann,Ioannis N Papadopoulos,Benjamin Judkewitz,Ioannis N. Papadopoulos

DOI: https://doi.org/10.1364/ol.43.000022

IF: 3.6

2017-12-20

Optics Letters

Abstract:The controlled modulation of an optical wavefront is required for aberration correction, digital phase conjugation, or patterned photostimulation. For most of these applications, it is desirable to control the wavefront modulation at the highest rates possible. The digital micromirror device (DMD) presents a cost-effective solution to achieve high-speed modulation and often exceeds the speed of the more conventional liquid crystal spatial light modulator but is inherently an amplitude modulator. Furthermore, spatial dispersion caused by DMD diffraction complicates its use with pulsed laser sources, such as those used in nonlinear microscopy. Here we introduce a DMD-based optical design that overcomes these limitations and achieves dispersion-free high-speed binary phase modulation. We show that this phase modulation can be used to switch through binary phase patterns at the rate of 20 kHz in two-photon excitation fluorescence applications.

optics
Active illumination using a digital micromirror device for quantitative phase imaging

Seungwoo Shin,Kyoohyun Kim,Jonghee Yoon,YongKeun Park

DOI: https://doi.org/10.1364/OL.40.005407

2015-06-20

Abstract:We present a powerful and cost-effective method for active illumination using a digital micromirror device (DMD) for quantitative phase imaging techniques. Displaying binary illumination patterns on a DMD with appropriate spatial filtering, plane waves with various illumination angles are generated and impinged onto a sample. Complex optical fields of the sample obtained with various incident angles are then measured via Mach-Zehnder interferometry, from which a high-resolution two-dimensional synthetic aperture phase image and a three-dimensional refractive index tomogram of the sample are reconstructed. We demonstrate the fast and stable illumination control capability of the proposed method by imaging colloidal spheres and biological cells, including a human red blood cell and a HeLa cell.

Optics
Fast 3D super-resolution imaging using a digital micromirror device and binary holography

Jialong Chen,Zhiqiang Fu,Bingxu Chen,Shih-Chi Chen

DOI: https://doi.org/10.1117/1.jbo.26.11.116502

IF: 3.758

2021-11-13

Journal of Biomedical Optics

Abstract:SIGNIFICANCE: High-speed three-dimensional (3D) super-resolution microscopy is a unique tool to investigate various biological phenomena; yet the technology is not broadly adopted due to its high cost and complex system design.AIM: We present a compact, low-cost, and high-speed 3D structured illumination microscopy (SIM) based on a digital micromirror device and binary holography to visualize fast biological events with super-resolution.APPROACH: The 3D SIM uses a digital micromirror device to generate three laser foci with individually controllable positions, phases, and amplitudes via binary holography at the back aperture of objective lens to form optimal 3D structured patterns. Fifteen raw images are sequentially recorded and processed by the 3D SIM algorithm to reconstruct a super-resolved image.RESULTS: Super-resolution 3D imaging at a speed of 26.7 frames per second is achieved with a lateral and axial resolution of 155 and 487 nm, which corresponds to a 1.65- and 1.63-times resolution enhancement, respectively, comparing with standard deconvolution microscopy.CONCLUSIONS: The 3D SIM realizes fast super-resolution imaging with optimal 3D structured illumination, which may find important applications in biophotonics.

radiology, nuclear medicine & medical imaging,biochemical research methods,optics
Adaptive Pixel-by-Pixel Modulated 3-D Morphometry Based on Digital Micromirror Device

Haozhen Huang,Bin Niu,Shen Cheng,Fumin Zhang

DOI: https://doi.org/10.1109/tim.2024.3368489

IF: 5.6

2024-03-09

IEEE Transactions on Instrumentation and Measurement

Abstract:This study introduces an adaptive 3-D morphometry method based on a digital micromirror device (DMD) with pixel-by-pixel modulation for acquiring highly dynamic 3-D data. The method combines the camera's exposure time with the projector's light intensity to determine the optimized exposure time and modulation mask. The experiment requires only two captured images to precisely calculate object reflectance, optimize exposure time, and generate pixel-level DMD modulation masks. This process enhances low-reflective areas and eliminates highly reflective areas. When combined with phase shift profilometry, adaptive high dynamic range (HDR) 3-D morphometry is achieved. Experimental results demonstrate that this approach can achieve 3-D measurements of highly reflective surfaces and objects with complex reflectivity using a reduced number of images.

engineering, electrical & electronic,instruments & instrumentation
A Programmable Optical Filter with Arbitrary Transmittance for Fast Spectroscopic Imaging and Spectral Data Post-Processing.

Jiao Lu,Yuetian Ren,Wenbin Xu,Xiaoyu Cui,Liping Xie,Shuo Chen,Jinhong Guo,Yudong Ya

DOI: https://doi.org/10.1109/access.2019.2937095

IF: 3.9

2019-01-01

IEEE Access

Abstract:Spectral reconstruction method based on narrow-band measurements has been demonstrated to achieve ultrafast spectroscopic imaging with high spatial and spectral resolution, in which multiple narrow-band images are collected by using several specific filters. Although commercially available filters can be employed in such method, filters with complex transmittance that are difficult to be fabricated typically show significant improvement in spectral reconstruction accuracy. In this study, a two dimensional programmable optical filter based on digital micromirror device (DMD) is proposed, in which its transmittance spectrum can be arbitrarily and quickly switched to realize complex transmittance. Furthermore, its flexible transmittance enables directly hardware-based spectral data post-processing, which can perform data acquisition and analysis simultaneously. Those have been evaluated by the diffuse reflectance spectra from normal and occluded skin flaps, as well as Raman spectra from live, apoptosis and necrosis leukemia cells. Our simulation results show that much higher spectral reconstruction accuracies can be achieved by the optimized filters with complex transmittance. Furthermore, the classification accuracy by using the proposed method is comparable to those achieved by conventional numerical methods. Therefore, based on the proposed programmable optical filter, fast spectroscopic imaging with high spatial and spectral resolution can be achieved for observing fast changing phenomena and even real-time target identification.
Tailoring Light with A Digital Micromirror Device

Yu-Xuan Ren,Rong-De Lu,Lei Gong

DOI: https://doi.org/10.1002/andp.201500111

2015-01-01

Annalen der Physik

Abstract:A digital micromirror device (DMD) is a product of micromechanics. The DMD employs numerous micromirrors as the actuating components to switch small portions of light on and off. During the past few decades, such devices have been widely applied in digital light processing technology. The expanding range of applications makes the DMD increasingly important in various research aspects. Recent advances demonstrate that the DMD is potentially better than the traditional liquid crystal spatial light modulator in speed, spectrum sensitivity, and polarization modulation. These characteristics have been verified in a series of recently reported experiments. This review summarizes the related theory, experimental techniques, and applications for wavefront shaping with DMDs in both statically shaping various spatial modes and dynamically compensating for wavefront distortion caused by the scattering medium. image
DMD-based LED-illumination Super-resolution and optical sectioning microscopy

Dan Dan,Ming Lei,Baoli Yao,Wen Wang,Martin Winterhalder,Andreas Zumbusch,Yujiao Qi,Liang Xia,Shaohui Yan,Yanlong Yang,Peng Gao,Tong Ye,Wei Zhao

DOI: https://doi.org/10.1038/srep01116

IF: 4.6

2013-01-01

Scientific Reports

Abstract:Super-resolution three-dimensional (3D) optical microscopy has incomparable advantages over other high-resolution microscopic technologies, such as electron microscopy and atomic force microscopy, in the study of biological molecules, pathways and events in live cells and tissues. We present a novel approach of structured illumination microscopy (SIM) by using a digital micromirror device (DMD) for fringe projection and a low-coherence LED light for illumination. The lateral resolution of 90 nm and the optical sectioning depth of 120 μm were achieved. The maximum acquisition speed for 3D imaging in the optical sectioning mode was 1.6×10 7 pixels/second, which was mainly limited by the sensitivity and speed of the CCD camera. In contrast to other SIM techniques, the DMD-based LED-illumination SIM is cost-effective, ease of multi-wavelength switchable and speckle-noise-free. The 2D super-resolution and 3D optical sectioning modalities can be easily switched and applied to either fluorescent or non-fluorescent specimens.
Structured Illumination Microscopy using Digital Micro-mirror Device and Coherent Light Source

Meiqi Li,Yaning Li,Wenhui Liu,Karl Zhanghao,Peng Xi

DOI: https://doi.org/10.1063/5.0008264

2019-10-30

Abstract:Structured illumination microscopy (SIM) achieves doubled spatial resolution by exciting the specimen with a high-contrast, high-frequency sinusoidal pattern. Such an excitation pattern can be generated by interference between multiple laser beams, which are diffracted from a grating. In SIM, 2D imaging requires 9 patterns and 3D imaging requires 15 patterns. Compared to mechanical movement of gratings, opti-electro devices provide rapid switch of the excitation patterns, in which Digital Micro-mirror Device (DMD) is most common in industry. Here we model DMD as the blazed grating and report a fast and cost-efficient SIM. Our home-built DMD-based laser interference structured illumination microscopy (DMD-ISIM) system reveals the nuclear pore complex and microtubule in mammalian cells with doubled spatial resolution. We further proposed multi-color DMD-ISIM system with simulation, which could potentially exploit the full power of DMD-ISIM.

Optics,Image and Video Processing,Biological Physics
Quasi one-shot full-field surface profilometry using digital diffractive-confocal imaging correlation microscope

Duc Trung Nguyen,Liang-Chia Chen,Nguyen Dinh Nguyen

DOI: https://doi.org/10.48550/arXiv.1812.06582

2019-04-11

Abstract:One-shot full-field surface profilometry using digital diffractive-confocal imaging correlation microscope based on digital micromirror device is developed for one-shot microscopic 3D surface measurement. Optical configuration applies confocal microscope setup and was building on DMD to generate specific pinhole array arrangement for minimizing cross talk effect. An innovative method was invented to create normalized cross correlation depth response curve from diffraction patterns of the pinhole. Using this approach, the sub-micrometer scale depth can be detected with high accuracy and precision.

Optics,Applied Physics

Programmable high-speed confocal reflectance microscopy enabled by a digital micromirror device

Digital micromirror device-based laser-illumination Fourier ptychographic microscopy.

Speckle-free Laser Projection Structured Illumination Microscopy Based on a Digital Micromirror Device

Reflex Spatial Light Modulator Based on Micromirror Array Device

DMD-based compact SIM system with hexagonal-lattice-structured illumination

Diffraction Phase Microscopy Realized with an Automatic Digital Pinhole

Quantitative Phase Imaging Based on Wavefront Correction of a Digital Micromirror Device

High-Resolution Dmd-Fpm System Based On Ring Pattern Phase Retrieval Algorithm

Digital micromirror devices: principles and applications in imaging

Phase Imaging Based on Random Coding Modulation of Digital Micro-Mirror Device

Confocal Fluorescence Microendoscopy Using A Digital Micro-Mirror Device

Digital Micromirror Device-Based Common-Path Quantitative Phase Imaging

Kilohertz binary phase modulator for pulsed laser sources using a digital micromirror device

Active illumination using a digital micromirror device for quantitative phase imaging

Fast 3D super-resolution imaging using a digital micromirror device and binary holography

Adaptive Pixel-by-Pixel Modulated 3-D Morphometry Based on Digital Micromirror Device

A Programmable Optical Filter with Arbitrary Transmittance for Fast Spectroscopic Imaging and Spectral Data Post-Processing.

Tailoring Light with A Digital Micromirror Device

DMD-based LED-illumination Super-resolution and optical sectioning microscopy

Structured Illumination Microscopy using Digital Micro-mirror Device and Coherent Light Source

Quasi one-shot full-field surface profilometry using digital diffractive-confocal imaging correlation microscope