Ultra-fast Super-Resolution Imaging by Time-Stretch Structured Illumination

Yuxi Wang,Qiang Guo,Hongwei Chen,Minghua Chen,Sigang Yang

2016-01-01

Abstract:A new strategy to generate illuminating pattern for structured illumination microscopy based on the method of optical pulse laser time-stretch open up the possibilities to conduct ultra-fast (50MHz pattern generation rate) super-resolution imaging.

What problem does this paper attempt to address?

Real-time reconstruction using electro-optics modulator-based structured illumination microscopy

Fanghui Xu,Jiachen Zhang,Dongdong Ding,Wenjie Liu,Chi Zheng,Sijia Zhou,Youhua Chen,Cuifang Kuang

DOI: https://doi.org/10.1364/OE.454982

IF: 3.8

2022-01-01

Optics Express

Abstract:Structured illumination microscopy (SIM), a super-resolution technology, has a wide range of applications in life sciences. In this study, we present an electro-optic high-speed phase-shift super-resolution microscopy imaging system including 2D SIM, total internal reflection fluorescence-SIM, and 3D SIM modes. This system uses galvanometers and an electro-optic modulator to flexibly and quickly control the phase and direction of structured illumination patterns. Moreover, its design consists of precise timing for improved acquisition speed and software architecture for real-time reconstruction. The highest acquisition rate achieved was 151 frames/s, while the highest real-time super-resolution reconstruction frame rate achieved was over 25 frames/s. (C) 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
Optical Super-Resolution Imaging Based On Frequency Shift

Hao Xiang,Yang Qing,Kuang Cuifang,Liu Xu

DOI: https://doi.org/10.3788/AOS202141.0111001

2021-01-01

Acta Optica Sinica

Abstract:Optical microscopy is non-invasive, sample-friendly, and fast, rendering itself the major approach for human beings to explore the microcosmic world. However, the diffraction limit has hindered the resolution of all optical imaging systems to approximately half the wavelength of visible light for over a century, until it was fundamentally broken by the development of super-resolution optical fluorescence microscopy. This technology bridges the gap between the electron microscopes (1 nm) and the ordinary optical microscopes (200 nm to 250 nm), but it is essentially useless for most samples, especially those non-fluorescent-labeled. In recent years, inspired by the synthetic aperture imaging, we have developed the optical super-resolution imaging based on frequency shift, providing a new approach to optical super-resolution imaging. As the technique is not limited by the nonlinear effects of fluorescence, it is applicable for both non-fluorescent-labeled and fluorescent-labeled samples. Besides, due to such advantages as fast imaging, high sample universality, and low phototoxicity, the technique shows good prospects in multiple fields, including materials science, biology, and medicine. In this paper, we deliver a detailed overview on both the principles and methods of optical super-resolution imaging based on frequency shift, as well as our prospects to the future development direction of this technique.
Saturated Pattern-Illuminated Fourier Ptychography Microscopy

Yue Fang,Youhua Chen,Cuifang Kuang,Peng Xiu,Qiulan Liu,Baoliang Ge,Xu Liu

DOI: https://doi.org/10.1088/2040-8986/19/1/015602

IF: 2.1

2016-01-01

Journal of Optics

Abstract:We report a series of simulation studies which extends pattern-illuminated Fourier ptychography microscopy by integrating with the nonlinearity arising from saturation of the fluorophore excited state for super-resolution fluorescence imaging. This extended technique, termed Saturated pattern-illuminated Fourier ptychography (SpiFP) microscopy, could achieve a resolution four times that of wide field when the illuminating light intensity approaches the saturation threshold in simulations. Increasing light intensity leads to further resolution enhancement. In order to demonstrate the performance of SpiFP, we make a comparison between SpiFP and saturated structure illumination microscopy in simulations, and prove that the SpiFP exhibits superior robustness to noise, aberration correcting ability, and pattern's flexibility. Introducing the saturation of the fluorescent emission brings in notable improvements in imaging performance, implying its potential in nanoscale-sized biological observations by wide-field microscopy.
Three-dimensional super-resolution imaging of live whole cells using structured illumination microscopy

Wenjie Liu,Cuifang kuang,Xu Liu

2019-01-01

Abstract:1. PRINCIPLE Structured illumination microscopy (SIM) improves the spatial resolution via shifting the high-frequency information of a sample into the acceptable passband of the imaging system. In conventional SIM systems, a diffraction grating is used to diffract the incident light interfering at the sample plane to produce the structured illumination pattern, which lengthens the imaging speed. Faster SIM can be achieved by replacing the grating with a spatial light modulator (SLM). In recent years, the SIM theory have been greatly developed to enhance the spatial and temporal resolution. However, these developments were mainly focused on two dimensions [1]. Only a few studies have been conducted with three-dimensional (3D) SIM, especially for live-cell imaging. With routine fast biological applications in mind, we present here a more flexible system for 3D SIM based on two galvanometer sets conveniently controlling the incident angle (i.e. pattern period) and azimuth angle (i.e. pattern orientation) of the illumination light. The phase of the 3D structured illumination pattern is shifted by two piezoelectric stages. As the galvanometer and piezoelectric stage allow the pattern to be rotated and phase-shifted at the order of kHz, the imaging speed of our system is high enough to observe the sub-cellular dynamics.
Single-frame Structured Illumination Microscopy for Fast Live-Cell Imaging

Hanmeng Wu,Yueming Li,Yile Sun,Lu Yin,Weiyun Sun,Zitong Ye,Xinxun Yang,Hongfei Zhu,Mingwei Tang,Yubing Han,Cuifang Kuang,Xu Liu

DOI: https://doi.org/10.1063/5.0180978

IF: 5.6

2024-01-01

APL Photonics

Abstract:Observing subcellular structural dynamics in living cells has become the goal of super-resolution (SR) fluorescence microscopy. Among typical SRM techniques, structured illumination microscopy (SIM) stands out for its fast imaging speed and low photobleaching. However, 2D-SIM requires nine raw images to obtain a SR image, leading to undesirable artifacts in the fast dynamics of live-cell imaging. In this paper, we propose a single-frame structured illumination microscopy (SF-SIM) method based on deep learning that achieves SR imaging using only a single image modulated by a hexagonal lattice pattern. The SF-SIM method used the prior knowledge to complete the structure enhancement of SR images in the spatial domain and the expansion of the Fourier spectrum through deep learning, achieving the same resolution as conventional 2D-SIM. Temporal resolution is improved nine times, and photobleaching is reduced by 2.4 times compared to conventional 2D-SIM. Based on this, we observed the fast dynamics of multiple subcellular structures and the dynamic interaction of two organelles. The SF-SIM methods provide a powerful tool for live-cell imaging.
Laser scanning saturated structured illumination microscopy based on phase modulation

Yujia Huang,Dazhao Zhu,Luhong Jin,Cuifang Kuang,Yingke Xu,Xu Liu

DOI: https://doi.org/10.1016/j.optcom.2017.03.020

IF: 2.4

2017-01-01

Optics Communications

Abstract:Wide-field saturated structured illumination microscopy has not been widely used due to the requirement of high laser power. We propose a novel method called laser scanning saturated structured illumination microscopy (LS-SSIM), which introduces high order of harmonics frequency and greatly reduces the required laser power for SSIM imaging. To accomplish that, an excitation PSF with two peaks is generated and scanned along different directions on the sample. Raw images are recorded cumulatively by a CCD detector and then reconstructed to form a high-resolution image with extended optical transfer function (OTF). Our theoretical analysis and simulation results show that LS-SSIM method reaches a resolution of 0.16 λ, equivalent to 2.7-fold resolution than conventional wide-field microscopy. In addition, LS-SSIM greatly improves the optical sectioning capability of conventional wide-field illumination system by diminishing our-of-focus light. Furthermore, this modality has the advantage of implementation in multi-photon microscopy with point scanning excitation to image samples in greater depths.
Structured Illumination Fluorescence Fourier Ptychographic Microscopy

Peng Xiu,Youhua Chen,Cuifang Kuang,Yue Fang,Yifan Wang,Jiannan Fan,Yingke Xu,Xu Liu

DOI: https://doi.org/10.1016/j.optcom.2016.06.075

IF: 2.4

2016-01-01

Optics Communications

Abstract:We apply a Fourier ptychographic algorithm for fluorescent samples using structured illumination. The samples are illuminated with structured light patterns and the raw imaging data using traditional structured illumination fluorescence microscopy (SIM) are acquired. We then extract equivalent oblique illuminated images of fluorescent samples from the SIM images. An optimized Fourier ptychography algorithm is proposed, which ensures the fidelity of the reconstructed the super-resolution results. This method can break the diffraction limit to a resolution of λ/4, and has a better signal-to-noise ratio (SNR) than SIM, especially when the background noise is high.
Time-encoded structured illumination microscopy: toward ultrafast superresolution imaging.

Yuxi Wang,Qiang Guo,Hongwei Chen,Minghua Chen,Sigang Yang,Shizhong Xie

DOI: https://doi.org/10.1364/OL.41.003755

IF: 3.6

2016-01-01

Optics Letters

Abstract:An imaging strategy based on optical time-encoded structured illumination microscopy (TE-SIM) opens the way toward ultrafast superresolution imaging. A proof-of-principle experiment is conducted and the introduced TE-SIM accelerates the generation rate of sinusoidal fringe patterns to an unprecedented speed (dozens of megahertz). At such a high speed, superresolution imaging that surpasses the diffraction limit by a factor of 1.4 is demonstrated. This imaging strategy with high temporal and spatial resolution has great potential in many exciting applications, such as dynamic live cell imaging or high-throughput screening. (C) 2016 Optical Society of America
Super-resolution Laser Scanning Microscopy Through Spatiotemporal Modulation.

Ju Lu,Wei Min,Jose-Angel Conchello,Xiaoliang Sunney Xie,Jeff W. Lichtman

DOI: https://doi.org/10.1021/nl902087d

IF: 10.8

2009-01-01

Nano Letters

Abstract:Super-resolution optical microscopy has attracted great interest among researchers in many fields, especially in biology where the scale of physical structures and molecular processes fall below the diffraction limit of resolution for light. As one of the emerging techniques, structured illumination microscopy can double the resolution by shifting unresolvable spatial frequencies into the pass-band of the microscope through spatial frequency mixing with a wide-field structured illumination pattern. However, such a wide-field scheme typically can only image optically thin samples and is incompatible with multiphoton processes such as two-photon fluorescence, which require point scanning with a focused laser beam. Here, we propose two new super-resolution schemes for laser scanning microscopy by generalizing the concept of a spatially nonuniform imaging system. One scheme, scanning patterned illumination (SPIN) microscopy, employs modulation of the excitation combined with temporally cumulative imaging by a nondescanned array detector. The other scheme, scanning patterned detection (SPADE) microscopy, utilizes detection modulation together with spatially cumulative imaging, in this case by a nondescanned single-element detector. When combined with multiphoton excitation, both schemes can image thick samples with three-dimensional optical sectioning and much improved resolution.
Efficient super-resolution imaging method for micro-nano structure based on structured illumination modulation

Kejun Yang,Yan Tang,Song Hu,Chuyi Chen

DOI: https://doi.org/10.1117/12.2512326

2019-01-30

Abstract:The structured illumination microscopy fills an unmet need for minimally invasive tools to image micrometer and nanoscale structure. However, conventional structured illumination super-resolution methods require precise phase shift of the illumination pattern, which leads to an inefficient image reconstruction process and a complicated imaging system. To solve these problems, we propose a novel image reconstruction method using only two image to acquire the frequencies beyond the diffraction limit. This method has an efficient image post-processing, which obtains extended frequencies without accurate estimation of phase-shifting. The related simulations and experiments are carried out to demonstrate the feasibility of this method.
Super-Resolution Structured Illumination Microscopy Reconstruction Using a Least-Squares Solver

Jintao Luo,Chuankang Li,Qiulan Liu,Junling Wu,Haifeng Li,Cuifang Kuang,Xiang Hao,Xu Liu

DOI: https://doi.org/10.3389/fphy.2020.00118

IF: 3.718

2020-01-01

Frontiers in Physics

Abstract:Super-resolution microscopy enables images to be obtained at a resolution higher than that imposed by the diffraction limit of light. Structured illumination microscopy (SIM) is among the fastest super-resolution microscopy techniques currently in use, and it has gained popularity in the field of cytobiology research owing to its low photo-toxicity and widefield modality. In typical SIM, a fluorescent sample is excited by sinusoidal patterns by employing a linear strategy to reconstruct super-resolution images. However, this strategy fails in cases where non-sinusoidal illumination patterns are used. In this study, we propose the least-squares SIM (LSQ-SIM) approach, which is an efficient super-resolution reconstruction algorithm in the framework of least-squares regression that can process raw SIM data under both sinusoidal and non-sinusoidal illuminations. The results obtained in this study indicate the potential of LSQ-SIM for use in structured illumination microscopy and its various application fields.
High-speed spatially re-modulated structured illumination microscopy

Shijie Tu,Xiaoyan Li,Wenwen Gong,Xin Liu,Yubing Han,Cuifang Kuang,Xu Liu,Xiang Hao,yueying wang,Qiulan Liu

DOI: https://doi.org/10.1364/ol.485929

IF: 3.6

2023-05-04

Optics Letters

Abstract:Shijie Tu, Xiaoyan Li, Yueying Wang, Wenwen Gong, Xin Liu, Q. Liu, Yubing Han, Cuifang Kuang, Xu Liu, Xiang Hao Structured illumination microscopy (SIM) allows non-invasive visualization of nanoscale subcellular structures. However, image acquisition ... [Opt. Lett. 48, 2535-2538 (2023)]

optics
Structured illumination microscopy with extreme ultraviolet pulses

R. Mincigrucci,E. Paltanin,J.-S. Pelli-Cresi,F. Gala,E. Pontecorvo,L. Foglia,D. De Angelis,D. Fainozzi,A. Gessini,D. S. P. Molina,O. Stranik,F. Wechsler,R. Heintzmann,G. Ruocco,F. Bencivenga,C. Masciovecchio

2024-03-28

Abstract:The relentless pursuit of understanding matter at ever-finer scales has pushed optical microscopy to surpass the diffraction limit and produced the super-resolution microscopy which enables visualizing structures shorter than the wavelength of light. In the present work, we harnessed extreme ultraviolet beams to create a sub-{\mu}m grating structure, which was revealed by extreme ultraviolet structured illumination microscopy. This achievement marks the first step toward extending such a super-resolution technique into the X-ray regime, where achieving atomic-scale resolution becomes a charming possibility.

Optics,Other Condensed Matter
Advances in High-Speed Structured Illumination Microscopy

Tianyu Zhao,Zhaojun Wang,Tongsheng Chen,Ming Lei,Baoli Yao,Piero R. Bianco

DOI: https://doi.org/10.3389/fphy.2021.672555

IF: 3.718

2021-05-28

Frontiers in Physics

Abstract:Super-resolution microscopy surpasses the diffraction limit to enable the observation of the fine details in sub-cellular structures and their dynamics in diverse biological processes within living cells. Structured illumination microscopy (SIM) uses a relatively low illumination light power compared with other super-resolution microscopies and has great potential to meet the demands of live-cell imaging. However, the imaging acquisition and reconstruction speeds limit its further applications. In this article, recent developments all targeted at improving the overall speed of SIM are reviewed. These comprise both hardware and software improvements, which include a reduction in the number of raw images, GPU acceleration, deep learning and the spatial domain reconstruction. We also discuss the application of these developments in live-cell imaging.

physics, multidisciplinary
Multiwavelength Time-Stretch Imaging System

Hongwei Chen,Cheng Lei,Fangjian Xing,Zhiliang Weng,Minghua Chen,Sigang Yang,Shizhong Xie

DOI: https://doi.org/10.1364/ol.39.002202

2014-01-01

Abstract:A high-speed microscopic imaging system based on a multiwavelength source and time-stretch technique is proposed and demonstrated. We realize an imaging system at 1D scan rate of 80 MHz with 20 resolvable points. This scheme breaks the bottleneck of large bandwidth and high repetition rate in mode-lock lasers and has great potential for imaging system integration.
Ultrafast Surface Imaging with an Increased Spatial Resolution Based on Polarization-Division Multiplexing

Fangjian Xing,Hongwei Chen,Shizhong Xie,Jianping Yao

DOI: https://doi.org/10.1109/jlt.2015.2388752

IF: 4.7

2015-01-01

Journal of Lightwave Technology

Abstract:Optical time stretch has been employed for ultrafast optical imaging based on space-to-wavelength-to-time mapping. However, temporal overlap between two adjacent time-stretched pulses is a disadvantageous factor that limits the spatial resolution, or the frame rate has to be reduced by reducing the pulse repetition rate to avoid the temporal overlap. To increase the spatial resolution without reducing the frame rate, we propose a novel technique based on polarization-division multiplexing, using a polarization modulator to generate two polarization interleaved pulse trains. Since two adjacent optical pulses are orthogonally polarized, the spacing between two adjacent pulses for one polarization direction is doubled, and the spatial resolution is doubled by using a dispersive element with two times the dispersion. The proposed approach is experimentally evaluated. An imaging system with an increased spatial resolution is demonstrated.
Super-resolution Two-Photon Microscopy Via Scanning Patterned Illumination

Ben E Urban,Ji Yi,Siyu Chen,Biqin Dong,Yongling Zhu,Steven H DeVries,Vadim Backman,Hao F Zhang

DOI: https://doi.org/10.1103/physreve.91.042703

IF: 2.707

2015-01-01

Physical Review E

Abstract:We developed two-photon scanning patterned illumination microscopy (2P-SPIM) for super-resolution two-photon imaging. Our approach used a traditional two-photon microscopy setup with temporally modulated excitation to create patterned illumination fields. Combing nine different illuminations and structured illumination reconstruction, super-resolution imaging was achieved in two-photon microscopy. Using 2P-SPIM we achieved a lateral resolution of 141 nm, which represents an improvement by a factor of 1.9 over the corresponding diffraction limit. We further demonstrated super-resolution cellular imaging by 2P-SPIM to image actin cytoskeleton in mammalian cells and three-dimensional imaging in highly scattering retinal tissue.
MUTE-SIM: Multiphoton Up-Conversion Time-Encoded Structured Illumination Microscopy

Chengyang Hu,Zhaoyang Wu,Xusan Yang,Wanyue Zhao,Chenshuo Ma,Minghua Chen,Peng Xi,Hongwei Chen

DOI: https://doi.org/10.1364/osac.387129

2020-01-01

OSA Continuum

Abstract:Multiphoton microscopy (MPM) plays important role in biological imaging for its low scattering nature, yet it typically requires high illumination intensity. Although time-stretch of the ultrashort pulse can achieve ultrahigh speed scanning and deep penetration, the near-infrared illumination yields a compromised resolution because of its long wavelength. Here, by combining structured illumination with up-conversion materials, a multiphoton up-conversion time-encoded structured illumination microscopy (MUTE-SIM) with the scanning rate of 50 MHz is developed, which overcomes the limitation on the resolution. The resolution limit of near-infrared light is surpassed by a factor of 223.3% with low illumination intensity. This imaging strategy provides an ultrafast, low intensity, super-resolution MPM approach imaging, which has great potential in deep-tissue with high spatial resolution.
Fast Long-Term Super-Resolution Imaging with Hessian Structured Illumination Microscopy

Xiaoshuai Huang,Junchao Fan,Liuju Li,Haosen Liu,Runlong Wu,Yi Wu,Lisi Wei,Heng Mao,Amit Lal,Peng Xi,Liqiang Tang,Yunfeng Zhang,Yanmei Liu,Shan Tan,Liangyi Chen

DOI: https://doi.org/10.1038/nbt.4115

IF: 46.9

2018-01-01

Nature Biotechnology

Abstract:To increase the temporal resolution and maximal imaging time of super-resolution (SR) microscopy, we have developed a deconvolution algorithm for structured illumination microscopy based on Hessian matrixes (Hessian-SIM). It uses the continuity of biological structures in multiple dimensions as a priori knowledge to guide image reconstruction and attains artifact-minimized SR images with less than 10% of the photon dose used by conventional SIM. Hessian-SIM enables spatiotemporal resolution of 88 nm and 188 Hz, and hour-long time-lapse SR imaging of actin filaments in live cells. Finally, we observed the structural dynamics of mitochondrial cristae and structures that, to our knowledge, have not been observed previously, such as enlarged fusion pores during vesicle exocytosis.
Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM)

Xinzhu Xu,Wenyi Wang,Liang Qiao,Yunzhe Fu,Xichuan Ge,Kun Zhao,Karl Zhanghao,Meiling Guan,Xin Chen,Meiqi Li,Dayong Jin,Peng Xi

DOI: https://doi.org/10.1038/s41377-024-01464-8

2024-05-29

Abstract:Structured illumination microscopy (SIM) has emerged as a promising super-resolution fluorescence imaging technique, offering diverse configurations and computational strategies to mitigate phototoxicity during real-time imaging of biological specimens. Traditional efforts to enhance system frame rates have concentrated on processing algorithms, like rolling reconstruction or reduced frame reconstruction, or on investments in costly sCMOS cameras with accelerated row readout rates. In this article, we introduce an approach to elevate SIM frame rates and region of interest (ROI) coverage at the hardware level, without necessitating an upsurge in camera expenses or intricate algorithms. Here, parallel acquisition-readout SIM (PAR-SIM) achieves the highest imaging speed for fluorescence imaging at currently available detector sensitivity. By using the full frame-width of the detector through synchronizing the pattern generation and image exposure-readout process, we have achieved a fundamentally stupendous information spatial-temporal flux of 132.9 MPixels · s-1, 9.6-fold that of the latest techniques, with the lowest SNR of -2.11 dB and 100 nm resolution. PAR-SIM demonstrates its proficiency in successfully reconstructing diverse cellular organelles in dual excitations, even under conditions of low signal due to ultra-short exposure times. Notably, mitochondrial dynamic tubulation and ongoing membrane fusion processes have been captured in live COS-7 cell, recorded with PAR-SIM at an impressive 408 Hz. We posit that this novel parallel exposure-readout mode not only augments SIM pattern modulation for superior frame rates but also holds the potential to benefit other complex imaging systems with a strategic controlling approach.

Ultra-fast Super-Resolution Imaging by Time-Stretch Structured Illumination

Real-time reconstruction using electro-optics modulator-based structured illumination microscopy

Optical Super-Resolution Imaging Based On Frequency Shift

Saturated Pattern-Illuminated Fourier Ptychography Microscopy

Three-dimensional super-resolution imaging of live whole cells using structured illumination microscopy

Single-frame Structured Illumination Microscopy for Fast Live-Cell Imaging

Laser scanning saturated structured illumination microscopy based on phase modulation

Structured Illumination Fluorescence Fourier Ptychographic Microscopy

Time-encoded structured illumination microscopy: toward ultrafast superresolution imaging.

Super-resolution Laser Scanning Microscopy Through Spatiotemporal Modulation.

Efficient super-resolution imaging method for micro-nano structure based on structured illumination modulation

Super-Resolution Structured Illumination Microscopy Reconstruction Using a Least-Squares Solver

High-speed spatially re-modulated structured illumination microscopy

Structured illumination microscopy with extreme ultraviolet pulses

Advances in High-Speed Structured Illumination Microscopy

Multiwavelength Time-Stretch Imaging System

Ultrafast Surface Imaging with an Increased Spatial Resolution Based on Polarization-Division Multiplexing

Super-resolution Two-Photon Microscopy Via Scanning Patterned Illumination

MUTE-SIM: Multiphoton Up-Conversion Time-Encoded Structured Illumination Microscopy

Fast Long-Term Super-Resolution Imaging with Hessian Structured Illumination Microscopy

Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM)