Image scanning microscopy: a vectorial physical optics analysis

Shih-Te Hung,Dylan Kalisvaart,Carlas Smith

DOI: https://doi.org/10.1364/oe.500957

IF: 3.8

2024-01-04

Optics Express

Abstract:Shih-Te Hung, Dylan Kalisvaart, Carlas Smith Image scanning microscopy (ISM) achieves resolution beyond the diffraction limit by a factor of 2. However, prior ISM research ... [Opt. Express 32, 1524-1539 (2024)]

optics

What problem does this paper attempt to address?

Image Scanning Difference Microscopy

Yuchen Chen,Shaocong Liu,Chengfeng Zhang,Zhimin Zhang,Cuifang Kuang,Xiang Hao,Xu Liu

DOI: https://doi.org/10.1111/jmi.12840

IF: 1.9522

2019-01-01

Journal of Microscopy

Abstract:Here, we propose a novel imaging method, which is called image scanning difference microscopy (ISDM), for superresolution imaging. In ISDM, we implement a detector array composed of 19 avalanche photodiodes (APD) rather than single‐point detector in standard confocal microscopy for reconstructing superresolved images with higher signal‐to‐noise ratio (SNR). Combining with our former proposed fluorescence emission difference (FED) method, we have achieved a lateral resolution of 111 nm (∼λ/6) without the damage of image quality, the highest FED resolution to the best of our knowledge. With its simple setup and remarkable performance, we believe that ISDM can become a versatile observation tool in biology and other fundamental studies.
Superresolution Via Saturated Virtual Modulation Microscopy

Ruizhi Cao,Cuifang Kuang,Yong Liu,Xu Liu

DOI: https://doi.org/10.1364/oe.25.032364

IF: 3.8

2017-01-01

Optics Express

Abstract:The virtual detection method provides us with a more simplified system setup and a considerable resolution enhancement compared with microscopies that apply physical modulation. However, the imaging speed of virtual modulation microscopy is much slower compared with wide-field imaging techniques such as structured illumination microscopy (SIM). In this study, we propose a multiplex virtual modulation microscopy that performs similarly to the former virtual modulation microscopy whose data are acquired using the same system as laser scanning microscopy (LSM) does, yet with a much higher theoretical speed. Under saturated conditions, the virtual modulation microscopy exhibits a high robustness against the aberrations and estimation errors of saturation level. We also show that by applying both virtual temporal modulation (VTM) and virtual spatial modulation (VSM), information can be extracted beyond the typical extended resolution support of linear superresolution methods such as confocal and SIM. However, it is demonstrated that VTM is more efficient in extracting high-spatial-frequency information than VSM. Biospecimen and fluorescent beads are imaged in order to verify the proposed method using the data acquired under the LSM system. (C) 2017 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
Laser scanning saturated structured illumination microscopy based on phase modulation

Yujia Huang,Dazhao Zhu,Luhong Jin,Cuifang Kuang,Yingke Xu,Xu Liu

DOI: https://doi.org/10.1016/j.optcom.2017.03.020

IF: 2.4

2017-01-01

Optics Communications

Abstract:Wide-field saturated structured illumination microscopy has not been widely used due to the requirement of high laser power. We propose a novel method called laser scanning saturated structured illumination microscopy (LS-SSIM), which introduces high order of harmonics frequency and greatly reduces the required laser power for SSIM imaging. To accomplish that, an excitation PSF with two peaks is generated and scanned along different directions on the sample. Raw images are recorded cumulatively by a CCD detector and then reconstructed to form a high-resolution image with extended optical transfer function (OTF). Our theoretical analysis and simulation results show that LS-SSIM method reaches a resolution of 0.16 λ, equivalent to 2.7-fold resolution than conventional wide-field microscopy. In addition, LS-SSIM greatly improves the optical sectioning capability of conventional wide-field illumination system by diminishing our-of-focus light. Furthermore, this modality has the advantage of implementation in multi-photon microscopy with point scanning excitation to image samples in greater depths.
Virtual k-Space Modulation Optical Microscopy.

Cuifang Kuang,Ye Ma,Renjie Zhou,Guoan Zheng,Yue Fang,Yingke Xu,Xu Liu,Peter T C So

DOI: https://doi.org/10.1103/PhysRevLett.117.028102

IF: 8.6

2016-01-01

Physical Review Letters

Abstract:We report a novel superresolution microscopy approach for imaging fluorescence samples. The reported approach, termed virtual k-space modulation optical microscopy (VIKMOM), is able to improve the lateral resolution by a factor of 2, reduce the background level, improve the optical sectioning effect and correct for unknown optical aberrations. In the acquisition process of VIKMOM, we used a scanning confocal microscope setup with a 2D detector array to capture sample information at each scanned x-y position. In the recovery process of VIKMOM, we first modulated the captured data by virtual k-space coding and then employed a ptychography-inspired procedure to recover the sample information and correct for unknown optical aberrations. We demonstrated the performance of the reported approach by imaging fluorescent beads, fixed bovine pulmonary artery endothelial (BPAE) cells, and living human astrocytes (HA). As the VIKMOM approach is fully compatible with conventional confocal microscope setups, it may provide a turn-key solution for imaging biological samples with similar to 100 nm lateral resolution, in two or three dimensions, with improved optical sectioning capabilities and aberration correcting.
Image Scanning Fluorescence Emission Difference Microscopy Based On A Detector Array

Y. Li,S. Liu,D. Liu,S. Sun,C. Kuang,Z. Ding,X. Liu

DOI: https://doi.org/10.1111/jmi.12538

IF: 1.9522

2017-01-01

Journal of Microscopy

Abstract:We propose a novel imaging method that enables the enhancement of three-dimensional resolution of confocal microscopy significantly and achieve experimentally a new fluorescence emission difference method for the first time, based on the parallel detection with a detector array. Following the principles of photon reassignment in image scanning microscopy, images captured by the detector array were arranged. And by selecting appropriate reassign patterns, the imaging result with enhanced resolution can be achieved with the method of fluorescence emission difference. Two specific methods are proposed in this paper, showing that the difference between an image scanning microscopy image and a confocal image will achieve an improvement of transverse resolution by approximately 43% compared with that in confocal microscopy, and the axial resolution can also be enhanced by at least 22% experimentally and 35% theoretically. Moreover, the methods presented in this paper can improve the lateral resolution by around 10% than fluorescence emission difference and 15% than Airyscan. The mechanism of our methods is verified by numerical simulations and experimental results, and it has significant potential in biomedical applications.
Optical Super-Resolution Imaging Based On Frequency Shift

Hao Xiang,Yang Qing,Kuang Cuifang,Liu Xu

DOI: https://doi.org/10.3788/AOS202141.0111001

2021-01-01

Acta Optica Sinica

Abstract:Optical microscopy is non-invasive, sample-friendly, and fast, rendering itself the major approach for human beings to explore the microcosmic world. However, the diffraction limit has hindered the resolution of all optical imaging systems to approximately half the wavelength of visible light for over a century, until it was fundamentally broken by the development of super-resolution optical fluorescence microscopy. This technology bridges the gap between the electron microscopes (1 nm) and the ordinary optical microscopes (200 nm to 250 nm), but it is essentially useless for most samples, especially those non-fluorescent-labeled. In recent years, inspired by the synthetic aperture imaging, we have developed the optical super-resolution imaging based on frequency shift, providing a new approach to optical super-resolution imaging. As the technique is not limited by the nonlinear effects of fluorescence, it is applicable for both non-fluorescent-labeled and fluorescent-labeled samples. Besides, due to such advantages as fast imaging, high sample universality, and low phototoxicity, the technique shows good prospects in multiple fields, including materials science, biology, and medicine. In this paper, we deliver a detailed overview on both the principles and methods of optical super-resolution imaging based on frequency shift, as well as our prospects to the future development direction of this technique.
SOFISM: Super-resolution optical fluctuation image scanning microscopy

Aleksandra Sroda,Adrian Makowski,Ron Tenne,Uri Rossman,Gur Lubin,Dan Oron,Radek Lapkiewicz

DOI: https://doi.org/10.1364/OPTICA.399600

2020-03-07

Abstract:Super-resolution optical microscopy is a rapidly evolving scientific field dedicated to imaging sub-wavelength sized objects, leaving its mark in multiple branches of biology and technology. While several super-resolution optical microscopy methods have become a common tool in life science imaging, new methods, supported by cutting-edge technology, continue to emerge. One rather recent addition to the super-resolution toolbox, image scanning microscopy (ISM), achieves an up to twofold lateral resolution enhancement in a robust and straightforward manner. To further enhance ISM's resolution in all three dimensions, we present and experimentally demonstrate here super-resolution optical fluctuation image scanning microscopy (SOFISM). Measuring the fluorescence fluctuation contrast in an ISM architecture, we obtain images with a x2.5 lateral resolution beyond the diffraction limit along with an enhanced axial resolution for a fixed cell sample labeled with commercially available quantum dots. The inherent temporal averaging of the ISM technique enables image acquisition of the fluctuation correlation contrast within millisecond scale pixel dwell times. SOFISM can therefore offer a robust path to achieve high resolution images within a slightly modified confocal microscope, using standard fluorescent labels and within reasonable acquisition times.

Optics
K-space interpretation of image-scanning-microscopy

Tal I. Sommer,Gil Weinberg,Ori Katz

DOI: https://doi.org/10.1063/5.0142000

2023-01-11

Abstract:In recent years, image-scanning microscopy (ISM, also termed pixel-reassignment microscopy) has emerged as a technique that improves the resolution and signal-to-noise compared to confocal and widefield microscopy by employing a detector array at the image plane of a confocal laser scanning microscope. Here, we present a k-space analysis of coherent ISM, showing that ISM is equivalent to spotlight synthetic-aperture radar (SAR) and analogous to oblique-illumination microscopy. This insight indicates that ISM can be performed with a single detector placed in the k-space of the sample, which we numerically demonstrate.

Optics,Signal Processing,Applied Physics,Medical Physics
High-Resolution Scanning X-ray Diffraction Microscopy

Pierre Thibault,Martin Dierolf,Andreas Menzel,Oliver Bunk,Christian David,Franz Pfeiffer

DOI: https://doi.org/10.1126/science.1158573

IF: 56.9

2008-07-18

Science

Abstract:Coherent diffractive imaging (CDI) and scanning transmission x-ray microscopy (STXM) are two popular microscopy techniques that have evolved quite independently. CDI promises to reach resolutions below 10 nanometers, but the reconstruction procedures put stringent requirements on data quality and sample preparation. In contrast, STXM features straightforward data analysis, but its resolution is limited by the spot size on the specimen. We demonstrate a ptychographic imaging method that bridges the gap between CDI and STXM by measuring complete diffraction patterns at each point of a STXM scan. The high penetration power of x-rays in combination with the high spatial resolution will allow investigation of a wide range of complex mesoscopic life and material science specimens, such as embedded semiconductor devices or cellular networks.

multidisciplinary sciences
Spatial light modulation for interferometric scattering microscopy

Vivien Walter,Christopher Parperis,Yujie Guo,Mark Ian Wallace

DOI: https://doi.org/10.1111/jmi.13347

IF: 1.9522

2024-08-28

Journal of Microscopy

Abstract:Interferometric scattering (iSCAT) microscopy enables high‐speed and label‐free detection of individual molecules and small nanoparticles. Here we apply point spread function engineering to provide adaptive control of iSCAT images using spatial light modulation. With this approach, we demonstrate improved dynamic spatial filtering, real‐time background subtraction, focus control, and signal modulation based on sample orientation.

microscopy
An Optical Super-Microscope for Far-field, Real-time Imaging Beyond the Diffraction Limit

Alex M. H. Wong,George V. Eleftheriades

DOI: https://doi.org/10.1038/srep01715

IF: 4.6

2013-04-24

Scientific Reports

Abstract:Optical microscopy suffers from a fundamental resolution limitation arising from the diffractive nature of light. While current solutions to sub-diffraction optical microscopy involve combinations of near-field, non-linear and fine scanning operations, we hereby propose and demonstrate the optical super-microscope (OSM) – a superoscillation-based linear imaging system with far-field working and observation distances – which can image an object in real-time and with sub-diffraction resolution. With our proof-of-principle prototype we report a point spread function with a spot size clearly reduced from the diffraction limit and demonstrate corresponding improvements in two-point resolution experiments. Harnessing a new understanding of superoscillations, based on antenna array theory, our OSM achieves far-field, sub-diffraction optical imaging of an object without the need for fine scanning, data post-processing or object pre-treatment. Hence the OSM can be used in a wide variety of imaging applications beyond the diffraction limit, including real-time imaging of moving objects.

multidisciplinary sciences
Multifocal Interferometric Synthetic Aperture Microscopy.

Yang Xu,Xiong Kai Benjamin Chng,Steven G. Adie,Stephen A. Boppart,P. Scott Carney

DOI: https://doi.org/10.1364/oe.22.016606

IF: 3.8

2014-01-01

Optics Express

Abstract:There is an inherent trade-off between transverse resolution and depth of field (DOF) in optical coherence tomography (OCT) which becomes a limiting factor for certain applications. Multifocal OCT and interferometric synthetic aperture microscopy (ISAM) each provide a distinct solution to the trade-off through modification to the experiment or via post-processing, respectively. In this paper, we have solved the inverse problem of multifocal OCT and present a general algorithm for combining multiple ISAM datasets. Multifocal ISAM (MISAM) uses a regularized combination of the resampled datasets to bring advantages of both multifocal OCT and ISAM to achieve optimal transverse resolution, extended effective DOF and improved signal-to-noise ratio. We present theory, simulation and experimental results.
Reconstructing the Image Scanning Microscopy Dataset: an Inverse Problem

Alessandro Zunino,Marco Castello,Giuseppe Vicidomini

DOI: https://doi.org/10.1088/1361-6420/accdc5

2022-11-22

Abstract:Confocal laser-scanning microscopy (CLSM) is one of the most popular optical architectures for fluorescence imaging. In CLSM, a focused laser beam excites the fluorescence emission from a specific specimen position. Some actuators scan the probed region across the sample and a photodetector collects a single intensity value for each scan point, building a two-dimensional image pixel-by-pixel. Recently, new fast single-photon array detectors have allowed the recording of a full bi-dimensional image of the probed region for each scan point, transforming CLSM into image scanning microscopy (ISM). This latter offers significant improvements over traditional imaging but requires an optimal processing tool to extract a super-resolved image from the four-dimensional dataset. Here we describe the image formation process in ISM from a statistical point of view, and we use the Bayesian framework to formulate a multi-image deconvolution problem. Notably, the single-photon detector suffers exclusively from the photon shot noise, enabling the development of an effective likelihood model. We derive an iterative likelihood maximization algorithm and test it on experimental and simulated data. Furthermore, we demonstrate that the ISM dataset is redundant, enabling the possibility of obtaining reconstruction sampled at twice the scanning step. Our results prove that in ISM, under appropriate conditions, the Nyquist-Shannon sampling criterium is effectively relaxed. This finding can be exploited to speed up the acquisition process by a factor of four, further improving the versatility of ISM systems.

Image and Video Processing,Optics
Image Scanning Microscopy Reconstruction by Autocorrelation Inversion

Daniele Ancora,Alessandro Zunino,Giuseppe Vicidomini,Alvaro H. Crevenna

2024-04-13

Abstract:Confocal laser scanning microscopy (CLSM) stands out as one of the most widely used microscopy techniques, thanks to its three-dimensional imaging capability and its sub-diffraction spatial resolution, achieved through the closure of a pinhole in front of a single-element detector. However, the pinhole also rejects useful photons and beating the diffraction limit comes at the price of irremediably compromising the signal-to-noise ratio (SNR) of the data. Image scanning microscopy (ISM) emerged as the natural evolution of CLSM, exploiting a small array detector in place of the pinhole and the single-element detector. Each sensitive element is small enough to achieve sub-diffraction resolution through the confocal effect, but the size of the whole detector is large enough to guarantee excellent collection efficiency and SNR. However, the raw data produced by an ISM setup consists of a 4D dataset which can be seen as a set of confocal-like images. Thus, fusing the dataset into a single super-resolved image requires a dedicated reconstruction algorithm. Conventional methods are multi-image deconvolution, which requires prior knowledge of the system point spread functions (PSF), or adaptive pixel reassignment (APR), which is effective only on a limited range of experimental conditions. In this work, we describe and validate a novel concept for ISM image reconstruction based on autocorrelation inversion. We leverage unique properties of the autocorrelation to discard low-frequency components and maximize the resolution of the reconstructed image, without any assumption on the image or any knowledge of the PSF. Our results push the quality of the ISM reconstruction beyond the level provided by APR and open new perspectives for multi-dimensional image processing.

Optics,Applied Physics,Computational Physics
Multifocal Interferometric Synthetic Aperture Microscopy

Yang Xu,Xiong Kai Benjamin Chng,Steven G. Adie,Stephen A. Boppart,P. Scott Carney

DOI: https://doi.org/10.1364/fio.2013.fw1d.5

2013-01-01

Abstract:We extend ISAM to OCT data collected with multiple positions of the focal plane. Multifocal ISAM achieves spatially invariant resolution and better signal-to-noise ratio over the entire image than is possible with single-focus ISAM.
Expanding Super-Resolution Imaging Versatility in Organisms with Multi-Confocal Image Scanning Microscopy

Wei Ren,Meiling Guan,Qianxi Liang,Meiqi Li,Boya Jin,Guangxing Duan,Liya Zhang,Xichuan Ge,Hong Xu,Yiwei Hou,Baoxiang Gao,Peng Sodmergen,Peng Xi

DOI: https://doi.org/10.1093/nsr/nwae303

IF: 20.6

2024-01-01

National Science Review

Abstract:Resolving complex three-dimensional (3D) subcellular dynamics noninvasively in live tissues demands imaging tools that balance spatiotemporal resolution, field-of-view and phototoxicity. Image scanning microscopy (ISM), as an advancement of confocal laser scanning microscopy, provides a 2-fold 3D resolution enhancement. Nevertheless, the relatively low imaging speed has been the major obstacle for ISM to be further employed in in vivo imaging of biological tissues. Our proposed solution, multi-confocal image scanning microscopy (MC-ISM), aims to overcome the limitations of existing techniques in terms of spatiotemporal resolution balancing by optimizing pinhole diameter and pitch, eliminating out-of-focus signals, and introducing a frame reduction reconstruction algorithm. The imaging speed is increased by 16 times compared with multifocal structured illumination microscopy. We further propose a single-galvo scan, akin to the Archimedes spiral in spinning disk confocal systems, to ensure a high-speed and high-accuracy scan without the galvanometer's inertial motion. Benefitting from its high photon efficiency, MC-ISM allows continuous imaging of mitochondria dynamics in live cells for 1000 frames without apparent phototoxicity, reaching an imaging depth of 175 mu m. Noteworthy, MC-ISM enables the observation of the inner membrane structure of living mitochondria in Arabidopsis hypocotyl for the first time, demonstrating its outstanding performance.
iSCAT microscopy and particle tracking with tailored spatial coherence

Mahdi Mazaheri,Kiarash Kasaian,David Albrecht,Jan Renger,Tobias Utikal,Cornelia Holler,Vahid Sandoghdar

DOI: https://doi.org/10.1364/optica.523788

IF: 10.4

2024-07-20

Optica

Abstract:Mahdi Mazaheri, Kiarash Kasaian, David Albrecht, Jan Renger, Tobias Utikal, Cornelia Holler, Vahid Sandoghdar Interferometric scattering (iSCAT) microscopy has demonstrated unparalleled performance among label-free optical methods for detecting and ... [Optica 11, 1030-1038 (2024)]

optics
Tsang's resolution enhancement method for imaging with focused illumination

Alexander Duplinskiy,Jernej Frank,Kaden Bearne,A. I. Lvovsky

2024-06-01

Abstract:A widely tested approach to overcoming the diffraction limit in microscopy without disturbing the sample relies on substituting widefield sample illumination with a structured light beam. This gives rise to confocal, image-scanning and structured-illumination microscopy methods. On the other hand, as shown recently by Tsang and others, subdiffractional resolution at the detection end of the microscope can be achieved by replacing the intensity measurement in the image plane with spatial mode demultiplexing. In this work we study the combined action of Tsang's method with image scanning. We experimentally demonstrate superior lateral resolution and enhanced image quality compared to either method alone. This result paves the way for integrating spatial demultiplexing into existing microscopes, contributing to further pushing the boundaries of optical resolution.

Optics,Quantum Physics
Deep imaging inside scattering media through virtual spatiotemporal wavefront shaping

Yiwen Zhang,Minh Dinh,Zeyu Wang,Tianhao Zhang,Tianhang Chen,Chia Wei Hsu

2024-06-04

Abstract:The multiple scattering of light makes materials opaque and obstructs imaging. Wavefront shaping can reverse the scattering process, but imaging with physical wavefront shaping has limitations such as requiring physical guidestars, being restricted within a small isoplanatic volume, and relying on slow wavefront updates, with some approaches only working for planar targets outside the scattering media. Here, we introduce scattering matrix tomography (SMT): measure the hyperspectral scattering matrix of the sample, use it to digitally scan a synthesized confocal spatiotemporal focus and construct a volumetric image of the sample, and then use the tomograms as virtual guidestars in a nonconvex optimization to find the pulse shape, input wavefront, and output wavefront that can compensate for aberrations and scattering. SMT combines the strengths of wavefront shaping, spatiotemporal gating, and computational adaptive optics, eliminating physical guidestars and enabling digital double-path wavefront corrections tailored for every isoplanatic volume. We demonstrate sub-micron lateral resolution and one-micron axial resolution at one millimeter beneath ex vivo mouse brain tissue and over three transport mean free paths inside an opaque colloid, where existing imaging methods all fail due to the overwhelming multiple scattering. As a noninvasive and label-free method that works both inside and outside the scattering media, SMT may be applied broadly across medical imaging, biological science, device inspection, and colloidal physics.

Optics,Biological Physics
Label-free image scanning microscopy for kHz super-resolution imaging and single particle tracking

Duc-Minh Ta,Alberto Aguilar,Pierre Bon

2023-08-30

Abstract:We report the modification of a label-free image scanning microscope (ISM) to perform asynchronous 2D imaging at 24kHz while keeping the lateral resolution gain and background rejection of a regular label-free ISM setup. Our method uses a resonant mirror oscillating at 12kHz for one-direction scanning and a chromatic line for instantaneous scanning in the other direction. We adapt optical photon reassignment in this scanning regime to perform fully optical super-resolution imaging. We exploit the kHz imaging capabilities of this confocal imaging system for single nanoparticle tracking down to 20nm for gold and 50nm for silica particles as well as imaging freely moving Lactobacillus with improved resolution.

Optics,Biological Physics

Image scanning microscopy: a vectorial physical optics analysis

Image Scanning Difference Microscopy

Superresolution Via Saturated Virtual Modulation Microscopy

Laser scanning saturated structured illumination microscopy based on phase modulation

Virtual k-Space Modulation Optical Microscopy.

Image Scanning Fluorescence Emission Difference Microscopy Based On A Detector Array

Optical Super-Resolution Imaging Based On Frequency Shift

SOFISM: Super-resolution optical fluctuation image scanning microscopy

K-space interpretation of image-scanning-microscopy

High-Resolution Scanning X-ray Diffraction Microscopy

Spatial light modulation for interferometric scattering microscopy

An Optical Super-Microscope for Far-field, Real-time Imaging Beyond the Diffraction Limit

Multifocal Interferometric Synthetic Aperture Microscopy.

Reconstructing the Image Scanning Microscopy Dataset: an Inverse Problem

Image Scanning Microscopy Reconstruction by Autocorrelation Inversion

Multifocal Interferometric Synthetic Aperture Microscopy

Expanding Super-Resolution Imaging Versatility in Organisms with Multi-Confocal Image Scanning Microscopy

iSCAT microscopy and particle tracking with tailored spatial coherence

Tsang's resolution enhancement method for imaging with focused illumination

Deep imaging inside scattering media through virtual spatiotemporal wavefront shaping

Label-free image scanning microscopy for kHz super-resolution imaging and single particle tracking