Delayed diagnosis of malignant tumors missed at laparoscopic cholecystectomy

W. Junger,W. Junger,J. Hutter,K. Miller,E. Moritz

DOI: https://doi.org/10.1007/s004649900513

1997-10-01

Surgical Endoscopy

Abstract:

What problem does this paper attempt to address?

Effect of spatial spectrum overlap on fourier ptychographic microscopy

Qiulan Liu,Cuifang Kuang,Yue Fang,Peng Xiu,Yicheng Li,Ruixin Wen,Xu Liu

DOI: https://doi.org/10.1142/S1793545816410042

IF: 2.396

2017-01-01

Journal of Innovative Optical Health Sciences

Abstract:Fourier ptychographic microscopy (FPM) is a newly developed imaging technique which stands out by virtue of its high-resolution and wide FOV. It improves a microscope's imaging performance beyond the diffraction limit of the employed optical components by illuminating the sample with oblique waves of different incident angles, similar to the concept of synthetic aperture. We propose to use an objective lens with high-NA to generate oblique illuminating waves in FPM. We demonstrate utilizing an objective lens with higher NA to illuminate the sample leads to better resolution by simulations, in which a resolution of 0.28 mu m is achieved by using a high-NA illuminating objective lens (NA = 1.49) and a low-NA collecting objective lens (NA = 0.2) in coherent imaging (lambda = 488 nm). We then deeply study FPM's exact relevance of convergence speed to spatial spectrum overlap in frequency domain. The simulation results show that an overlap of about 60% is the optimal choice to acquire a high-quality recovery (520*520 pixels) with about 2 min ' s computing time. In addition, we testify the robustness of the algorithm of FPM to additive noises and its suitability for phase objects, which further proves FPM's potential application in biomedical imaging.
Digital micromirror device-based laser-illumination Fourier ptychographic microscopy.

Cuifang Kuang,yousi ma,renping zhou,Justin Lee,George Barbastathis,Ramachandra R Dasari,Zahid Yaqoob,Peter T C So

DOI: https://doi.org/10.1364/OE.23.026999

IF: 3.8

2015-01-01

Optics Express

Abstract:We report a novel approach to Fourier ptychographic microscopy (FPM) by using a digital micromirror device (DMD) and a coherent laser source (532 nm) for generating spatially modulated sample illumination. Previously demonstrated FPM systems are all based on partially-coherent illumination, which offers limited throughput due to insufficient brightness. Our FPM employs a high power coherent laser source to enable shot-noise limited high-speed imaging. For the first time, a digital micromirror device (DMD), imaged onto the back focal plane of the illumination objective, is used to generate spatially modulated sample illumination field for ptychography. By coding the on/off states of the micromirrors, the illumination plane wave angle can be varied at speeds more than 4 kHz. A set of intensity images, resulting from different oblique illuminations, are used to numerically reconstruct one high-resolution image without obvious laser speckle. Experiments were conducted using a USAF resolution target and a fiber sample, demonstrating high-resolution imaging capability of our system. We envision that our approach, if combined with a coded-aperture compressive-sensing algorithm, will further improve the imaging speed in DMD-based FPM systems. (C) 2015 Optical Society of America
Surface wave illumination Fourier ptychographic microscopy.

Qiulan Liu,Yue Fang,Renjie Zhou,Peng Xiu,Cuifang Kuang,Xu Liu

DOI: https://doi.org/10.1364/OL.41.005373

IF: 3.6

2016-01-01

Optics Letters

Abstract:We propose a novel microscopy method, combining surface wave illumination and the Fourier ptychographic microscopy (FPM) algorithm to achieve super-resolution (SR) imaging. In our system, an oil-immersion objective lens is used to excite both the total internal reflection (TIR) evanescent waves and the surface plasmon waves (SPWs), which illuminate the sample with large wave vectors. Through the FPM algorithm, a resolution approximately twice that of conventional wide-field microscopy is obtained. Meanwhile, we could retrieve the sample's quantitative phase map in order to obtain its surface profile. Importantly, the field enhancement from a SPW has improved the contrast of the reconstructed images, which is critical for revealing the finer structural details of the specimen. In our experiments, we have imaged metallic gratings with a 120 or 150 nm wide line and trench features. We accurately retrieved their axial dimensions with a lateral resolution better than 240 nm that is close to the theoretical resolution of 215 nm, thus demonstrating the quantitative phase imaging capability of our technique. As this approach provides a label-free solution for intensity and phase imaging of samples with lateral resolution exceeding the limit introduced by the optical system, it can be potentially used in a wide range of noninvasive biological imaging applications. (C) 2016 Optical Society of America.
Wavefront Modulation with Spatial Light Modulator for Fourier Ptychographic Microscopy

Jinlei Zhang,Xiao Tao,Qin Xie,Yan Sun,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2601379

2021-01-01

Abstract:Fourier ptychographic microscopy (FPM) is a recently developed computational imaging technology, which can bypass the limitation of optical-spatial-bandwidth product to achieve imaging with both high resolution and wide field-of-view. Original FPM setup is limited to image thin samples with angle-varied illuminations. A diffuser scanning FPM method, which scans a diffuser with unknown profile between the object and objective lens to modulate the complex exit wavefront of the object, is implemented to address this 3D refocusing problem. However, since the profile of the diffuser is unknown, the number of images required for method to converge is large. A mechanical translation stage is also required, which may introduce the systematic error of the position. In this paper, we propose a new FPM method with wavefront modulation imposed by spatial light modulator (SLM). The SLM is placed between the object and the objective lens to produce specific pattern profile, which is used to modulate the complex exit wavefront of the object. Fourier ptychographic phase retrieval process is employed to recovery the complex exit wavefront of the object. With the use of SLM, it is unnecessary to employ 2D motorized translation stage to move the imposed pattern profile so that the error of translation stage is eliminated. Moreover, since the imposed pattern profile is known, the number of images required for the algorithm to converge is reduced. Simulation and experiment are performed to validate the effectiveness of our proposed method. Compared with the method, which utilizes unknown diffuser, our method can achieve a more accurate reconstruction result with a faster data acquisition and higher convergence speed.
High-speed Fourier Ptychographic Microscopy for Quantitative Phase Imaging.

Yi Xiao,Shiyuan Wei,Shaolong Xue,Cuifang Kuang,Anli Yang,Maoliang Wei,Hongtao Lin,Renjie Zhou

DOI: https://doi.org/10.1364/ol.428731

IF: 3.6

2021-01-01

Optics Letters

Abstract:Fourier ptychographic microscopy (FPM), as an emerging computational imaging method, has been applied to quantitative phase imaging with resolution bypassing the physical limit of the detection objective. Due to the weak illumination intensity and long image acquisition time, the achieved imaging speed in current FPM methods is still low, making them unsuitable for real-time imaging applications. We propose and demonstrate a high-speed FPM method based on using laser illumination and digital micro-mirror devices for illumination angle scanning. In this new, to the best of our knowledge, FPM method, we realized quantitative phase imaging and intensity imaging at over 42 frames per second (fps) with around 1 µm lateral resolution. The quantitative phase images have revealed membrane height fluctuations of red blood cells with nanometer-scale sensitivity, while the intensity images have resolved subcellular features in stained cancer tissue slices.
Fourier Ptychography for High Space-Bandwidth Product Microscopy

Liheng Bian,Jinli Suo,Qionghai Dai,Feng Chen

DOI: https://doi.org/10.1515/aot-2017-0054

2017-01-01

Advanced Optical Technologies

Abstract:Fourier ptychography is a novel imaging technique with high space-bandwidth product (SBP) on the scale of gigapixel, and has been successfully applied for high-resolution and large field-of-view (FOV) microscopy, termed Fourier ptychographic microscopy (FPM). FPM utilizes a low-numerical-aperture objective lens to capture multiple large FOV but low-resolution images under angularly varying illumination, and uses phase-retrieval algorithms to reconstruct the sample's high-resolution amplitude and phase information. FPM is advantageous over conventional high SBP microscopy techniques in many aspects, including no mechanical scanning, computational acquisition of both amplitude and phase, extended depth of focus, long working distance, and high compatibility with current microscopes. In this paper, we review FPM with its principles, multiple techniques to improve its performance, and its various applications and extensions.
Tunable-illumination for Laser Fourier Ptychographic Microscopy Based on a Background Noise-Reducing System

Xiao Tao,Jinlei Zhang,Chenning Tao,Peng Sun,Rengmao Wu,Zhenrong Zheng

DOI: https://doi.org/10.1016/j.optcom.2020.125764

IF: 2.4

2020-01-01

Optics Communications

Abstract:It is inherently difficult for a conventional microscopic imaging system to produce images with both wide field of view (FOV) and high-resolution because of its limited space bandwidth product. Fourier ptychographic microscopy (FPM) has been developed to overcome this limitation by using angle-varied illumination to enhance the performance of the system. In this paper, we propose a FPM imaging approach that employs a laser source with a newly developed illumination control optical system. The proposed system consists of a digital micromirror device and a zoom system with a condenser lens to provide sample illumination with angle-varied pattern directions and controllable pattern sizes. In addition, a total internal reflection prism is employed in the system to remove unexpected background noise and extend the FOV for reconstruction. The proposed system is validated against a USAF resolution target and a biological sample, and as a result reconstructs images with higher resolution and more details once the positional misalignment correction algorithm is employed. We envision that the proposed FPM system will be suitable for high-speed imaging applications.
Fourier Ptychographic Microscopy 10 Years on: A Review

Fannuo Xu,Zipei Wu,Chao Tan,Yizheng Liao,Zhiping Wang,Keru Chen,An Pan

DOI: https://doi.org/10.3390/cells13040324

IF: 6

2024-02-11

Cells

Abstract:Fourier ptychographic microscopy (FPM) emerged as a prominent imaging technique in 2013, attracting significant interest due to its remarkable features such as precise phase retrieval, expansive field of view (FOV), and superior resolution. Over the past decade, FPM has become an essential tool in microscopy, with applications in metrology, scientific research, biomedicine, and inspection. This achievement arises from its ability to effectively address the persistent challenge of achieving a trade-off between FOV and resolution in imaging systems. It has a wide range of applications, including label-free imaging, drug screening, and digital pathology. In this comprehensive review, we present a concise overview of the fundamental principles of FPM and compare it with similar imaging techniques. In addition, we present a study on achieving colorization of restored photographs and enhancing the speed of FPM. Subsequently, we showcase several FPM applications utilizing the previously described technologies, with a specific focus on digital pathology, drug screening, and three-dimensional imaging. We thoroughly examine the benefits and challenges associated with integrating deep learning and FPM. To summarize, we express our own viewpoints on the technological progress of FPM and explore prospective avenues for its future developments.

cell biology
Phase-coded Speckle Illumination for Laser Fourier Ptychographic Microscopy

Xiao Tao,Jinlei Zhang,Peng Sun,Chang Wang,Chenning Tao,Rengmao Wu,Zhenrong Zheng

DOI: https://doi.org/10.1016/j.optcom.2021.127199

IF: 2.4

2021-01-01

Optics Communications

Abstract:It remains a tough task for designing a microscopy system to approach the diffraction limit over a wide field of view due to its restricted space bandwidth product (SBP). Fourier ptychographic microscopy (FPM) has been developed to broaden the SBP of a conventional microscope platform without major hardware modifications. In this paper, we propose a novel FPM system based on the phase-coded speckle illumination, termed PSI-FPM, which employs a laser source with a speckle illumination control optical system. A phase-only spatial light modulator (SLM) with a condenser lens is utilized in the PSI-FPM system to project the phase-coded speckle illumination patterns onto the sample. The convolution between the sample spectrum and the illumination spectrum in the Fourier domain extend the numerical aperture of the objective that acts as a low-pass filter with cut-off frequency. The SLM is introduced in the PSI-FPM system to produce the specific illumination patterns so that the number of the captured images used for reconstruction are greatly reduced. In addition, the generated pattern is scanned to different directions without mechanical movement, which improves the robustness of the system. The PSI-FPM system is validated against simulations and experiments, and as a result reconstructs high-resolution images once the phase retrieval algorithm is employed. We envision that the PSI-FPM system will be suitable for many other speckle imaging applications.
High-Resolution Dmd-Fpm System Based On Ring Pattern Phase Retrieval Algorithm

Xiao Tao,Jinlei Zhang,Youquan Liu,Chang Wang,Wentao Zhang,Chenning Tao,Shengqian Chang,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2319648

2018-01-01

Abstract:We report an approach to enhance the resolution of the microscopy imaging by using the fourier ptychographic microscopy (FPM) method with a laser source and Spatial Light Modulator (SLM) to generate modulated sample illumination. The performance of the existed FPM system is limited by low illumination efficiency of the LED array. In our prototype setup, digital micromirror device (DMD) is introduced to replace the LED array as a reflective spatial light modulator and is placed at the front focal plane of the 4F system. A ring pattern sample illumination is generated by coding the micromirrors on the DMD, and converted to multi-angular illumination through the relay illumination system. A series of intensity sample images can be obtained by changing the size of the ring pattern and then used to reconstruct high resolution image through the ring pattern phase retrieval algorithm. Finally, our method is verified by an experiment using a resolution chart. The results also show that our method have higher reconstruction resolution and faster imaging speed.
High-throughput fast full-color digital pathology based on Fourier ptychographic microscopy via color transfer

Yuting Gao,Jiurun Chen,Aiye Wang,An Pan,Caiwen Ma,Baoli Yao

DOI: https://doi.org/10.1007/s11433-021-1730-x

2021-07-27

Abstract:The usage of full-color imaging in digital pathology produces significant results. Compared with a grayscale image or a pseudocolor image containing contrast information, a full-color image can identify and detect the target object better with color texture information. Fourier ptychographic microscopy (FPM) is a high-throughput computational imaging technique that breaks the tradeoff between high resolution (HR) and a large field of view. It also eliminates the artifacts of scanning and stitching in digital pathology and improves its imaging efficiency. However, the conventional full-color digital pathology based on FPM is still time-consuming because of the repeated experiments with tri-wavelengths. A color transfer FPM approach termed "CFPM" was reported. The color texture information of a low-resolution full-color pathologic image is directly transferred to the HR grayscale FPM image captured by only a single wavelength. Both of the color space of FPM based on the standard CIE-XYZ color model and the display based on the standard RGB color space were established. Different FPM colorization schemes were analyzed and compared with 30 biological samples. Three types of evaluation approaches were provided, including the root-mean-square error (RMSE), the difference maps, and the image histogram cosine similarity. The average RMSE values of the conventional method and CFPM compared with the ground truth were 5.3% and 5.7%, respectively. Therefore, the reconstruction time is significantly reduced by 2/3 with the sacrifice of precision of only 0.4%. The CFPM method is also compatible with advanced fast FPM approaches to further reduce computation time.
FPM-WSI: Fourier ptychographic whole slide imaging via feature-domain backdiffraction

Shuhe Zhang,Aiye Wang,Jinghao Xu,Tianci Feng,Jinhua Zhou,An Pan

2024-02-28

Abstract:Fourier ptychographic microscopy (FPM), characterized by high-throughput computational imaging, theoretically provides a cunning solution to the trade-off between spatial resolution and field of view (FOV), which has a promising prospect in the application of digital pathology. However, block reconstruction and then stitching has currently become an unavoidable procedure due to vignetting effects. The stitched image tends to present color inconsistency in different image segments, or even stitching artifacts. In response, we reported a computational framework based on feature-domain backdiffraction to realize full-FOV, stitching-free FPM reconstruction. Different from conventional algorithms that establish the loss function in the image domain, our method formulates it in the feature domain, where effective information of images is extracted by a feature extractor to bypass the vignetting effect. The feature-domain error between predicted images based on estimation of model parameters and practically captured images is then digitally diffracted back through the optical system for complex amplitude reconstruction and aberration compensation. Through massive simulations and experiments, the method presents effective elimination of vignetting artifacts, and reduces the requirement of precise knowledge of illumination positions. We also found its great potential to recover the data with a lower overlapping rate of spectrum and to realize automatic blind-digital refocusing without a prior defocus distance.

Optics,Complex Variables,Optimization and Control
Fast color Fourier ptychographic microscopy based on spatial filtering frequency fusion

Junrui Zhen,Yanxiong Wu,Mingdi Liu,Haiqi Zhang,Zicong Luo,Lisong Yan,Ruofei Wu,Jiaxiong Luo

DOI: https://doi.org/10.1016/j.optlastec.2024.112054

IF: 4.939

2024-11-04

Optics & Laser Technology

Abstract:High-throughput, highly color-accurate full-color images have high application value in digital pathology and can provide valuable information in the corresponding pathology section analysis. Fourier ptychographic microscopy (FPM) is a new computational microscopy imaging technique, which breaks through the diffraction limit of traditional microscopy via the optical synthesis of aperture. Thus, FPM technology has been widely used in digital pathology. However, the use of the traditional RGB channel reconstruction color FPM to achieve full-color imaging and acquire and reconstruct images is computationally extensive. Moreover, during the reconstruction process, the low-frequency portion of the reconstructed image varies with factors such as fluctuations in the light intensity and exhibits a color bias, resulting in the loss of a certain degree of color accuracy. To address these challenges, this study proposes a fast color FPM scheme based on spatial filtering frequency fusion (SFCFPM). The scheme describes the frequency fusion relationship between color and texture in color FPM by establishing a spectrum filtering model for color FPM. Based on the guidance of this model, the SFCFPM scheme extracts high-resolution (HR) images reconstructed by a single channel FPM and fuses them with low-resolution (LR) color images acquired using a low-magnification objective to obtain HR color images with a large field-of-view. Moreover, the SFCFPM can reduce the acquisition and reconstruction time by 2/3 compared with the traditional RGB channel reconstruction color FPM scheme. Furthermore, compared with the fast color FPM scheme that requires coloring, the coloring time can be reduced from tens to hundreds of seconds to less than 0.1 s, and the accuracy can be improved by 65.21 % compared with the RGB channel reconstruction, which enables SFCFPM to further promote the application of color FPM technology in the field of digital pathology.

optics,physics, applied
Single full-FOV reconstruction Fourier ptychographic microscopy

Youqiang Zhu,Minglu Sun,Xiong Chen,Hao Li,Quanquan Mu,Dayu Li,Li Xuan

DOI: https://doi.org/10.1364/boe.409952

IF: 3.4

2020-11-16

Biomedical Optics Express

Abstract:Fourier ptychographic microscopy (FPM) is a recently developed computational imaging technique that has high-resolution and wide field-of-view (FOV). FPM bypasses the NA limit of the system by stitching a number of variable-illuminated measured images in Fourier space. On the basis of the wide FOV of the low NA objective, the high-resolution image with a wide FOV can be reconstructed through the phase recovery algorithm. However, the high-resolution reconstruction images are affected by the LED array point light source. The results are: (1) the intensities collected by the sample are severely declined when edge LEDs illuminate the sample; (2) the multiple reconstructions are caused by wavevectors inconsistency for the full FOV images. Here, we propose a new lighting scheme termed full FOV Fourier ptychographic microscopy (F3PM). By combining the LED array and telecentric lens, the method can provide plane waves with different angles while maintaining uniform intensity. Benefiting from the telecentric performance and f‒θ property of the telecentric lens, the system stability is improved and the relationship between the position of LED and its illumination angle is simplified. The excellent plane wave provided by the telecentric lens guarantees the same wavevector in the full FOV, and we use this wavevector to reconstruct the full FOV during one time. The area and diameter of the single reconstruction FOV reached 14.6mm 2 and 5.4 mm, respectively, and the diameter is very close to the field number (5.5 mm) of the 4× objective. Compared with the traditional FPM, we have increased the diameter of FOV in a single reconstruction by ∼ 10 times, eliminating the complicated steps of computational redundancy and image stitching.

radiology, nuclear medicine & medical imaging,biochemical research methods,optics
A Fast Fourier Ptychographic Microscope Method with Biomedical Application

Chaijie Duan,Yawei Kuang,Hui Ma

DOI: https://doi.org/10.1117/12.2251897

2017-01-01

Abstract:Fourier ptychographic microscopy (FPM) is a newly reported techniques that bypasses the SBP barrier of conventional microscope platforms, which gets high-resolution (HR) images with large FOV. FPM uses an LED matrix as the illuminating source of the microscope. Each lighted LED corresponds to a low-resolution (LR) image. An HR image is generated from a set of LR images by FPM. Larger illuminating angle provides higher frequency information for the HR image. Therefore, FPM increases the NA of the low-NA objective lens while maintaining the large FOV. However, the process of FPM is usually time-consuming, since typically hundreds of LR images are recorded and equally involved in the iteration to maintain the quality of reconstruction. In this paper, we proposed a method to accelerate FPM reconstructing process, called Adaptive-FPM. Inspired by the concept of “keyhole imaging” in MRI, we set an energy change threshold in the reconstruction for each LR image to decide whether the image can be skipped in current iteration or not. In this way, some images will be skipped in further iteration, and the total reconstruction time can be reduced. The method was tested by both simulated data and biomedical data, which showed that the new method led to similar results with the original FPM method, while the run-time was reduced a lot.
Fourier ptychographic microscopy with sparse representation

Yongbing Zhang,Pengming Song,Jian Zhang,Qionghai Dai

DOI: https://doi.org/10.1038/s41598-017-09090-8

IF: 4.6

2017-01-01

Scientific Reports

Abstract:Fourier ptychographic microscopy (FPM) is a novel computational microscopy technique that provides intensity images with both wide field-of-view and high-resolution. By combining ideas from synthetic aperture and phase retrieval, FPM iteratively stitches together a number of variably illuminated, low-resolution intensity images in Fourier space to reconstruct a high-resolution complex sample image. Although FPM is able to bypass the space-bandwidth product (SBP) limit of the optical system, it is vulnerable to the various capturing noises and the reconstruction is easy to trap into the local optimum. To efficiently depress the noise and improve the performance of reconstructed high-resolution image, a FPM with sparse representation is proposed in this paper. The cost function of the reconstruction is formulated as a regularized optimization problem, where the data fidelity is constructed based on a maximum likelihood theory, and the regulation term is expressed as a small number of nonzero elements over an appropriate basis for both amplitude and phase of the reconstructed image. The Nash equilibrium is employed to obtain the approximated solution. We validate the proposed method with both simulated and real experimental data. The results show that the proposed method achieves state-of-the-art performance in comparison with other approaches.
Analysis of Fourier ptychographic microscopy with half of the captured images

Ao Zhou,Ni Chen,Haichao Wang,Guohai Situ

DOI: https://doi.org/10.1088/2040-8986/aad453

IF: 2.1

2018-07-31

Journal of Optics

Abstract:Fourier ptychographic microscopy (FPM) is a new computational imaging technique that can provide gigapixel images with both a high resolution and a wide field of view. However, the data-acquisition process is time consuming, which is a critical issue. In this study, we analyze the FPM imaging system with the half number of captured images; i.e., if the size of the light-emitting diode (LED) array is 15× 15, we use 15×8 LEDs to capture images. According to the image analysis of the conventional FPM system, we then compare the reconstructed images with different captured data. When the sample is close to amplitude-only, simulation and experimental results show that the resolution of the reconstructed image with the half number of captured data does not differ significantly from that with all the captured data.

optics
Fast color fourier Ptychographic microscopic imaging technology with fusion color correction

HaiQi Zhang,JunRui Zhen,Yanxiong Wu,RuoFei Wu,ZiCong Luo,MingDi Liu,Jiaxiong Luo,Rui Xie,LiSong Yan

DOI: https://doi.org/10.2139/ssrn.4801829

IF: 5.666

2024-06-20

Optics and Lasers in Engineering

Abstract:In biomedicine, rapid and accurate acquisition of color pathology slides is of paramount importance for diagnostic analyses. Conventional microscopic full-color imaging cannot provide the physician with enough effective information at one time due to the "law of proportionality of objective lenses." Fourier ptychographic microscopy (FPM) has emerged as a solution for high-throughput digital pathology. It can simultaneously achieve a large field of view and high-resolution (HR) imaging. However, achieving color FPM typically requires capturing images separately for each of the red, green, and blue channels for reconstruction, resulting in a significant increase in the time cost. Existing improvement strategies require long coloring times, and have difficulty ensuring standardization between the reconstructed and original image colors owing to the influence of optical system stability and algorithm errors. In this study, a fast-color FPM imaging technology with fusion color correction (CCFPM) is proposed. It achieves high-precision color FPM imaging by separately capturing single low-resolution images for the red and blue channels, which are used to color the reconstructed green-channel HR grayscale image. The reconstructed HR color image is then processed using a color correction algorithm. Simulation and experimental analyses demonstrate that this method compresses the coloring algorithm's computation time to less than 1 s, reducing both the acquisition and reconstruction times by 66.7 % compared with the traditional R + G + B channel approach, achieving a significant improvement in speed. Meanwhile, it also achieves a breakthrough in algorithm speed compared with other fast color FPM solutions, compressing the coloring time to a few hundredths or even a few thousandths of the existing algorithms, and ensures the accuracy of the reconstructed image, reducing the RMSE by 50 % compared with the existing algorithms. Regarding color consistency, CCFPM can mitigate the chromatic aberration caused by fluctuations in optical system stability, maintaining consistency between the reconstructed and original image colors, thus achieving standardization of image color appearance. Therefore, the proposed method is promising for further advancements in the application of FPM in digital pathology.

optics
Concept, implementations and applications of Fourier ptychography

Guoan Zheng,Cheng Shen,Shaowei Jiang,Pengming Song,Changhuei Yang

DOI: https://doi.org/10.1038/s42254-021-00280-y

IF: 36.273

2021-02-10

Nature Reviews Physics

Abstract:The competition between resolution and the imaging field of view is a long-standing problem in traditional imaging systems — they can produce either an image of a small area with fine details or an image of a large area with coarse details. Fourier ptychography (FP) is an approach for tackling this intrinsic trade-off in imaging systems. It takes the challenge of high-throughput and high-resolution imaging from the domain of improving the physical limitations of optics to the domain of computation. It also enables post-measurement computational correction of optical aberrations. We present the basic concept of FP, compare it to related imaging modalities and then discuss experimental implementations, such as aperture-scanning FP, macroscopic camera-scanning FP, reflection mode, single-shot set-up, X-ray FP, speckle-scanning scheme and deep-learning-related implementations. Various applications of FP are discussed, including quantitative phase imaging in 2D and 3D, digital pathology, high-throughput cytometry, aberration metrology, long-range imaging and coherent X-ray nanoscopy. A collection of datasets and reconstruction codes is provided for readers interested in implementing FP themselves. Fourier ptychography is an imaging approach that addresses the intrinsic trade-off between resolution and field of view in optical systems and provides computational correction of optical aberrations. This Technical Review surveys its implementations and applications.

physics, applied, multidisciplinary
Virtual brightfield and fluorescence staining for Fourier ptychography via unsupervised deep learning

Ruihai Wang,Pengming Song,Shaowei Jiang,Chenggang Yan,Jiakai Zhu,Chengfei Guo,Zichao Bian,Tianbo Wang,Guoan Zheng

DOI: https://doi.org/10.1364/OL.400244

2020-08-16

Abstract:Fourier ptychographic microscopy (FPM) is a computational approach geared towards creating high-resolution and large field-of-view images without mechanical scanning. To acquire color images of histology slides, it often requires sequential acquisitions with red, green, and blue illuminations. The color reconstructions often suffer from coherent artifacts that are not presented in regular incoherent microscopy images. As a result, it remains a challenge to employ FPM for digital pathology applications, where resolution and color accuracy are of critical importance. Here we report a deep learning approach for performing unsupervised image-to-image translation of FPM reconstructions. A cycle-consistent adversarial network with multiscale structure similarity loss is trained to perform virtual brightfield and fluorescence staining of the recovered FPM images. In the training stage, we feed the network with two sets of unpaired images: 1) monochromatic FPM recovery, and 2) color or fluorescence images captured using a regular microscope. In the inference stage, the network takes the FPM input and outputs a virtually stained image with reduced coherent artifacts and improved image quality. We test the approach on various samples with different staining protocols. High-quality color and fluorescence reconstructions validate its effectiveness.

Image and Video Processing,Medical Physics

Delayed diagnosis of malignant tumors missed at laparoscopic cholecystectomy

Effect of spatial spectrum overlap on fourier ptychographic microscopy

Digital micromirror device-based laser-illumination Fourier ptychographic microscopy.

Surface wave illumination Fourier ptychographic microscopy.

Wavefront Modulation with Spatial Light Modulator for Fourier Ptychographic Microscopy

High-speed Fourier Ptychographic Microscopy for Quantitative Phase Imaging.

Fourier Ptychography for High Space-Bandwidth Product Microscopy

Tunable-illumination for Laser Fourier Ptychographic Microscopy Based on a Background Noise-Reducing System

Fourier Ptychographic Microscopy 10 Years on: A Review

Phase-coded Speckle Illumination for Laser Fourier Ptychographic Microscopy

High-Resolution Dmd-Fpm System Based On Ring Pattern Phase Retrieval Algorithm

High-throughput fast full-color digital pathology based on Fourier ptychographic microscopy via color transfer

FPM-WSI: Fourier ptychographic whole slide imaging via feature-domain backdiffraction

Fast color Fourier ptychographic microscopy based on spatial filtering frequency fusion

Single full-FOV reconstruction Fourier ptychographic microscopy

A Fast Fourier Ptychographic Microscope Method with Biomedical Application

Fourier ptychographic microscopy with sparse representation

Analysis of Fourier ptychographic microscopy with half of the captured images

Fast color fourier Ptychographic microscopic imaging technology with fusion color correction

Concept, implementations and applications of Fourier ptychography

Virtual brightfield and fluorescence staining for Fourier ptychography via unsupervised deep learning