A Superresolution Algorithm of Millimeter Wave Focal Plane Array Image

Y Zhang,XG Li

DOI: https://doi.org/10.3321/j.issn:1001-9014.1998.04.010

1998-01-01

Abstract:A new algorithm was presented, which can improve millimeter wave image resolution by directly altering the eigenvalues of the point spread function matrix, The results of computer simulation and actual image processing show good effect of the algorithm.

What problem does this paper attempt to address?

Spatial-frequency-shift Enables Integrated Super-Resolution Microscopy: Advance and Perspective

Chenlei Pang,Xiaowei Liu,Mingwei Tang,Qing Yang,Xu Liu

DOI: https://doi.org/10.1016/j.scib.2022.04.017

IF: 18.9

2022-01-01

Science Bulletin

Abstract:The invention of the optical microscope is significant to the development of many aspects of science and technology,including novel materials,life sciences and medicine,for its superiorities in resolving fine structures.But,restrained by the Abbe diffraction limit,the best-resolving capability that can be obtained by conven-tional linear optical microscopy is～200 nm laterally and～500 nm axially using an objective lens(numerical aperture=1.4)at 550 nm wavelength.Over the past decades,to break the resolution limit and meet the increasing demand for super-resolution ability,numerous attempts were made,and fruitful developments emerged[1-8].Among all the approaches,one significant class is based on the integrated spatial frequency engineering to extend the collectable spatial frequency region via spatial frequency shift(SFS)method[3-13].Through the combination of SFS with spe-cially designed photonic chips,highly sophisticated optical sys-tems in traditional super-resolution instruments are moved out.
Far-Field Superresolution Imaging via Spatial Frequency Modulation

Mingwei Tang,Xiaowei Liu,Zhong Wen,Feihong Lin,Chao Meng,Xu Liu,Yaoguang Ma,Qing Yang

DOI: https://doi.org/10.1002/lpor.201900011

2020-01-01

LASER & PHOTONICS REVIEWS

Abstract:The diffraction limit substantially impedes the resolution of the conventional optical microscope. Under traditional illumination, the high-spatial-frequency light corresponding to the subwavelength information of objects is located in the near-field in the form of evanescent waves, and thus not detectable by conventional far-field objectives. Recent advances in nanomaterials and metamaterials provide new approaches to break this limitation by utilizing large-wavevector evanescent waves. Here, a comprehensive review of this emerging and fast-growing field is presented. The current superresolution imaging techniques based on evanescent-wave-assisted spatial frequency modulation, including hyperlens, microsphere lens, and evanescent field-illuminated spatial frequency shift microscopy, are illustrated. They are promising in investigating unobserved details and processes in fields such as medicine, biology, and material research. Some current challenges and future possibilities of these superresolution methods are also discussed.
Far‐Field Superresolution Imaging Via Spatial Frequency Modulation

Mingwei Tang,Xiaowei Liu,Wen Zhong,Feihong Lin,Chao Meng,Xu Liu,Yaoguang Ma,Qing Yang

DOI: https://doi.org/10.1002/lpor.201900011

2020-01-01

LASER & PHOTONICS REVIEWS

Abstract:The diffraction limit substantially impedes the resolution of the conventional optical microscope. Under traditional illumination, the high‐spatial‐frequency light corresponding to the subwavelength information of objects is located in the near‐field in the form of evanescent waves, and thus not detectable by conventional far‐field objectives. Recent advances in nanomaterials and metamaterials provide new approaches to break this limitation by utilizing large‐wavevector evanescent waves. Here, a comprehensive review of this emerging and fast‐growing field is presented. The current superresolution imaging techniques based on evanescent‐wave‐assisted spatial frequency modulation, including hyperlens, microsphere lens, and evanescent field‐illuminated spatial frequency shift microscopy, are illustrated. They are promising in investigating unobserved details and processes in fields such as medicine, biology, and material research. Some current challenges and future possibilities of these superresolution methods are also discussed.
Simple Fringe Illumination Technique for Optical Superresolution

Anwar Hussain,Tariq Amin,Cuifang Kuang,Liangcai Cao,Xu Liu

DOI: https://doi.org/10.1364/josab.34.000b78

2017-01-01

Abstract:The simple and precise fringe-illumination technique has been implemented to retrieve the missing information of a two-dimensional object. The object placed in a 4f optical system is illuminated with fringes, generated by a reflective-mode spatial light modulator. A set of three fringes, shifted in phase, sequentially illuminate the object, and correspondingly, three images are captured through CCD. The fringes illuminate the object and higher spatial frequencies primarily fall outside the aperture along horizontal direction heterodyne into the passband. To heterodyne higher spatial frequencies in a vertical direction, the fringes are swapped by 90 deg, and three further images are captured through CCD. These recorded images are processed to retrieve the object information using the spectrum-domain image-processing algorithm. The final image is higher in resolution compared to the band-limited image. For validity of technique, the theoretical concept was simulated and supported through experimental results. The presented system is stable against environmental factors due to on-axis geometry. (C) 2017 Optical Society of America
Progress of Point-Wise Scanning Superresolution Methods

Zhao Guang-Yuan,Zheng Cheng,Fang Yue,Kuang Cui-Fang,Liu Xu

DOI: https://doi.org/10.7498/aps.66.148702

IF: 0.906

2017-01-01

Acta Physica Sinica

Abstract:Optical microscope has been giving impetus to the development of modern technology. As the advancement of these techniques, high resolution microscopy becomes crucial in biological and material researches. However, the diffraction limit restricts the resolution of conventional microscopy. In 1968, confocal microscopy, the first pointwise scanning superresolution method, appeared. It improves the imaging resolution, enhances the contrast, and thus breaks through the diffraction limit. Since then many superresolution methods have come into being, among which the pointwise scanning superresolution method earns reputation for its high imaging resolution and contrast. The stimulated emission depletion microscopy becomes the most prominent method with an achievable resolution of about 2.4 nm and then widely used. Besides, the newly developed fluorescence emission difference microscopy (FED) and the saturated absorption competition microscopy (SAC) have their advantages of non-constraint on fluorescent dyes, low saturated beam power, simplified optical setups, while they achieve a resolution of lower than /6. Further explorations of FED will be keen on vivo biological observations by using it, while that of SAC can concentrate on enhancing the resolution on a nanoscale and reducing the signal-to-noise ratio. In addition, the Airyscan technique in which a detector array is used for image acquisition, can serve as a complementary tool to further enhance the imaging quality of pointwise scanning superresolution method. The detector-array enables both the narrowed size of pinhole and the increasing of the acquired signal intensity by 1.84 folds. The other methods, e.g. superoscillation lens and high-index resolution enhancement by scattering, have the potentialities to obtain superresolved image in material science or deep tissues. After being developed in the past three decades, the superresolution methods now encounter a new bottleneck. Further improvement of the current methods is aimed at imaging depth, and being used more practically and diversely. In this review, we detailedly describe the above pointwise scanning superresolution methods, and explain their principles and techniques. In addition, the deficiencies and potentialities of these methods are presented in this review. Finally, we compare the existing methods and envision the next generation of the pointwise scanning superresolution methods.
Grads Parse Algorithm for Enhancing CCD Resolution

LIU Yi-peng,FENG Hua-jun,XU Zhi-hai,WANG Ling,CHEN Yue-ting

DOI: https://doi.org/10.3969/j.issn.1003-501x.2005.07.022

2005-01-01

Abstract:High resolution imaging technology based on image reconstruction from image series is an effective approach to improve the resolution of digital imaging system. The acquisition of image series with displacements among each other and the reconstruction algorithm are two cores of high resolution image reconstruction. In the paper, a new image acquisition equipment which uses PZT (Piezoelectric Translator) to control the movement of CCD and a new algorithm named grads parse algorithm for image reconstruction are proposed. Based on the theory of grads, along with the consideration of high frequency, this algorithm enhances the resolution of the reconstructed image. Simulation results prove that the algorithm is over 40 percent more effective than the old ones.
Fast Image Super-Resolution for a Dual-Resolution Camera

Kuo Chen,Yueting Chen,Huajun Feng,Zhihai Xu

DOI: https://doi.org/10.1007/s10043-015-0077-6

2022-01-01

Abstract:High-spatial resolution and wide field of view (FOV) can be satisfied simultaneously with a dual-sensor camera. A special kind of dual-sensor camera named dual-resolution camera has been designed and manufactured; therefore, a high-resolution image with narrow FOV and another low-resolution image with wide FOV are captured by one shot. To generate a high-resolution image with wide FOV, a fast super-resolution reconstruction is proposed, which is composed of wavelet-based super-resolution and back projection. During wavelet-based super-solution, the high-resolution image captured is used to learn the co-occurrence prior by a linear regression function. At last, low-resolution image is reconstructed based on the learnt co-occurrence prior. Simulation and real experiments are carried out, and three other common super-resolution algorithms are compared. The experimental results show that the proposed method reduces time cost significantly, and achieves excellent performance with high PSNR and SSIM.
Shift-photography-assisted Image Super-Resolution for Optical Zooming System Based on Alvarez Lenses

Jiapu Yan,Menghao Li,Jingwen Zhou,Zheng Ren,Huajun Feng,Zhihai Xu,Qi Li,Yueting Chen

DOI: https://doi.org/10.1016/j.optcom.2024.130921

IF: 2.4

2024-01-01

Optics Communications

Abstract:The optical zooming system based on Alvarez lenses (OZA) exhibits shortcomings in terms of zooming magnification and imaging quality. To address this, we propose a generic method utilizing an image super- resolution algorithm based on shift-photography to enhance the zoom ratio of OZA without altering the optical design. Shift-photography can mitigate optical aberrations across different fields of view, resulting in clearer local textures. With the assistance of multiple image inputs, our network model achieves reliable super- resolution results. Extensive experiments demonstrate that our image reconstruction performance surpasses existing methods, which can help the OZA system achieve a higher zoom ratio or reduce the number of required freeform lenses. An example is presented where a 4.17x x OZA without specifically optimized freeform surfaces achieves image restoration and 4x x super-resolution through the proposed method at the telephoto end, resulting in a total magnification ratio exceeding 16x. x .
A Super-Resolution Method with EWA

Jiang ZhongDing,Lin Hai,Bao HuJun,Ma LiZhuang

DOI: https://doi.org/10.1007/bf02945472

2003-01-01

Abstract:This paper introduces a practical algorithm for super-resolution, the process of reconstructing a high-resolution image from low-resolution input ones. The emphasis of the work is to super-resolve frames from real-world image/video sequences which may contain significant object occlusion or scene changes. As the quality of super-resolved images highly relies on the correctness of image alignment between consecutive frames, the robust optical flow method is used to accurately estimate motion between the image pair. An efficient and reliable scheme is devised to detect and discard incorrect matchings which may degrade the output quality. The usage of elliptical weighted average (EWA) filter is also introduced to model the point spread function (PSF) of acquisition system in order to improve accuracy of the model. A number of complex video sequences are tested to demonstrate the applicability and reliability of the proposed algorithm.
Towards Super-Resolution Microwave Imaging: General Framework

Lianlin Li,Xin Xu,Fang Li

DOI: https://doi.org/10.1109/isape.2012.6409015

2012-01-01

Abstract:Over past decades, there are growing intensive interests of achieving imaging resolution beyond that mainly constrained to system bandwidth, for example, the so-called Rayleigh diffraction limit. Three directions of research aiming to beat this limit are strongly advocated, i.e., (1) to exploit the evanescent components capturing the subtle details of the electromagnetic field at the immediate proximity of the object to be probed; (2) to develop the imaging algorithm of treating the specific type of imaged object, namely, the sparse object; (3) to design the precise instrument dedicated to create constructive subtle inference. This paper proposed a general framework of super-resolution imaging algorithm, which has the advantages that (a) of highly efficient and can be used for real-time imaging, (b) the sub-wavelength reconstruction, roughly, the resolution can be improved to be the factor of three times compared with the traditional imaging approaches. The key ingredient of proposed methodology is to construct an off-line filter, whose basic function is to produce so-called super-oscillation waves, leading to a sub-wavelength focus of prescribed size and shape in a field of view. Numerical and experimental results have demonstrated the state-of-art performance of the proposed approach, and open a new promising door to real-time super-resolution imaging, regarding computational complexity and imaging resolution.
Far-Field Super-Resolution Imaging Using Near-Field Illumination by Micro-Fiber

Xiang Hao,Xu Liu,Cuifang Kuang,Yanghui Li,Yulong Ku,Haijun Zhang,Haifeng Li,Limin Tong

DOI: https://doi.org/10.1063/1.4773572

IF: 4

2013-01-01

Applied Physics Letters

Abstract:We propose an approach that uses a conventional optical microscope to achieve optical super-resolution. This approach will provide a direct, non-invasive, and far-field access in the observation of both metallic and non-metallic objects with a spatial resolution of tens-of-nanometres, achieved in a single snap shot. This method, combines near-field illumination by the micro-fiber and a passive spatial frequency shift by the sample itself, offering a promising approach to surface tomography imaging without localized field enhancement by surface plasmon polaritons. Our results present the potential of breaking the diffractive barrier using a conventional wide-field optical microscope within the visible spectrum.
Pixel Super Resolution Imaging Technology Based on Phase Wavefront Modulation

Xu Yang,Yimeng Zhong,Jiaming Xu,Bowen Wang,Chao Zuo

DOI: https://doi.org/10.1117/12.3018229

2024-01-01

Abstract:In the field of aperture coding super-resolution imaging, an important reason limiting the image super-resolution effect is that aperture coding greatly reduces the incident light flux of the system. Phase wavefront encoding modulation technology can effectively increase the system light flux and improve image super-resolution results. However, using phase wavefront coding instead of aperture coding will cause complex frequency domain calculations. In this paper, the feasibility of the single-seam phase encoding pattern is proved through the mathematical calculation of phase wavefront coding modulation. In the subsequent reconstruction process, the Fourier ptychographic (FP) imaging algorithm is used for verification. The resolvable line pairs of the USAF are increased from Group0 Number2 to Group1 Number3, means the image resolution is approximately doubled. The optical system built based on this phase mask prove the luminous flux of the acquired down-sampled image is increased about more than 5 times, and the image signal-to-noise ratio (SNR) is increased about more than 7 times. This makes it possible for higher super-resolution computational imaging.
Super-Resolution Imaging Enhancement through a 2D Scanning Galvanometer: Algorithm Formulation and Application in Aerial Optoelectronic Systems

Tianxiang Ma,Chao Liang,Yuting Han,Fang Yuan,Lingtong Meng,Yongsen Xu,Honghai Shen,Yunqing Liu

DOI: https://doi.org/10.3390/photonics10111203

IF: 2.536

2023-10-27

Photonics

Abstract:As the fields of aviation and aerospace optics continue to evolve, there is an increasing demand for enhanced detection capabilities in equipment. Nonetheless, in applications where both optical and mechanical constraints are stringent, the continuous expansion of optical aperture and focal length is impractical. Given the existing technological landscape, employing super-resolution algorithms to enhance the imaging capability of optical systems is both practical and highly relevant. This study capitalizes on using a 2D scanning galvanometer in optical systems to acquire micro-displacement information. Initially, an imaging model for optical systems equipped with a 2D scanning galvanometer was established, and the displacement vectors for both forward and sweep image motions were defined. On this foundation, we incorporated micro-displacement information that can induce high-frequency aliasing. Subsequently, the motion paths of the galvanometer were planned and modeled. To align image sequences with micro-displacement correlations, the Lucas–Kanade (L-K) optical flow method was employed with multi-layer pyramid iteration. Then, super-resolution reconstruction was performed using kernel regression techniques. Ultimately, we tested the algorithm on an aeronautical optoelectronic pod to evaluate its impact on optical resolution and imaging quality. Compared with the original images, the 16-frame image demonstrated a 39% improvement in optical resolution under laboratory conditions. Moreover, the algorithm exhibited satisfactory performance under both nighttime and daytime conditions, as well as during aerial tests.

optics
Super-Resolution Imaging via Angular Magnification

Yi Zhou,Dingpeng Liao,Kun Zhang,Zijie Ma,Shikai Wu,Jun Ma,Xuemei Dai,Zhengguo Shang,Zhongquan Wen,Gang Chen

2023-05-17

Abstract:The far-field resolution of optical imaging systems is restricted by the Abbe diffraction limit, a direct result of the wave nature of light. One successful technological approach to circumventing this limit is to reduce the effective size of a point-spread-function. In the past decades, great endeavors have been made to engineer an effective point-spread-function by exploiting different mechanisms, including optical nonlinearities and structured light illumination. However, these methods are hard to be applied to objects in a far distance. Here, we propose a new way to achieve super-resolution in a far field by utilizing angular magnification. We present the first proof-of-concept demonstration of such an idea and demonstrate a new class of lenses with angular magnification for far-field super-resolution imaging. Both theoretical and experimental results demonstrate a more than two-fold enhancement beyond the angular-resolution limit in the far-field imaging. The proposed approach can be applied to super-resolution imaging of objects in far distance. It has promising potential applications in super-resolution telescopes and remote sensing.

Optics
Super-Resolution Image Reconstruction of Wavefront Coding Imaging System Based on Deep Learning Network

Xueyan Li,Haowen Yu,Yijian Wu,Lieshan Zhang,Di Chang,Xuhong Chu,Haoyuan Du

DOI: https://doi.org/10.3390/electronics13142781

IF: 2.9

2024-07-16

Electronics

Abstract:Wavefront Coding (WFC) is an innovative technique aimed at extending the depth of focus (DOF) of optics imaging systems. In digital imaging systems, super-resolution digital reconstruction close to the diffraction limit of optical systems has always been a hot research topic. With the design of a point spread function (PSF) generated by a suitably phase mask, WFC could also be used in super-resolution image reconstruction. In this paper, we use a deep learning network combined with WFC as a general framework for images reconstruction, and verify its possibility and effectiveness. Considering the blur and additive noise simultaneously, we proposed three super-resolution image reconstruction procedures utilizing convolutional neural networks (CNN) based on mean square error (MSE) loss, conditional Generative Adversarial Networks (CGAN), and Swin Transformer Networks (SwinIR) based on mean absolute error (MAE) loss. We verified their effectiveness by simulation experiments. A comparison of experimental results shows that the SwinIR deep residual network structure based on MAE loss optimization criteria can generate more realistic super-resolution images with more details. In addition, we used a WFC camera to obtain a resolution test target and real scene images for experiments. Using the resolution test target, we demonstrated that the spatial resolution could be improved from 55.6 lp/mm to 124 lp/mm by the proposed super-resolution reconstruction procedure. The reconstruction results show that the proposed deep learning network model is superior to the traditional method in reconstructing high-frequency details and effectively suppressing noise, with the resolution approaching the diffraction limit.

engineering, electrical & electronic,computer science, information systems,physics, applied
Superresolution by Micro-Zooming Technique

HT Zhang,ML Gong,DZ Zhao,P Yan,RZ Cui,WP Jia

DOI: https://doi.org/10.7498/aps.50.1486

IF: 0.906

2001-01-01

Acta Physica Sinica

Abstract:In opto-electronic imaging systems, aliasing will occur when sampling a scene containing spatial frequencies exceeding one half of the sampling frequency. A novel superresolution technique, micro-zooming, is proposed, which can reduce aliasing and improve the resolution of the imaging systems through a series of aliased frames with different optical magnifications'. Both computer simulations and experimental results are presented to verify the effectiveness and simplicity of micro-zooming technique for obtaining superresolution.
A new method of super-resolution reconstruction based on wavelet and subpixel interpolation

Senhua Wang,Zhang Li,Xiangzhong Li,Yongqin Yang

DOI: https://doi.org/10.1109/iccwamtip.2014.7073391

2014-12-01

Abstract:Image super-resolution reconstruction was an important task in the field of image enhancement and image restoration. In this paper, a new super-resolution reconstruction method which based on wavelet analysis and sub-pixel interpolation was proposed by using wavelet edge detection and polynomial subdivision location. The simulation results showed that the boundary of reconstructed high-resolution image is clear and natural, and the subjective judgment and objective evaluation is better than traditional reconstruction algorithm. The algorithm in this paper achieves good effects and reaches good feasibility and validity.
Interpolation-based Image Super-Resolution Using Multisurface Fitting.

Fei Zhou,Wenming Yang,Qingmin Liao

DOI: https://doi.org/10.1109/tip.2012.2189576

IF: 10.6

2012-01-01

IEEE Transactions on Image Processing

Abstract:In this paper, we propose a new interpolation-based method of image super-resolution reconstruction. The idea is using multisurface fitting to take full advantage of spatial structure information. Each site of low-resolution pixels is fitted with one surface, and the final estimation is made by fusing the multisampling values on these surfaces in the maximum a posteriori fashion. With this method, the reconstructed high-resolution images preserve image details effectively without any hypothesis on image prior. Furthermore, we extend our method to a more general noise model. Experimental results on the simulated and real-world data show the superiority of the proposed method in both quantitative and visual comparisons.
Real-Time 3d Image Fusion Based on Wavelet Transform in Microscope Auto-Focusing System

Xu Liqun,Ye Zi,Yan Xinxin,Yu Feihong

DOI: https://doi.org/10.1117/12.755721

2007-01-01

Abstract:With the limitation of the depth of focus in microscope, especially in high-power objectives, different areas in the field of view have different focal planes and therefore only sharp focused images in a small part of the view can be obtained. A three-dimension micro-image fusion algorithm is introduced based on wavelet transform (WT) in microscope auto-focusing system. The step motor is driven continuously moving across the vicinity of the focal plane to obtain the micro image information of the relevant position. With real-time multi-focused images acquired and saved, the image fusion algorithm is applied to finally get a complete and sharp three-dimension image. This can be used to extend the depth of focus in microscope and in three-dimension reconstruction in biologic slice, rock specimen, and so on. The particularity brought by the image fusion of a real-time system is mainly studied as well as the algorithm based on this condition. Here we emphasize the multi-focus fusion algorithm based on WT. Images acquired from the digital camera are transformed from spatial domain to wavelet domain. All the details from different images are extracted and processed from the wavelet coefficients and then are recombined to form the new coefficient of the resulting image. By taking an inverse WT, we finally get the final three-dimension image. This system has two main advantages: real-time processing and accurate fusion result.
Super-resolution Technique of Microzooming in Electro-Optical Imaging Systems

HT Zhang,ML Gong,DZ Zhao,P Yan,RZ Cui,WP Jia

DOI: https://doi.org/10.1080/09500340110095102

IF: 1.3

2001-01-01

Journal of Modern Optics

Abstract:The main resolution limit for an electro-optical imaging system comprising a focal plane array (FPA) sensor obeys Nyquist theorem which states that an object must be sampled at more than twice the cut-off frequency to avoid aliasing. A novel super-resolution technique, microzooming (MZ), is presented. MZ provides electro-optical imagery with an extended unaliased bandwidth using multiple aliased images at different optical magnifications. A number of simulation and experiment results demonstrate that MZ is a practical advance for reducing aliasing and enhancing resolution as well as helping to suppress white noise.

A Superresolution Algorithm of Millimeter Wave Focal Plane Array Image

Spatial-frequency-shift Enables Integrated Super-Resolution Microscopy: Advance and Perspective

Far-Field Superresolution Imaging via Spatial Frequency Modulation

Far‐Field Superresolution Imaging Via Spatial Frequency Modulation

Simple Fringe Illumination Technique for Optical Superresolution

Progress of Point-Wise Scanning Superresolution Methods

Grads Parse Algorithm for Enhancing CCD Resolution

Fast Image Super-Resolution for a Dual-Resolution Camera

Shift-photography-assisted Image Super-Resolution for Optical Zooming System Based on Alvarez Lenses

A Super-Resolution Method with EWA

Towards Super-Resolution Microwave Imaging: General Framework

Far-Field Super-Resolution Imaging Using Near-Field Illumination by Micro-Fiber

Pixel Super Resolution Imaging Technology Based on Phase Wavefront Modulation

Super-Resolution Imaging Enhancement through a 2D Scanning Galvanometer: Algorithm Formulation and Application in Aerial Optoelectronic Systems

Super-Resolution Imaging via Angular Magnification

Super-Resolution Image Reconstruction of Wavefront Coding Imaging System Based on Deep Learning Network

Superresolution by Micro-Zooming Technique

A new method of super-resolution reconstruction based on wavelet and subpixel interpolation

Interpolation-based Image Super-Resolution Using Multisurface Fitting.

Real-Time 3d Image Fusion Based on Wavelet Transform in Microscope Auto-Focusing System

Super-resolution Technique of Microzooming in Electro-Optical Imaging Systems