Multiple-view 3D digital image correlation based on pseudo-overlapped imaging

Zhenning Chen,Xiaowen Li,Hao Li

DOI: https://doi.org/10.1364/ol.529123

IF: 3.6

2024-06-26

Optics Letters

Abstract:Zhenning Chen, Xiaowen Li, Hao Li The restriction of the field of view (FOV) enlargement and spatial resolution increase during optical monitoring was investigated. ... [Opt. Lett. 49, 3733-3736 (2024)]

optics

What problem does this paper attempt to address?

A Three-Dimensional Measurement Method for Binocular Endoscopes Based on Deep Learning

Yu Hao,Zhou Changjiang,Zhang Wei,Wang Liqiang,Yang Qing,Yuan Bo

DOI: https://doi.org/10.1631/fitee.2000679

2022-01-01

Abstract:In the practice of clinical endoscopy, the precise estimation of the lesion size is quite significant for diagnosis. In this paper, we propose a three-dimensional (3D) measurement method for binocular endoscopes based on deep learning, which can overcome the poor robustness of the traditional binocular matching algorithm in texture-less areas. A simulated binocular image dataset is created from the target 3D data obtained by a 3D scanner and the binocular camera is simulated by 3D rendering software to train a disparity estimation model for 3D measurement. The experimental results demonstrate that, compared with the traditional binocular matching algorithm, the proposed method improves the accuracy and disparity map generation speed by 48.9% and 90.5%, respectively. This can provide more accurate and reliable lesion size and improve the efficiency of endoscopic diagnosis.
Multi-image-distance Imaging System for Extending Depth-of-field

Jixiang Tang,Xuanyin Wang,Huan Zhou,Jiayu Ji,Zhengxiao Li,Zijian Ye

DOI: https://doi.org/10.1016/j.ijleo.2023.170965

IF: 3.1

2023-01-01

Optik

Abstract:Depth of field (DoF) defines the longitudinal range of objects in sharp focus. Imaging systems for machine vision are generally limited to a small DoF by various conditions, constraining the visual inspection of objects with large depth. In this paper, we develop a multi-image-distance imaging system, which can extend the DoF by capturing multi-focus images for fusion. A three-way beam-splitter prism is designed to support independent imaging of three image sensors. Through adjusting the sensors to different back focal lengths, multiple images focusing at different depths are captured in a single exposure. Finally, the focused regions of each image are fused for extending the DoF. Analyses of the proposed DoF extension strategy illustrate excellent enhancement more than three times. Moreover, we introduce a DoF measurement method based on the estimation of the point spread function, and measurement experiments are conducted using the fabricated prototype. Imaging experiments for various scenes demonstrate great imaging quality and DoF extension performance. The proposed multi-image-distance imaging system provides an effective and practical DoF extension solution for close-range visual inspection.
Ultra-deep three-dimensional optical coherence tomography in turbid media

Zhihua Ding,Lu Yang,Tao Han,Yun Tang,Changyong Chen,Cui Ma,Zhiyi Liu

DOI: https://doi.org/10.21203/rs.3.rs-4231224/v1

2024-01-01

Abstract:Abstract Ultra-deep three-dimensional (3D) optical coherence tomography (OCT) in turbid media is reported. Parallel detection along depth combined with scanning detection across lateral field is exploited in a swept-source OCT system to obtain the depth-resolved reflection matrices. Scanning detection enables the use of a highspeed swept source and a matched detector providing the required depth range for ultra-deep imaging. Disturbances intrinsic to scanning detection are compensated with negligible intra-frame phase variations to ensure satisfactory reconstruction by the inter-frame phase insensitive algorithm. 3D OCT imaging with an ultra-deep imaging depth of 11.5 times the scattering mean-free-path and a triple extension of the imaging depth achieved by a conventional SS-OCT is realized. The measurement time for 3D imaging (125μm×125μm×4mm ) is ~5 min, a significant leap over the time-domain matrix OCT where 6 min is taken for only one specified depth.
Monocentric Imaging System with Wide Field of View and High Resolution for Distant View Observation

Siqi Liu,Shengqian Chang,Siman Zhang,Ting Xie,Peng Sun,Huaye Li,Zhenrong Zheng

DOI: https://doi.org/10.1016/j.ijleo.2017.09.106

IF: 3.1

2018-01-01

Optik

Abstract:An imaging system with wide field of view (FOV) and high resolution is proposed in this paper. The optical design employed monocentric objective lens design combined with the unique arrangement of multi-aperture array, which empowers the system of good tradeoff between imaging performances and structural complexity. A prototype is built based on the design, achieving the field angle of 55° as well as the angular resolution of 40μrad. Experiments show excellent performances in distant view observation and images with 0.1 gigapixels can be finally obtained after image mosaicing, in addition, the proposed system has potential applications in airborne ground observation and crops survey in the future.
Joint Focusing Method Based on Optimal Image-Distance Interval for Multi-Image-distance Imaging System

Zhenguo Wu,Jixiang Tang,Xuanyin Wang,Kexin Wang

DOI: https://doi.org/10.1016/j.optcom.2024.130435

IF: 2.4

2024-01-01

Optics Communications

Abstract:The multi-image-distance imaging system captures multiple images simultaneously with different focused depths, and uses image fusion to obtain an all-in-focus image for extending the depth of field (DoF). However, an image-distance adjustment strategy that takes into account the optimal DoF extension capability and imaging quality remains to be explored. In this paper, we propose a joint focusing method based on the optimal image-distance interval between the three sensors. First, we propose multi-sensor image-distance adjustment control strategies for different scenes. Then, theoretical analyses and calibration experiments of the optimal image-distance interval are conducted for continuous depth scenes. In order to quantitatively evaluate the DoF extension performance of the imaging system, a DoF estimation method based on point spread function measurement is proposed. Additionally, an evaluation metrics for extended DoF imaging based on the range and continuity of DoF is presented. We have developed a multi-image-distance electric focusing imaging system. Imaging experiments are conducted in various scenes to verify the effectiveness of the joint focusing method. The joint focusing method, based on the optimal image-distance interval, provides an image-distance adjustment strategy to achieve high-quality extended DoF imaging for multi-image-distance imaging systems.
Focal plane coincidence method for a multi-view telecentric 3D imaging system

Dezhao Wang,Weihu Zhou,Zili Zhang,Fanchang Meng,Chao Gao

DOI: https://doi.org/10.1364/ol.516093

IF: 3.6

2024-02-10

Optics Letters

Abstract:Dezhao Wang, Weihu Zhou, Zili Zhang, Fanchang Meng, Chao Gao Multi-view microscopic fringe projection systems, which use high-resolution telecentric lenses and the Scheimpflug condition, face ... [Opt. Lett. 49, 919-922 (2024)]

optics
Increasing a microscope's effective field of view via overlapped imaging and machine learning

Xing Yao,Vinayak Pathak,Haoran Xi,Amey Chaware,Colin Cooke,Kanghyun Kim,Shiqi Xu,Yuting Li,Timothy Dunn,Pavan Chandra Konda,Kevin C. Zhou,Roarke Horstmeyer

DOI: https://doi.org/10.1364/OE.445001

IF: 3.8

2022-01-07

Optics Express

Abstract:Xing Yao, Vinayak Pathak, Haoran Xi, Amey Chaware, Colin Cooke, Kanghyun Kim, Shiqi Xu, Yuting Li, Timothy Dunn, Pavan Chandra Konda, Kevin C. Zhou, Roarke Horstmeyer This work demonstrates a multi-lens microscopic imaging system that overlaps multiple independent fields of view on a single sensor for ... [Opt. Express 30, 1745-1761 (2022)]

optics
Research of real-time wide field image merging based on multi-cameras

Tao Xu,Zhaofeng Cen,Xiaotong Li

DOI: https://doi.org/10.1117/12.834455

2009-01-01

Abstract:Wide field images have been widely applied in Visual reality, video compression, transmission and medical apparatus. The image is usually obtained by using single wide-angle lens such as the fisheye lens or by merging the images scanned with conventional cameras. The paper proposed a system by placing two cameras at a fixed distance between each other so the large-scale field of view can be split into small parts and images are obtained synchronously. Because each adjacent camera has been located fixedly, the corresponding field range of each image is known easily, and a stitching algorithm based on correlation coefficient of corresponding pixel lists is used to merge the images. As shown by the experiments, the system proposed in this paper is simple and effective for obtaining wide field image with both high real-time quality and image resolution. © 2009 SPIE.
Success Probability in Multi-View Imaging

Vadim Holodovsky,Masada Tzabari,Yoav Schechner,Alex Frid,Klaus Schilling

2024-07-15

Abstract:Platforms such as robots, security cameras, drones and satellites are used in multi-view imaging for three-dimensional (3D) recovery by stereoscopy or tomography. Each camera in the setup has a field of view (FOV). Multi-view analysis requires overlap of the FOVs of all cameras, or a significant subset of them. However, the success of such methods is not guaranteed, because the FOVs may not sufficiently overlap. The reason is that pointing of a camera from a mount or platform has some randomness (noise), due to imprecise platform control, typical to mechanical systems, and particularly moving systems such as satellites. So, success is probabilistic. This paper creates a framework to analyze this aspect. This is critical for setting limitations on the capabilities of imaging systems, such as resolution (pixel footprint), FOV, the size of domains that can be captured, and efficiency. The framework uses the fact that imprecise pointing can be mitigated by self-calibration - provided that there is sufficient overlap between pairs of views and sufficient visual similarity of views. We show an example considering the design of a formation of nanosatellites that seek 3D reconstruction of clouds.

Computer Vision and Pattern Recognition
RIS-aided Single-frequency 3D Imaging by Exploiting Multi-view Image Correlations

Yixuan Huang,Jie Yang,Chao-Kai Wen,Shi Jin

2024-03-18

Abstract:Retrieving range information in three-dimensional (3D) radio imaging is particularly challenging due to the limited communication bandwidth and pilot resources. To address this issue, we consider a reconfigurable intelligent surface (RIS)-aided uplink communication scenario, generating multiple measurements through RIS phase adjustment. This study successfully realizes 3D single-frequency imaging by exploiting the near-field multi-view image correlations deduced from user mobility. We first highlight the significance of considering anisotropy in multi-view image formation by investigating radar cross-section properties and diffraction resolution limits. We then propose a novel model for joint multi-view 3D imaging that incorporates occlusion effects and anisotropic scattering. These factors lead to slow image support variation and smooth coefficient evolution, which are mathematically modeled as Markov processes. Based on this model, we employ the Expectation Maximization-Turbo-Generalized Approximate Message Passing algorithm for joint multi-view single-frequency 3D imaging with limited measurements. Simulation results reveal the superiority of joint multi-view imaging in terms of enhanced imaging ranges, accuracies, and anisotropy characterization compared to single-view imaging. Combining adjacent observations for joint multi-view imaging enables a reduction in the measurement overhead by 80%.

Information Theory,Signal Processing
Panoramic Direct LiDAR-assisted Visual Odometry

Zikang Yuan,Tianle Xu,Xiaoxiang Wang,Jinni Geng,Xin Yang

2024-09-14

Abstract:Enhancing visual odometry by exploiting sparse depth measurements from LiDAR is a promising solution for improving tracking accuracy of an odometry. Most existing works utilize a monocular pinhole camera, yet could suffer from poor robustness due to less available information from limited field-of-view (FOV). This paper proposes a panoramic direct LiDAR-assisted visual odometry, which fully associates the 360-degree FOV LiDAR points with the 360-degree FOV panoramic image datas. 360-degree FOV panoramic images can provide more available information, which can compensate inaccurate pose estimation caused by insufficient texture or motion blur from a single view. In addition to constraints between a specific view at different times, constraints can also be built between different views at the same moment. Experimental results on public datasets demonstrate the benefit of large FOV of our panoramic direct LiDAR-assisted visual odometry to state-of-the-art approaches.

Robotics
Extending Depth of Field for Varifocal Multiview Images

Zhilong Li,Kejun Wu,Qiong Liu,You Yang

2024-09-28

Abstract:Optical imaging systems are generally limited by the depth of field because of the nature of the optics. Therefore, extending depth of field (EDoF) is a fundamental task for meeting the requirements of emerging visual applications. To solve this task, the common practice is using multi-focus images from a single viewpoint. This method can obtain acceptable quality of EDoF under the condition of fixed field of view, but it is only applicable to static scenes and the field of view is limited and fixed. An emerging data type, varifocal multiview images have the potential to become a new paradigm for solving the EDoF, because the data contains more field of view information than multi-focus images. To realize EDoF of varifocal multiview images, we propose an end-to-end method for the EDoF, including image alignment, image optimization and image fusion. Experimental results demonstrate the efficiency of the proposed method.

Computer Vision and Pattern Recognition,Multimedia
Exploiting Correspondences with All-pairs Correlations for Multi-view Depth Estimation

Kai Cheng,Hao Chen,Wei Yin,Guangkai Xu,Xuejin Chen

DOI: https://doi.org/10.48550/arxiv.2205.02481

2022-01-01

Abstract: Multi-view depth estimation plays a critical role in reconstructing and understanding the 3D world. Recent learning-based methods have made significant progress in it. However, multi-view depth estimation is fundamentally a correspondence-based optimization problem, but previous learning-based methods mainly rely on predefined depth hypotheses to build correspondence as the cost volume and implicitly regularize it to fit depth prediction, deviating from the essence of iterative optimization based on stereo correspondence. Thus, they suffer unsatisfactory precision and generalization capability. In this paper, we are the first to explore more general image correlations to establish correspondences dynamically for depth estimation. We design a novel iterative multi-view depth estimation framework mimicking the optimization process, which consists of 1) a correlation volume construction module that models the pixel similarity between a reference image and source images as all-to-all correlations; 2) a flow-based depth initialization module that estimates the depth from the 2D optical flow; 3) a novel correlation-guided depth refinement module that reprojects points in different views to effectively fetch relevant correlations for further fusion and integrate the fused correlation for iterative depth update. Without predefined depth hypotheses, the fused correlations establish multi-view correspondence in an efficient way and guide the depth refinement heuristically. We conduct sufficient experiments on ScanNet, DeMoN, ETH3D, and 7Scenes to demonstrate the superiority of our method on multi-view depth estimation and its best generalization ability.
Single-Camera Three-Dimensional Digital Image Correlation with Enhanced Accuracy Based on Four-View Imaging

Xinxing Shao,Jingye Qu,Wenwu Chen

DOI: https://doi.org/10.3390/ma16072726

IF: 3.4

2023-03-29

Materials

Abstract:Owing to the advantages of cost-effectiveness, compactness, and the avoidance of complicated camera synchronization, single-camera three-dimensional (3D) digital image correlation (DIC) techniques have gained increasing attention for deformation measurement of materials and structures. In the traditional single-camera 3D-DIC system, the left and right view images can be recorded by a single camera using diffraction grating, a bi-prism, or a set of planar mirrors. To further improve the measurement accuracy of single-camera 3D-DIC, this paper introduces a single-camera four-view imaging technique by installing a pyramidal prism in front of the camera. The 3D reconstruction of the measured points before and after deformation is realized with eight governing equations induced by four views, and the strong geometric constraints of four views can help to improve the measurement accuracy. A static experiment, a rigid body translation experiment, and a four-point bending experiment show that the proposed single-camera 3D-DIC method can achieve higher measurement accuracy than the dual-view single-camera 3D-DIC techniques and that the single-camera 3D-DIC method has advantages in reducing both random error and systematic error.

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,metallurgy & metallurgical engineering
Multi-viewing-point 3D digital display using integral imaging

Jing Xu,Huaqiao Gui,Fan Ji,Wei Huang,Hong Chang,Fugui Yang,Jianping Xie,Hai Ming

DOI: https://doi.org/10.1117/12.758813

2007-01-01

Abstract:This paper proposed a method by using integral imaging for computationally reconstructing three-dimensional (3D) images from different viewing points without introducing additional system complexity. In this method, the process of 3D scene sensing is accomplished by using a microlens array to obtain elemental images. The multi-viewing-points reconstruction process is carried out by computationally simulating optical reconstruction. The prototype displays differently directional views with a horizontal or vertical angle pitch of 3°~1°, when the depth range of object is from 150mm to 450mm. The viewing angle of one image point is about 53°. By optimizing the parameters of imaging system, the angle pitch would satisfy the requirement of practical application. The experimental results proving the effectiveness of the method are given.© (2007) COPYRIGHT SPIE--The International Society for Optical Engineering. Downloading of the abstract is permitted for personal use only.
High-speed multiview imaging approaching 4pi steradians using conic section mirrors: theoretical and practical considerations

Kevin C. Zhou,Al-Hafeez Dhalla,Ryan P. McNabb,Ruobing Qian,Sina Farsiu,Joseph A. Izatt

DOI: https://doi.org/10.1364/JOSAA.440592

2021-11-18

Abstract:Illuminating or imaging samples from a broad angular range is essential in a wide variety of computational 3D imaging and resolution-enhancement techniques, such as optical projection tomography (OPT), optical diffraction tomography (ODT), synthetic aperture microscopy, Fourier ptychographic microscopy (FPM), structured illumination microscopy (SIM), photogrammetry, and optical coherence refraction tomography (OCRT). The wider the angular coverage, the better the resolution enhancement or 3D resolving capabilities. However, achieving such angular ranges is a practical challenge, especially when approaching plus-or-minus 90 degrees or beyond. Often, researchers resort to expensive, proprietary high numerical aperture (NA) objectives, or to rotating the sample or source-detector pair, which sacrifices temporal resolution or perturbs the sample. Here, we propose several new strategies for multi-angle imaging approaching 4pi steradians using concave parabolic or ellipsoidal mirrors and fast, low rotational inertia scanners, such as galvanometers. We derive theoretically and empirically relations between a variety of system parameters (e.g., NA, wavelength, focal length, telecentricity) and achievable fields of view (FOVs) and importantly show that intrinsic tilt aberrations do not restrict FOV for many multi-view imaging applications, contrary to conventional wisdom. Finally, we present strategies for avoiding spherical aberrations at obliquely illuminated flat boundaries. Our simple designs allow for high-speed multi-angle imaging for microscopic, mesoscopic, and macroscopic applications.

Optics
Motion correction using overlapped data correlation based on a spatial-spectral encoded parallel optical coherence tomography.

Zhiyan Chen,Yi Shen,Wen Bao,Peng Li,Xiaoping Wang,Zhihua Ding

DOI: https://doi.org/10.1364/OE.25.007069

IF: 3.8

2017-01-01

Optics Express

Abstract:This paper presents an approach to remove motion artifacts based on a spatial-spectral encoded parallel OCT (SSE-POCT) system, where encoded rectangular illumination is employed. Motion artifacts within a B-scan are avoided due to parallel detection intrinsic to parallel OCT, while those between successive B-scans are estimated and corrected by a proposed overlapped data correlation (ODC) algorithm. To preserve axial resolution, decoded B-scan corresponding to complete spectrum is stitched from successive encoded B-scans after motion correction. Imaging is conducted on several samples under preset motion trajectories, and OCT images with unnoticed motion artifacts and well-preserved resolutions are reconstructed. The approach based on the developed SSE-POCT system and the proposed ODC algorithm for motion correction can be applicable for in vivo imaging where uncontrolled motion is usually unavoidable. (C) 2017 Optical Society of America
Three-dimensional ghost imaging based on periodic diffraction correlation imaging

yongchao zhu,jianhong shi,hu li,guihua zeng

DOI: https://doi.org/10.3788/COL201412.071101

IF: 2.56

2014-01-01

Chinese Optics Letters

Abstract:We experimentally demonstrate a three-dimensional (3D) ghost imaging method based on period diffraction correlation imaging. Compared with conventional ghost imaging, our method can easily retrieve the images of different focal planes. Due to the correlation between the disturbed object beam and the reference beams which do not pass through any scattering, the clear images can be periodically obtained in the uncovered zones even through a scattering medium. The analysis of the 3D imaging resolution reveals that the proper resolution for actual demand can be achieved by designing our devices. The implementation of this experiment is quite simple and low-cost. It facilitates the practical applications of ghost imaging.

Multiple-view 3D digital image correlation based on pseudo-overlapped imaging

A Three-Dimensional Measurement Method for Binocular Endoscopes Based on Deep Learning

Multi-image-distance Imaging System for Extending Depth-of-field

Ultra-deep three-dimensional optical coherence tomography in turbid media

Monocentric Imaging System with Wide Field of View and High Resolution for Distant View Observation

Joint Focusing Method Based on Optimal Image-Distance Interval for Multi-Image-distance Imaging System

Focal plane coincidence method for a multi-view telecentric 3D imaging system

Increasing a microscope's effective field of view via overlapped imaging and machine learning

Research of real-time wide field image merging based on multi-cameras

Success Probability in Multi-View Imaging

RIS-aided Single-frequency 3D Imaging by Exploiting Multi-view Image Correlations

Panoramic Direct LiDAR-assisted Visual Odometry

Extending Depth of Field for Varifocal Multiview Images

Exploiting Correspondences with All-pairs Correlations for Multi-view Depth Estimation

Single-Camera Three-Dimensional Digital Image Correlation with Enhanced Accuracy Based on Four-View Imaging

Multi-viewing-point 3D digital display using integral imaging

High-speed multiview imaging approaching 4pi steradians using conic section mirrors: theoretical and practical considerations

Motion correction using overlapped data correlation based on a spatial-spectral encoded parallel optical coherence tomography.

Three-dimensional ghost imaging based on periodic diffraction correlation imaging