Multiview three-dimensional imaging using a Risley-prism-based spatially adaptive virtual camera field

Xingsheng Liu,Anhu Li

DOI: https://doi.org/10.1364/AO.454308

IF: 1.9

2022-04-22

Applied Optics

Abstract:Xingsheng Liu, Anhu Li We present a three-dimensional (3D) imaging system that incorporates a stationary camera and Risley prisms. By planning prism rotation to ... [Appl. Opt. 61, 3619-3629 (2022)]

optics

What problem does this paper attempt to address?

Virtual image array generated by Risley prisms for three-dimensional imaging

Haoyu Zhang,Jie Cao,Huan Cui,Dong Zhou,Qun Hao

DOI: https://doi.org/10.1016/j.optcom.2022.128309

IF: 2.4

2022-08-01

Optics Communications

Abstract:We present a compact three-dimensional (3D) imaging system based on a virtual image array, which employs a single camera and Risley prisms. The original multi-perspective images are captured by the fixed camera with a dynamically deflected boresight. By applying planar homographies to original images, we obtain light field samples from a planar virtual image array. Moreover, a depth estimation framework on the epipolar-plane image (EPI) is adopted to generate 3D profiles of scenes. In the experiment, two-dimensional (2D) projections from a 5 × 5 virtual image array are obtained to exhibit the 3D imaging capability. The system has the potential to achieve stereovision in numerous applications such as industrial vision and visual navigation.

optics
Multi-view 3D Reconstruction from Uncalibrated Radially-Symmetric Cameras

Jae-Hak Kim,Yuchao Dai,Hongdong Li,Xin Du,Jonghyuk Kim

DOI: https://doi.org/10.1109/iccv.2013.238

2013-01-01

Abstract:We present a new multi-view 3D Euclidean reconstruction method for arbitrary uncalibrated radially-symmetric cameras, which needs no calibration or any camera model parameters other than radial symmetry. It is built on the radial 1D camera model [25], a unified mathematical abstraction to different types of radially-symmetric cameras. We formulate the problem of multi-view reconstruction for radial 1D cameras as a matrix rank minimization problem. Efficient implementation based on alternating direction continuation is proposed to handle scalability issue for real-world applications. Our method applies to a wide range of omni directional cameras including both dioptric and catadioptric (central and non-central) cameras. Additionally, our method deals with complete and incomplete measurements under a unified framework elegantly. Experiments on both synthetic and real images from various types of cameras validate the superior performance of our new method, in terms of numerical accuracy and robustness.
Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Wentao Zhang,Shengqian Chang,Xiao Tao,Chang Wang,Chenning Tao,Peizheng Huang,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2319552

2018-01-01

Abstract:A novel method is proposed in this paper to accurately reconstruct the three-dimensional scenes by using a passive single-shot exposure with a lenslet light field camera. This method has better performance of 3D scenes reconstruction with both defocus and disparity depth cues captured by light field camera. First, the light field data is used to refocus and shift viewpoints to get a focal stack and multi-view images. In refocusing procedure, the phase shift theorem in the Fourier domain is first introduced to substitute shift in spatial domain, and sharper focal stacks can be obtained with less blurriness. Thus, 3D scenes can be reconstructed more accurately. Next, through multi-view images, disparity depth cues are obtained by performing correspondence measure. Then, the focal stack is used to compute defocus depth cues by focus measure based on gray variance. Finally, the focus cost is built to integrate both defocus and disparity depth cues, and the accurate depth map is estimated by using Graph Cuts based on the focus cost. Using this accurate depth map and all-in-focus image, the 3D structure in real world are accurately reconstructed. Our method is verified by a number of synthetic and real-world examples captured with a dense camera array and a Lytro light field camera.
Three-dimensional computational ghost imaging using a dynamic virtual projection unit generated by Risley prisms

Haoyu Zhang,Jie Cao,Dong Zhou,Huan Cui,Yang Cheng,Qun Hao

DOI: https://doi.org/10.1364/OE.472889

2022-10-10

Abstract:Computational ghost imaging (CGI) using stereo vision is able to achieve three-dimensional (3D) imaging by using multiple projection units or multiple bucket detectors which are separated spatially. We present a compact 3D CGI system that consists of Risley prisms, a stationary projection unit and a bucket detector. By rotating double prisms to various angles, speckle patterns appear to be projected by a dynamic virtual projection unit at different positions and multi-view ghost images are obtained for 3D imaging. In the process of reconstruction, a convolutional neural network (CNN) for super-resolution (SR) is adopted to enhance the angular resolution of reconstructed images. Moreover, an optimized 3D CNN is implemented for disparity estimation and 3D reconstruction. The experimental results validate the effectiveness of the method and indicate that the compact system with flexibility has potential in applications such as navigation and detection.
A Large Field-of-view Imaging and Stitching Method Using a Risley-prism-embedded Camera

Weidong Pan,Anhu Li

DOI: https://doi.org/10.1364/dh.2022.tu2a.6

Abstract:We propose a large field-of-view, high-resolution imaging method. A Risley-prism-embedded camera captures different regions of interest of objects from multiple viewpoints. In addition, a fast matching method is proposed to achieve efficient image stitching.

Computer Science,Engineering,Physics
Scale-adaptive three-dimensional imaging using Risley-prism-based coherent lidar

Xingsheng Liu,Anhu Li,Hao Chen,Jianfeng Sun,Zhiyong Lu

DOI: https://doi.org/10.1364/OL.487477

IF: 3.6

2023-05-06

Optics Letters

Abstract:Xingsheng Liu, Anhu Li, Hao Chen, Jianfeng Sun, Zhiyong Lu We present a scale-adaptive three-dimensional (3D) imaging architecture for coherent light detection and ranging (lidar) that incorporates ... [Opt. Lett. 48, 2587-2590 (2023)]

optics
Color omnidirectional-view three-dimensional display based on rotating selective diffuser

Xinxing Xia,Caijie Yan,Haifeng Li,Zhenrong Zheng,Xü Liu

2010-01-01

Abstract:Three-dimensional (3D) display with omnidirectional view combines the characteristic of autostereoscopic and volumetric displays, and occlusion-capable highly multiview display is implemented. This paper presents the principle of this 3D display and analyzes the performance of it. With this display system, the real 3D scenes can be reconstructed for observers viewing from different directions. Observers could watch vivid refined 3D scenes without the need of any special viewing aids.
Omnidirectional-view three-dimensional display system based on cylindrical selective-diffusing screen.

Xinxing Xia,Zhenrong Zheng,Xu Liu,Haifeng Li,Caijie Yan

DOI: https://doi.org/10.1364/AO.49.004915

IF: 1.9

2010-01-01

Applied Optics

Abstract:We utilized a high-frame-rate projector, a rotating mirror, and a cylindrical selective-diffusing screen to present a novel three-dimensional (3D) omnidirectional-view display system without the need for any special viewing aids. The display principle and image size are analyzed, and the common display zone is proposed. The viewing zone for one observation place is also studied. The experimental results verify this method, and a vivid color 3D scene with occlusion and smooth parallax is also demonstrated with the system. (C) 2010 Optical Society of America
Risley-prism-based multi-beam scanning LiDAR for high-resolution three-dimensional imaging

Anhu Li,Xingsheng Liu,Jianfeng Sun,Zhiyong Lu

DOI: https://doi.org/10.1016/j.optlaseng.2021.106836

IF: 5.666

2022-03-01

Optics and Lasers in Engineering

Abstract:Light detection and ranging (LiDAR) as a significant approach to three-dimensional perception has increasingly suffered from challenges for compact structure, high resolution and strong adaptability. This paper presents a versatile LiDAR system that incorporates multi-beam scanning using Risley prisms and coherent detection based on triangular frequency modulation. By combining Risley-prism-based multi-beam steering model with simultaneous distance and velocity measurements, the LiDAR architecture for three-dimensional imaging is theoretically demonstrated. A unified LiDAR point cloud processing framework is developed, where the multi-mode integrated filtering method is proposed for outlier removal using point cloud characteristics. The coarse-fine coupled strategy is also formulated to combine statistical modeling with iterative optimization for multi-channel point cloud registration. It is experimentally validated that our LiDAR can achieve high-resolution three-dimensional information acquisition against long range, and the proposed point cloud processing technique can fully reconstruct the spatial form of object while preserving sufficient details.

optics
Development of a Three-Dimensional Multimode Visual Immersive System With Applications in Telepresence

Luo Hao,Pan Tien-Szu,Pan Jeng-Shyang,Chu Shu-Chuan,Yang Bian

DOI: https://doi.org/10.1109/JSYST.2015.2410533

IF: 4.802

2017-01-01

IEEE Systems Journal

Abstract:Three dimensional (3-D) visual immersive system provides a better experience of virtual or remote environments compared with 2-D vision and is thus becoming one of the most active research fields of virtual reality. This paper describes how a 3-D multimode visual immersive system (3DMVIS) is developed, including system architecture, triplet lens module, head orientation tracking circuit, display module, and sensor signal processing. It supports two operation modes for different applications, corresponding to different combinations of lens. As a portable head-mounted display (HMD) device, it can be used in extensive virtual reality and telepresence applications. In addition, this HMD provides visual accommodation with the aid of manual focus and compatibility with various types of 3-D videos. Hence, users with various levels of myopia can experience this facility without wearing glasses. Meanwhile, a typical application in telepresence is investigated along with a compact panoramic camera system. The 3DMVIS is tested and evaluated with various virtual reality scenes, standard-format 3-D movies, and real-world 360. panoramic videos. In addition, comparisons with other commercial counterparts are presented. Technical specification indicates that the 3DMVIS with its telepresence system satisfies the requirements of practical applications.
Transverse wide-visual field tridimensional display method and system based on spliced light field

Haifeng Li,Yifan Peng,Xu Liu,Qing Zhong

2012-01-01

Abstract:The invention discloses transverse wide-visual field tridimensional display method and system based on a spliced light field. The method comprises the steps of: obtaining image sources necessary for aligned observation of different view points in the transverse direction of a tridimensional scene; utilizing a plurality of projection display units to project a planar directional diffuser screen in an alignment manner; and enabling an observer to move along the transverse direction to view different transverse parts of the tridimensional scene spliced by vertical images formed by the aligned projection of different projection display units so as to realize transverse wide-visual field tridimensional display. The system comprises a projection tridimensional display unit, a planar directional diffuser screen and a control computer. The projection unit is structured by pixel region division of a two-dimensional display unit and a corresponding lens and aperture array right ahead, and the planar directional diffuser screen is projected in an alignment manner. The method and system disclosed by the invention have the advantages of being capable of generating a tridimensional image with fine transverse parallax capable of being observed in a wide view field range in the transverse direction. Compared with the single naked eye stereoscopic display, the multi-screen splicing arrangement can expand the view angle and increase the spatial scale and enjoyment range of the tridimensional image.
Multiview and light-field reconstruction algorithms for 360° multiple-projector-type 3D display.

Qing Zhong,Yifan Peng,Haifeng Li,Chen Su,Weidong Shen,Xu Liu

DOI: https://doi.org/10.1364/AO.52.004419

IF: 1.9

2013-01-01

Applied Optics

Abstract:Both multiview and light-field reconstructions are proposed for a multiple-projector 3D display system. To compare the performance of the reconstruction algorithms in the same system, an optimized multiview reconstruction algorithm with sub-view-zones (SVZs) is proposed. The algorithm divided the conventional view zones in multiview display into several SVZs and allocates more view images. The optimized reconstruction algorithm unifies the conventional multiview reconstruction and light-field reconstruction algorithms, which can indicate the difference in performance when multiview reconstruction is changed to light-field reconstruction. A prototype consisting of 60 projectors with an arc diffuser as its screen is constructed to verify the algorithms. Comparison of different configurations of SVZs shows that light-field reconstruction provides large-scale 3D images with the smoothest motion parallax; thus it may provide better overall performance for large-scale 360 degrees display than multiview reconstruction. (C) 2013 Optical Society of America
Fast Risley prisms camera steering system: calibration and image distortions correction through the use of a three-dimensional refraction model

Benoît Ricard

DOI: https://doi.org/10.1117/1.2722754

IF: 1.3

2007-04-01

Optical Engineering

Abstract:To improve airborne search and rescue operations and the general aerial surveillance efficiency, new concepts of multiple field-of-view and variable-resolution imagers have been developed. These imagers provide surveillance operators with simultaneous wide area coverage and high-resolution imaging. Over the last years, several optical steering systems have been developed and field tested in operational conditions. These developments helped us to develop a novel camera steering system using achromatic Risley prisms. This simple and sturdy steering system allowed us to move rapidly and precisely the field of view of an infrared camera. To improve its performance, a three-dimensional (3D) refraction model was applied to enable fast pointing direction calibration and correction of distorted images. Image deformations were analyzed, and a fast linear image correction based on homographic transformation and the 3D refraction model are presented. Experimental results of mosaicking applications with real imaging systems in the 3- to 5-μm, 8- to 12-μm infrared, and 850- to 860-nm visible bands demonstrate the improvements achieved with the homographic image distortions correction and the fast pointing calibration procedure.

optics
Cooperative correction method for distortion and dispersion of deflected field of view in Risley-prism bionic-human-eye imaging systems

Feng Huang,Duanhao Huang,Shumin Yang,Pengfei Wang

DOI: https://doi.org/10.1364/oe.513502

IF: 3.8

2024-02-02

Optics Express

Abstract:Feng Huang, Duanhao Huang, Shumin Yang, Pengfei Wang The Risley-prism imaging system (RPIS) is a powerful way to achieve bionic human eye imaging with great advantages on large field of view ... [Opt. Express 32, 5444-5459 (2024)]

optics
On Adjustment of Stereo Parameters in Multiview Synthesis for Planar 3d Displays

Dongxiao Li,Xiaotian Qiao,Dongning Zang,Lianghao Wang,Ming Zhang

DOI: https://doi.org/10.1002/jsid.387

2015-01-01

Journal of the Society for Information Display

Abstract:This paper investigates the impacts of stereo parameters in multiview synthesis for planar 3D display and presents a novel parameter adjustment method for reducing visual discomforts and geometric distortions. The proposed method combines the geometry of stereoscopic capturing system with the comfortable viewing rules for the human vision system in three steps. First, an identically sized representation between the virtual space and the display space is established, and the virtual camera parameters are derived based on the stereo geometry. Second, the scale factor between the physical space and the virtual space is computed based on the depth of focus theory to diminish vergence-accommodation conflicts. Last, the capturing and displaying parameters are adjusted according to the comfortable viewing zone and personal preference. Experimental results demonstrated that a reliable basis for multiview image synthesis and a more comfortable stereo perception can be achieved by applying the proposed method.
3D imaging scanner.

Zhouyi Wu,Chao Han,Changhuei Yang,Jiangtao Huangfu

DOI: https://doi.org/10.1364/AO.57.005399

IF: 1.9

2018-01-01

Applied Optics

Abstract:This paper proposes a multi-view three-dimensional display method based on a scanning imaging system with the light-intensity characteristic recorded by an improved flatbed scanner. Within the effective scanning depth of the imaging sensor, two transmission images are each simultaneously acquired by two linear CCD modules with different focal planes. Then the phase gradient information of the target can be obtained by an appropriate retrieval algorithm. Further, the multi-view three-dimensional effect is presented through dynamic angles of view. Theoretical analysis of this method is discussed, and experiments are carried out by building a scanner. The experiment results are presented with an algae specimen and transparent beads. We hope this method can be applied to present the three-dimensional effect of objects of flat translucent multilayer structure with a wide field of view. (C) 2018 Optical Society of America
Single-Lens Stereovision System Using A Prism: Position Estimation of A Multi-Ocular Prism

Xiaoyu Cui,Kah Bin Lim,Yue Zhao,Wei Loon Kee

DOI: https://doi.org/10.1364/josaa.31.001074

2014-01-01

Abstract:In this paper, a position estimation method using a prism-based single-lens stereovision system is proposed. A multifaced prism was considered as a single optical system composed of few refractive planes. A transformation matrix which relates the coordinates of an object point to its coordinates on the image plane through the refraction of the prism was derived based on geometrical optics. A mathematical model which is able to denote the position of an arbitrary faces prism with only seven parameters is introduced. This model further extends the application of the single-lens stereovision system using a prism to other areas. Experimentation results are presented to prove the effectiveness and robustness of our proposed model.
High-efficiency simplification method of irregular FOV for accelerating the imaging process in the Risley-Prism system

Pengfei Wang,Duanhao Huang,He Ren,Feng Huang

DOI: https://doi.org/10.1364/OE.472884

IF: 3.8

2022-09-28

Optics Express

Abstract:Pengfei Wang, Duanhao Huang, He Ren, Feng Huang The Risley-Prism system, which has advantages in large FOV (field of view), high resolution and flexible imaging, faces limitations in ... [Opt. Express 30, 37364-37378 (2022)]

optics
Calibration method of Risley-prism imaging System

Anhu Li,Shengze Zhong

DOI: https://doi.org/10.1016/j.optcom.2019.124975

IF: 2.4

2020-03-01

Optics Communications

Abstract:<p>In this paper, a Risley-prism imaging system is proposed, which incorporates a camera and two coaxial Risley prisms to capture various scenes, namely images captured by equivalent cameras. An equivalent camera calibration method is established to obtain the extrinsic parameters of the equivalent cameras from rectified images captured by the system. To improve calibration accuracy, a geometric method is applied to rectify the degraded images over the whole scanning area. Such opto-electronmechanical configuration makes possible an agile and compact imaging system suitable for boresight adjustment. Experiments that apply imaging system located in different positions are conducted to validate the proposed method, and results are compared to verify its efficiency and accuracy.</p>

optics

Multiview three-dimensional imaging using a Risley-prism-based spatially adaptive virtual camera field

Virtual image array generated by Risley prisms for three-dimensional imaging

Multi-view 3D Reconstruction from Uncalibrated Radially-Symmetric Cameras

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Three-dimensional computational ghost imaging using a dynamic virtual projection unit generated by Risley prisms

A Large Field-of-view Imaging and Stitching Method Using a Risley-prism-embedded Camera

Scale-adaptive three-dimensional imaging using Risley-prism-based coherent lidar

Color omnidirectional-view three-dimensional display based on rotating selective diffuser

Omnidirectional-view three-dimensional display system based on cylindrical selective-diffusing screen.

Risley-prism-based multi-beam scanning LiDAR for high-resolution three-dimensional imaging

Development of a Three-Dimensional Multimode Visual Immersive System With Applications in Telepresence

Transverse wide-visual field tridimensional display method and system based on spliced light field

Multiview and light-field reconstruction algorithms for 360° multiple-projector-type 3D display.

Fast Risley prisms camera steering system: calibration and image distortions correction through the use of a three-dimensional refraction model

Cooperative correction method for distortion and dispersion of deflected field of view in Risley-prism bionic-human-eye imaging systems

On Adjustment of Stereo Parameters in Multiview Synthesis for Planar 3d Displays

3D imaging scanner.

Single-Lens Stereovision System Using A Prism: Position Estimation of A Multi-Ocular Prism

High-efficiency simplification method of irregular FOV for accelerating the imaging process in the Risley-Prism system

Calibration method of Risley-prism imaging System