Multifocal array camera system design

Shengtai Zhu,José Sasián,David J. Brady

DOI: https://doi.org/10.1364/ao.528972

IF: 1.9

2024-08-24

Applied Optics

Abstract:Shengtai Zhu, José Sasián, David J. Brady Traditional cameras rely on focusing mechanisms for high-performance imaging over a large depth range. However, focusing mechanisms are ... [Appl. Opt. 63, 6553-6559 (2024)]

optics

What problem does this paper attempt to address?

Autofocus for Multispectral Camera Using Focus Symmetry.

Hui-Liang Shen,Zhi-Huan Zheng,Wei Wang,Xin Du,Si-Jie Shao,John H. Xin

DOI: https://doi.org/10.1364/ao.51.002616

IF: 1.9

2012-01-01

Applied Optics

Abstract:A multispectral camera acquires spectral color images with high fidelity by splitting the light spectrum into more than three bands. Because of the shift of focal length with wavelength, the focus of each channel should be mechanically adjusted in order to obtain sharp images. Because progressive adjustment is quite time consuming, the clear focus must be determined by using a limited number of images. This paper exploits the symmetry of focus measure distribution and proposes a simple yet efficient autofocus method. The focus measures are computed using first-order image derivatives, and the focus curve is obtained by spline interpolation. The optimal focus position, which maximizes the symmetry of the focus measure distribution, is then computed according to distance metrics. The effectiveness of the proposed method is validated in the multispectral camera system, and it is also applicable to relevant imaging systems.
Multi-image-distance Imaging System for Extending Depth-of-field

Jixiang Tang,Xuanyin Wang,Huan Zhou,Jiayu Ji,Zhengxiao Li,Zijian Ye

DOI: https://doi.org/10.1016/j.ijleo.2023.170965

IF: 3.1

2023-01-01

Optik

Abstract:Depth of field (DoF) defines the longitudinal range of objects in sharp focus. Imaging systems for machine vision are generally limited to a small DoF by various conditions, constraining the visual inspection of objects with large depth. In this paper, we develop a multi-image-distance imaging system, which can extend the DoF by capturing multi-focus images for fusion. A three-way beam-splitter prism is designed to support independent imaging of three image sensors. Through adjusting the sensors to different back focal lengths, multiple images focusing at different depths are captured in a single exposure. Finally, the focused regions of each image are fused for extending the DoF. Analyses of the proposed DoF extension strategy illustrate excellent enhancement more than three times. Moreover, we introduce a DoF measurement method based on the estimation of the point spread function, and measurement experiments are conducted using the fabricated prototype. Imaging experiments for various scenes demonstrate great imaging quality and DoF extension performance. The proposed multi-image-distance imaging system provides an effective and practical DoF extension solution for close-range visual inspection.
Distributed focus and digital zoom

Wubin Pang,David J Brady

DOI: https://doi.org/10.1088/2631-8695/abad0a

IF: 1.7

2020-08-24

Engineering Research Express

Abstract:Abstract We explore integrated microcamera focus systems for array cameras. Array cameras enable wide field of view 90° to 360° high resolution (10–100 μ rad) imaging with small exit apertures (≈10 mm). Small exit apertures enable compact focus mechanisms with fast actuators. We show that a common mechanism supports ≈f/2.5 camera modules with focal lengths ranging from 25 to 60 mm. Designs for each focal length include a fixed objective lens group and an adjustable back focus group. Increasing the focal power of the front focal group enables the travel range to accommodate long focal length systems. We present design examples for both discrete and multiscale array camera systems.
A Fast Autofocus Method for Multispectral Imaging System

WANG Wei,ZHENG Zhihuan,SHEN Huiliang

DOI: https://doi.org/10.3969/j.issn.1003-501X.2013.09.006

2013-01-01

Abstract:A multispectral imaging system acquires spectral color images by splitting the light spectrum into multiple bands.Due to the different refractive index for individual wavelength,the focus positions of the channels are different,and thus each channel should be adjusted to obtain sharp image.We propose a fast autofocus method based on the similarity of focus measure distributions,which is suitable to multispectral imaging.In the proposed method,we first obtain the focus measure distribution of a reference channel using traditional autofocus method.Then,the clear focus positions of other channels are located according to the distribution similarity between individual channels.As only a few images are needed,the autofocus for these channels is quite fast.Experimental results validate that the proposed method performs better than the traditional techniques.
Calibration of a Camera-Array-based Microscopic System with Spatiotemporal Structured Light Encoding

Jing Hu,Jingtao Fan,Yibing Shen

DOI: https://doi.org/10.1016/j.optcom.2021.127503

IF: 2.4

2021-01-01

Optics Communications

Abstract:The strong need in life science and medicine research has prompted the development of wide-field, high resolution and real-time microscopic imaging based on camera array. For large-scale sub-image stitching on the order of billion pixels, it is highly challenging to calibrate the camera array with low-overlapping fields of view (FOVs). To address the challenge, we propose a camera array calibration method to obtain the complete camera model and global mapping coordinates. The method utilizes spatiotemporal structured light encoding provided by a spatial light modulator to establish the correspondence between the physical coordinates of the keypoints in the object plane and their pixel coordinates in the sub-image plane. This achieves fast and accurate calibration of a camera-array-based microscopic system without the requirement of sub-FOV overlap. A series of experiments, including reprojection evaluation and global image stitching on the resolution chart and biological specimen slice, verified the effectiveness of the proposed approach. The method supports calibration of global geometric position with 0.2-pixel accuracy and has a broad potential for application to general camera array-based imaging systems.
Chromatically Multi-Focal Optics Based on Micro-Lens Array Design.

Fang Duan,Wu-Le Zhu,Yanjun Han,Bing-Feng Ju,Anthony Beaucamp

DOI: https://doi.org/10.1364/oe.391674

IF: 3.8

2020-01-01

Optics Express

Abstract:CCD arrays encode color information via uniformly distributed red, green and blue pixels. Therefore, even a perfectly achromatic system projecting an image onto a CCD plane cannot possibly associate a single object point with the 3 or more discrete pixels encoding color content. Here, we propose and demonstrate a micro-lens array (MLA) design that simultaneously corrects chromatic aberrations and separates color channels to spatially distinct pixels. Starting from a commercially available aspheric condenser lens, methods to design and assess the performance of a few microns deep MLA etched on the convex optical surface are detailed. Actual fabrication is carried out by fluid jet polishing, with an optical form deviation of 0.24 µm rms. Finally, the MLA is assessed with a narrowly collimated beam containing two wavelengths, which produces distinct spots of diameter 10-15 µm as expected.
Dynamically Tunable Hemispherical Electronic Eye Camera System with Adjustable Zoom Capability

Inhwa Jung,Jianliang Xiao,Viktor Malyarchuk,Chaofeng Lu,Ming Li,Zhuangjian Liu,Jongseung Yoon,Yonggang Huang,John A. Rogers

DOI: https://doi.org/10.1073/pnas.1015440108

2011-01-01

Abstract:Imaging systems that exploit arrays of photodetectors in curvilinear layouts are attractive due to their ability to match the strongly nonplanar image surfaces (i.e., Petzval surfaces) that form with simple lenses, thereby creating new design options. Recent work has yielded significant progress in the realization of such "eyeball" cameras, including examples of fully functional silicon devices capable of collecting realistic images. Although these systems provide advantages compared to those with conventional, planar designs, their fixed detector curvature renders them incompatible with changes in the Petzval surface that accompany variable zoom achieved with simple lenses. This paper describes a class of digital imaging device that overcomes this limitation, through the use of photodetector arrays on thin elastomeric membranes, capable of reversible deformation into hemispherical shapes with radii of curvature that can be adjusted dynamically, via hydraulics. Combining this type of detector with a similarly tunable, fluidic plano-convex lens yields a hemispherical camera with variable zoom and excellent imaging characteristics. Systematic experimental and theoretical studies of the mechanics and optics reveal all underlying principles of operation. This type of technology could be useful for night-vision surveillance, endoscopic imaging, and other areas that require compact cameras with simple zoom optics and wide-angle fields of view.
Design method for a telecentric multiscale imaging system to avoid mechanical interference

Peirong Chen,Honghan Li,Tianren Li,Yu Zhang,Yufu Qu,Zhenzhong Wei

DOI: https://doi.org/10.1364/ao.528357

IF: 1.9

2024-06-26

Applied Optics

Abstract:Peirong Chen, Honghan Li, Tianren Li, Yu Zhang, Yufu Qu, Zhenzhong Wei Multiscale imaging systems are widely employed for high-resolution imaging purposes. However, research in this area often lacks ... [Appl. Opt. 63, 5174-5183 (2024)]

optics
Micromechanics and Advanced Designs for Curved Photodetector Arrays in Hemispherical Electronic-Eye Cameras

Gunchul Shin,Inhwa Jung,Viktor Malyarchuk,Jizhou Song,Shuodao Wang,Heung Cho Ko,Yonggang Huang,Jeong Sook Ha,John A. Rogers

DOI: https://doi.org/10.1002/smll.200901350

IF: 13.3

2010-01-01

Small

Abstract:The fabrication of a hemispherical electronic-eye camera with optimized designs based upon micromechanical analysis is reported. The photodetector arrays combine layouts with multidevice tiles and extended, non-coplanar interconnects to improve the fill factor and deformability, respectively. Quantitative comparison to micromechanics analysis reveals the key features of these designs. Color images collected with working cameras demonstrate the utility of these approaches.
Optical System Design of Multi-Angle Coupled Framing Camera

Zhang Tian-shu,Jin Guang,Liu Chun-yu

DOI: https://doi.org/10.3788/co.20181104.0615

2018-01-01

Abstract:In order to realize the framing function of high-speed cameras, we proposes a high-speed camera optical system using multi-angle coupled framing methods. The framing structure uses multiple groups of the same optical system and is evenly distributed on the circumference parallel to the object plane. The same object surface is photographed from different angles. Each group is guaranteed to have the same object field of view. The angle between the optical axis of the optical system and the object plane is the same, and the best imaging of the entire field of view is obtained through optimization design. According to the requirements, a telephoto optical system in multi-angle-coupled quadrant imaging is designed using optical design software and a three-dimensional simulation model is drawn. The image quality, luminance, distortion, and other relevant parameters of each group are analyzed, and at a frequency of 501p/mm, the modulation transfer function (MTF) is not less than 0.5, the F number is 2, and the distortion is less than 0.4%. Compared with the commonly used prism and reflective pyramidal spectroscopy, the surface illumination can be increased by more than 4 times without additional splitting structure. The results show that the imaging quality is ideal and the image formation consistency of the image planes of the framing camera system is satisfied.
Depth-of-Field-Extended Plenoptic Camera Based on Tunable Multi-Focus Liquid-Crystal Microlens Array

Mingce Chen,Wenda He,Dong Wei,Chai Hu,Jiashuo Shi,Xinyu Zhang,Haiwei Wang,Changsheng Xie

DOI: https://doi.org/10.3390/s20154142

IF: 3.9

2020-07-25

Sensors

Abstract:Plenoptic cameras have received a wide range of research interest because it can record the 4D plenoptic function or radiance including the radiation power and ray direction. One of its important applications is digital refocusing, which can obtain 2D images focused at different depths. To achieve digital refocusing in a wide range, a large depth of field (DOF) is needed, but there are fundamental optical limitations to this. In this paper, we proposed a plenoptic camera with an extended DOF by integrating a main lens, a tunable multi-focus liquid-crystal microlens array (TMF-LCMLA), and a complementary metal oxide semiconductor (CMOS) sensor together. The TMF-LCMLA was fabricated by traditional photolithography and standard microelectronic techniques, and its optical characteristics including interference patterns, focal lengths, and point spread functions (PSFs) were experimentally analyzed. Experiments demonstrated that the proposed plenoptic camera has a wider range of digital refocusing compared to the plenoptic camera based on a conventional liquid-crystal microlens array (LCMLA) with only one corresponding focal length at a certain voltage, which is equivalent to the extension of DOF. In addition, it also has a 2D/3D switchable function, which is not available with conventional plenoptic cameras.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Design of a Multifunction Astronomical CCD Camera

Dalei Yao,Desheng Wen,Jianru Xue,Zhi Chen,Yan Wen,Baotan Jiang,Jiangbo Xi

DOI: https://doi.org/10.1117/12.2197105

2015-01-01

Abstract:To satisfy the requirement of the astronomical observation, a novel timing sequence of frame transfer CCD is proposed. The multiple functions such as the adjustments of work pattern, exposure time and frame frequency are achieved. There are four work patterns: normal, standby, zero exposure and test. The adjustment of exposure time can set multiple exposure time according to the astronomical observation. The fame frequency can be adjusted when dark target is imaged and the maximum exposure time cannot satisfy the requirement. On the design of the video processing, offset correction and adjustment of multiple gains are proposed. Offset correction is used for eliminating the fixed pattern noise of CCD. Three gains pattern can improve the signal to noise ratio of astronomical observation. Finally, the images in differentsituations are collected and the system readout noise is calculated. The calculation results show that the designs in this paper are practicable.
Optical design and fabrication of a three-channel common-aperture multispectral polarization camera

Shan Du,Jun Chang,Chuhan Wu,Yue Zhong,Yaoyao Hu,Xuehui Zhao,Zihang Su

DOI: https://doi.org/10.1080/09500340.2021.1977861

IF: 1.3

2021-09-22

Journal of Modern Optics

Abstract:The ability to detect and recognize the low-contrast and distance targets in a complex environment is of great importance for many applications. However, one or two single spectral channel imaging cannot obtain adequate information. This study reports the design and construction of a common-aperture multispectral polarization imaging system, which can simultaneously obtain visible, short-wave infrared and mid-wave infrared wavebands. Such a system enables the acquirement of spatial, polarization and multispectral information of distance targets simultaneously. The experimental set-up is built to verify the basic principle of the device. The device is used to image optical resolution targets and the car at different times and distances in several complex backgrounds. The generated images are fused by polarization using image processing. The results indicate that the system performs well for imaging low-contrast objects in each waveband.

optics
Multi-Camera System: Imaging Enhancement and Application

Guo Peiyao,Pu Zhiyuan,Ma Zhan

DOI: https://doi.org/10.3788/lop202158.1811013

2021-01-01

Abstract:A camera mimics the biological vision system for acquiring natural scenes. Human beings and other animals are mostly equipped with binocular stereo or multi-eye vision systems for high-fidelity scene acquisition, which motivates us to develop a multi-camera system to enhance the imaging capacity. Multi-dimensional and multi scale image/video acquisitions can be realized via heterogeneous sensors and shooting conditions of different cameras, and then leveraging matches across cameras to realize computational multiscale feature fusion for final enhanced reconstruction in respect of scale or dimensionality. In this article, we exemplify the multi-camera system in the applications of wide-field ultrahigh-definition imaging, high spatiotemporal video acquisition, high dynamicrange and low-light imaging enhancement to demonstrate its advantages in improving the imaging capacity, e. g., increasing imaging spatiotemporal resolution, expanding the field of view and extending imaging dynamic range. Key words imaging system; multicamera system; computational imaging; imaging enhancement; spatiotemporal resolution; dynamic range
An Ultra High Definition Array Camera System and Parallel Processing Technology

Changjin Li,Xinyan Cao,Wei Ren,Jiquan Yuan,Xixin Cao

DOI: https://doi.org/10.1109/ipec61310.2024.00048

2024-01-01

Abstract:With the continuous advancement of technology, array camera systems, serving as a collaborative system of multiple cameras, exhibit broad prospects in areas such as surveillance, image processing, and computer vision. However, the development of array cameras is constrained by the challenges of large-scale data processing. This paper aims to address key technical issues related to the efficiency of digital image processing while delving into the design and implementation of array camera systems. To meet the demands of digital image processing in a multi-core environment, a parallel image data processing architecture is proposed, effectively mitigating issues arising from the lengthy execution times associated with serial data processing and enhancing the speed and efficiency of digital image processing. The design and integration of the array camera system are realized at both the hardware and algorithmic levels. Through the optimization of optical design and mechanical support structures, the hardware integration and debugging of the array camera system are achieved. At the algorithmic level, a parallel algorithm for digital image processing in a multi-core environment is employed, facilitating functions such as multi-channel video capture, pre-processing, transmission, and post-processing. This comprehensive approach provides a holistic solution for advanced security monitoring technology.
Design and fabrication of a multifocal bionic compound eye for imaging

Axiu Cao,Jiazhou Wang,Hui Pang,Man Zhang,Lifang Shi,Qiling Deng,Song Hu

DOI: https://doi.org/10.1088/1748-3190/aaa901

2018-02-27

Abstract:Miniaturized bionic compound eyes featured with multi-aperture imaging have potential applications in the areas of micro opto-electro-mechanical-system. In this manuscript, we present a novel structure of the bionic compound eye with multiple focal lengths consists of an array of individual lenses with 1000 µm diameter. The simulation results of the designed multifocal bionic compound eye (MBCE) with two focal lengths of 190 mm and 44.4 mm demonstrate excellent two-order focusing abilities. Moving mask exposure technology was used to fabricate the designed MBCE with the corresponding imaging experiments conducted to validate the two-order imaging ability of the fabricated MBCE. Experimental results revealed that the developed structure has potential applications in diverse optical imaging systems such as three-dimensional imaging and real-time detection of unconfined or fluctuating targets.

robotics,engineering, multidisciplinary,materials science, biomaterials
Curved retina-like camera array imaging system with adjustable super-resolution fovea

Huan Cui,Qun Hao,Jie Cao,Zihan Wang,Haoyu Zhang,Yang Cheng

DOI: https://doi.org/10.1364/AO.417466

2021-02-20

Abstract:To achieve non-uniform imaging with a large field of view and high efficiency as well as to obtain an adjustable fovea with super-resolution, we proposed a curved retina-like camera array imaging system (CRCS), which is built by an eight-camera array distributed non-uniformly on a curved surface and a camera coaxial with Risley prisms located in the center. By the non-uniform imaging, the field of view of the developed prototype is 150∘×40∘ with a reduction of data redundancy by 87.62%. Besides, the experimental results show that CRCS can obtain clear and sharp images of farther targets of interest around the fovea field of view with a constant focal length.
Heterogeneous Camera Array for Multispectral Light Field Imaging

Yang Zhao,Tao Yue,Linsen Chen,Hongyuan Wang,Zhan Ma,David J. Brady,Xun Cao

DOI: https://doi.org/10.1364/oe.25.014008

IF: 3.8

2017-01-01

Optics Express

Abstract:Multispectral light field acquisition is challenging due to the increased dimensionality of the problem. In this paper, inspired by anaglyph theory (i.e. the ability of human eyes to synthesize colored stereo perception from color-complementary (such as red and cyan) views), we propose to capture the multispectral light field using multiple cameras with different wide band filters. A convolutional neural network is used to extract the joint information of different spectral channels and to pair the cross-channel images. In our experiment, results on both synthetic data and real data captured by our prototype system validate the effectiveness and accuracy of proposed method.
Three-dimensional Vectorial Multifocal Arrays Created by Pseudo-Period Encoding

Tingting Zeng,Chenliang Chang,Zhaozhong Chen,Hui-Tian Wang,Jianping Ding

DOI: https://doi.org/10.1088/2040-8986/aac1de

IF: 2.1

2018-01-01

Journal of Optics

Abstract:Multifocal arrays have been attracting considerable attention recently owing to their potential applications in parallel optical tweezers, parallel single-molecule orientation determination, parallel recording and multifocal multiphoton microscopy. However, the generation of vectorial multifocal arrays with a tailorable structure and polarization state remains a great challenge, and reports on multifocal arrays have hitherto been restricted either to scalar focal spots without polarization versatility or to regular arrays with fixed spacing. In this work, we propose a specific pseudo-period encoding technique to create three-dimensional (3D) vectorial multifocal arrays with the ability to manipulate the position, polarization state and intensity of each focal spot. We experimentally validated the flexibility of our approach in the generation of 3D vectorial multiple spots with polarization multiplicity and position tunability.
Multifocal Array with Controllable Orbital Angular Momentum Modes by Tight Focusing

Duo Deng,Yan Li,Yanhua Han,Jingfu Ye,Zhongyi Guo,Shiliang Qu

DOI: https://doi.org/10.1016/j.optcom.2016.08.049

IF: 2.4

2017-01-01

Optics Communications

Abstract:Multifocal spots arrays with controllable three-dimensional (3D) position, orbital angular momentum (OAM) and the number of focal planes along longitudinal direction have been proposed and investigated by using a special designed phase-only multi-zone plate at the back aperture of a high numerical aperture (NA) objective. By using Debye diffraction integral, the focusing field could be rewritten as a fast Fourier transform (FFT), which is the theory and principle for generating the controllable OAM-modes focusing spots. According to this theory, a hybrid multi-zone plate at the back aperture of a high NA objective is designed for the illuminations of the radially polarized Bessel–Gaussian beam. Each focusing spot in the focal plane is generated by independent parts, so the multiplexing OAM-modes could be realized by focusing two or more spots at the same position with different orthogonal eigenstates. It is a practical and flexible OAM multi-focus technique with dynamically controllable 3D position, number of focal planes, corresponding topological charges and focal lengths to meet different requirements, such as 3D optical data storage, air-core fiber coupler and parallel optical manipulation.

Multifocal array camera system design

Autofocus for Multispectral Camera Using Focus Symmetry.

Multi-image-distance Imaging System for Extending Depth-of-field

Distributed focus and digital zoom

A Fast Autofocus Method for Multispectral Imaging System

Calibration of a Camera-Array-based Microscopic System with Spatiotemporal Structured Light Encoding

Chromatically Multi-Focal Optics Based on Micro-Lens Array Design.

Dynamically Tunable Hemispherical Electronic Eye Camera System with Adjustable Zoom Capability

Design method for a telecentric multiscale imaging system to avoid mechanical interference

Micromechanics and Advanced Designs for Curved Photodetector Arrays in Hemispherical Electronic-Eye Cameras

Optical System Design of Multi-Angle Coupled Framing Camera

Depth-of-Field-Extended Plenoptic Camera Based on Tunable Multi-Focus Liquid-Crystal Microlens Array

Design of a Multifunction Astronomical CCD Camera

Optical design and fabrication of a three-channel common-aperture multispectral polarization camera

Multi-Camera System: Imaging Enhancement and Application

An Ultra High Definition Array Camera System and Parallel Processing Technology

Design and fabrication of a multifocal bionic compound eye for imaging

Curved retina-like camera array imaging system with adjustable super-resolution fovea

Heterogeneous Camera Array for Multispectral Light Field Imaging

Three-dimensional Vectorial Multifocal Arrays Created by Pseudo-Period Encoding

Multifocal Array with Controllable Orbital Angular Momentum Modes by Tight Focusing