Panoramic lens an historical perspective: from sky lens to consumer wide angle freeform optics

Simon Thibault

DOI: https://doi.org/10.1117/12.2603635

2021-11-19

Abstract:Panoramic photography has an old history, mostly because since the beginning of the photography around 1840, we try to capture the world we see. The fascination for Panoramic image was and is still remains today.

What problem does this paper attempt to address?

A Present and Development of Catadioptric Panoramic Stereo Imaging Technique

陈炫屹,白剑

DOI: https://doi.org/10.3969/j.issn.1005-5630.2009.06.018

2009-01-01

Abstract:Catadioptric panoramic stereo imaging technique plays important roles in the applications of machine vision, virtual reality, etc. Catadioptric panoramic stereo imaging technique is based on the catadioptric panoramic imaging technology for large field of view imaging,and the principle of binocular vision to obtain stereo information. In this paper, the present and development of catadioptric panoramic stereo imaging technique is expounded systematically, and the advantages and disadvantages of some important approaches are discussed. Finally, the existing problems and future development in catadioptric panoramic stereo imaging technique are discussed.
Design of Panoramic Stereo Imaging with Single Optical System

Zhi Huang,Jian Bai,Xi Yun Hou

DOI: https://doi.org/10.1364/oe.20.006085

IF: 3.8

2012-01-01

Optics Express

Abstract:A novel panoramic stereo imaging system with double panoramic annular lenses (PAL) is introduced in this paper. The proposed system consists of two coaxial PAL units and images on one sensor. The imaging rings are concentric. The object position can be calculated by triangulation. The novelty of this system is that the central blind zone of one PAL unit is partly used by the other as an image zone. The stereo field of view is 60°~105° × 360°. The depth extracting resolution is about 500 mm at 1line/cm. The F# of the system is about 3, facilitating the system to be applied in low illumination environment. A design is presented and the depth extracting precision is analyzed.
Design of a Panoramic Annular Lens System with an Ultra-Wide Angle Via an Annular Gaussian Radial Basis Function Freeform Surface.

Yingzhe Yang,Jia Wang,Yuejia LI,Jian Bai

DOI: https://doi.org/10.1364/ao.488917

IF: 1.9

2023-01-01

Applied Optics

Abstract:The panoramic annular lens (PAL) system can capture plentiful scene information in real time. The locally described freeform surface can provide more degrees of freedom for the optical system design than the globally described one. In this paper, we propose a locally described annular Gaussian radial basis function freeform surface that enables a high-performance yet compact PAL system. The designed PAL system achieves an ultra-wide field of view (FOV) of (30 degrees similar to 125 degrees) x 360 degrees. The F-theta distortion of the system is less than 3%, and the modulation transfer function across the whole FOV is greater than 0.5 at 100 lp/mm. The proposed system can be implemented for various applications such as video conferencing or robotic navigation.(c) 2023 Optica Publishing Group
A Design Method of the Distortionless Catadioptric Panoramic Imaging Based on Freeform Surface

Wu Yi-si,Li An,Chen Chi,Shen Jun-fei,Bian Yin-xu,Zheng Zhen-rong

DOI: https://doi.org/10.1117/12.2071600

2014-01-01

Abstract:A design method for the distortionless catadioptric panoramic imaging system is proposed in this paper. The panoramic system mainly consists of two parts, a reflecting surface system with relay lens and a CCD camera. A mapping relationship between the real image plane and the projection surface is established to acquires low distorted imaging features easily. And the design of freeform surface is applied to the reflecting surfaces to correct distortion. After iteratively optimize the freeform surfaces, the image quality is gradually improved. The simulation results show that compared with traditional system, the new freeform surface system has simple design, attaining higher performance and has the advantage of small scene distortion and making the image more suitable and convenient for observing.
A Preliminary Study of Panoramic Photography: From Panoramic Painting to Three-dimensional Holographic Image

Huang Qiu-ru

Abstract:Although panoramic photography does not have a long history since its birth,it still presents a unique way of development due to its combination of technology and art.Panoramic painting in the early stage aroused people’s great interest in large visual angle photography.With the development of technology,electronic industry has shown its driving force,which gives new life to photography.When camera equipment keeps improving continuously,computerized image software makes photo-making a magic.New technologies such as threedimensional photo and panoramic photo will bring panoramic photography into a bright future.

Computer Science,Art
Design of High Resolution Panoramic Endoscope Imaging System Based on Freeform Surface

Qun Liu,Jian Bai,Yujie Luo

DOI: https://doi.org/10.1088/1742-6596/680/1/012011

2016-01-01

Journal of Physics Conference Series

Abstract:This paper introduces a novel endoscope design based on the panoramic annular staring imaging technology. This design utilizes a single optical system to realize both panoramic observation and local high resolution on a single sensor. The freeform surface is employed to improve the image quality and reduce system volume. The design results based on the commercial optical design software package ZEMAX, indicate that this optical system is able to acquire an excellent image quality with a modulation transfer function above 0.6. Compared with the traditional ones, this novel endoscope design with wide FOV is likely to decrease the diagnostic time dramatically and improve the lesion detect rate considerably.
Omni-directional Image Unwarping Based on Taylor Model

LEI Jie,DU Xin,ZHU Yunfang,LIU Jilin

2010-01-01

Journal of Image and Graphics

Abstract:Omni-directional camera has attracted more attentions in computer vision community due to its quick wide-angle imaging.But the great distortion makes the post-processing complex,which limits the algorithm applications of classical perspective camera.This paper deduces an unwarping algorithm from arbitrary ring omni-directional image to cylinder panorama based on the Taylor model of omni-directional imaging system.And we also present an unwarping method to produce a novel kind of panorama which is composed of N perspective planer images.Both two reprojection unwarpings do not depend on a particular model or accurate parameters of omni-directional system.In the unwarped panoramas,each pixel is assigned with a light ray in the 3D space,which makes the applications of stereo rectification and 3D reconstruction simple.Finally,the experimental results with the simulations and real data illustrate the validity of the proposed method.
Panoramic Optical Annular Staring Imaging Technology

BAI Jian,NIU Shuang,YANG Guo-guang,HOU Xi-yun

DOI: https://doi.org/10.3969/j.issn.1007-2276.2006.03.019

2006-01-01

Abstract:A panoramic optical annular staring imaging technology was presented,which could be used to image the surrounding 360° scene at one time without rotating the optical system.Imaging characteristics of the panoramic annular lens was analyzed and a design example was given.According to the design,a prototype of the panoramic annular staring optical system had developed and panoramic ring images could be obtained.With digital image processing,the panoramic image could be expanded with self-written software.Potential application of this technology in industry and defense was discussed.
A 360-Degree Panoramic Stereo Scanning Measurement System Based on a Panoramic Annular Lens and Omnidirectional Ring Structured Light

Yao Wang,Chuanwei Yao,Zhonghui Chen,Hengyu Wang,Peng Zhou,Bin Lin

DOI: https://doi.org/10.1016/j.optlaseng.2024.108445

IF: 5.666

2024-01-01

Optics and Lasers in Engineering

Abstract:360-degree panoramic stereo profilometry has been used in many fields for its large field of view. The paper presents a panoramic stereoscopic scanning measurement system leveraging a camera equipped with a panoramic annular lens and an omnidirectional ring-shaped structured light. The ring-shaped structured light assembly comprises a collimated laser, an axicon lens, and a spherical mirror. The system facilitates a 360-degree panoramic stereo scanning measurement by a translation stage movement. Additionally, based on the calibration result of the panoramic annular camera, we propose a calibration algorithm based on the concept of the light cone to calibrate the spatial position of the ring-shaped structured light during the scanning process. Experimental validation demonstrates the calibration and measurement accuracy of the proposed system. The system features simplicity in structure, ease of calibration, and has significant application prospects.
Comparison of Two Panoramic Front Unit Arrangements in Design of A Super Wide Angle Panoramic Annular Lens

Xiangdong Zhou,Jian Bai,Chen Wang,Xiyun Hou,Kaiwei Wang

DOI: https://doi.org/10.1364/ao.55.003219

IF: 1.9

2016-01-01

Applied Optics

Abstract:In this paper, a new panoramic annular lens (PAL) with a super wide angle of (30°-120°)×360° is introduced that consists of two parts: a panoramic front unit (PFU) and a relay lens. First, two PFU arrangements referring to the block structured panoramic front unit (BSPFU) and the shell structured panoramic front unit are compared and analyzed in terms of their field curvature correction ability and structural feasibility for obtaining a wide angle PAL. From the comparison, the BSPFU arrangement turns out to be more promising for its good field curvature correction, structure compactness, and convenience for manufacture and assembly. Second, a relay lens composed of six lenses with three Qbfs aspheres has been designed to match the BSPFU. Finally, image performance analysis of the optimized super wide angle PAL is presented. The results show that the designed PAL equipped with a BSPFU and a Qbfs aspherized relay lens achieves good performance under a super wide field of view of (30°-120°)×360°.
Design of High Resolution Panoramic Annular Lens System

Jia Wang,Xiao Huang,Jian Bai,Kaiwei Wang,Yongxiao Hua

DOI: https://doi.org/10.1117/12.2547629

2019-01-01

Abstract:Panoramic annular lens (PAL) system consists of a panoramic head block unit and a relay lens system, adopting a plane cylindrical projection method to project a cylindrical field of view around the optical axis 360 degrees into a two-dimensional planar annular region to realize super hemispherical imaging. PAL system requires large field of view imaging on a limited image plane, which inevitably results in lower image resolution and poor local detail imaging. However, the information processing speed gets faster with the development of 5G, which leads to a growing demand for better image quality and clarity. This paper presents a PAL system matching image sensors with 4K resolution, which can demonstrate the details about the object and get a smooth and ultra-high definition image. Unlike other sensors, it has large image faces and tiny pixels and the effective number of the pixel is about 24.3 million (4K x 6K). The proposed PAL system has 6 sets of 9 lenses with compact structure. The F-theta distortion of the full field of view is less than 1%, and the modulation transfer function value of each field of view is greater than 0.5 at the Nyquist spatial frequency of 130lp/mm which approaches diffraction limitation. The designed system has good imaging quality and meets the application requirements.
Design of a Panoramic Annular Lens with a Horizontal Symmetric FOV

Yuan Yao,Zhi Huang,Jian Bai,Xi Yun Hou

DOI: https://doi.org/10.1117/12.974921

2012-01-01

Abstract:A new improved design method of the panoramic annular lens (PAL) with aspheric surfaces is introduced. The structure is not only helpful to enlarge the field of view (FOV) of the system, but also help to make a horizontal symmetric field of view. The field of view reaches (-30 degrees-+30 degrees) x 360 degrees and was distortion controlled to reduce blind zone in the center. The field of view and distortion of PAL was investigated theoretically and method of aspheric surface design was also discussed. An aspheric PAL and its relay lens group were designed. The total length was 20.4mm, and the focal length was 0.3mm. To get bright and clear image, the aperture of the system was set to f/2.88, and the diameter was 16.6mm. The spectral range was from 0.486 similar to 0.656um. The relay lens group was consisted of 8 pieces of lenses, with a back focal length (BFL) of 2mm. MTF below 70 lp/mm of the system is above 0.5. The result shows that the aberrations are corrected well.
Research on Image Processing of Two-Dimensional Plan of the Hemispheric Panoramic Imaging System

Hou Huijie,Bai Jian,Yang Guoguang

IF: 0.6

2006-01-01

ACTA PHOTONICA SINICA

Abstract:PAL(Panoramic Annular Lens)was a hemispheric panoramic imaging system based on the principle of FCP(Plat Cylinder Perspective),field range of 360° around the optical axis could be imaged into a annular plane without any kinds of rotatable parts.The image was distorted,thus it was necessary to correct the deviation.An algorithm of correcting the image of a two-dimensional plane was provided based on the principle of FCP,after being treated by radical and tangential linear processes,image of the plane could be corrected into its former shape.
Panoramic lens designed with transformation optics

Huaping Wang,Yangyang Deng,Bin Zheng,Rujiang Li,Yuyu Jiang,Shahram Dehdashti,Zhiwei Xu,Hongsheng Chen

DOI: https://doi.org/10.1038/srep40083

IF: 4.6

2017-01-01

Scientific Reports

Abstract:The panoramic lens is a special kind of lens, which is applied to observe full view. In this letter, we theoretically present a panoramic lens (PL) using transformation optics method. The lens is designed with inhomogeneous and anisotropic constitutive parameters, which has the ability to gather light from all directions and confine light within the visual angle of observer. Simulation results validate our theoretical design.
Review on Panoramic Imaging and Its Applications in Scene Understanding

Shaohua Gao,Kailun Yang,Hao Shi,Kaiwei Wang,Jian Bai

DOI: https://doi.org/10.1109/tim.2022.3216675

IF: 5.6

2022-11-19

IEEE Transactions on Instrumentation and Measurement

Abstract:With the rapid development of high-speed communication and artificial intelligence technologies, human perception of real-world scenes is no longer limited to the use of small Field of View (FoV) and low-dimensional scene detection devices. Panoramic imaging emerges as the next generation of innovative intelligent instruments for environmental perception and measurement. However, while satisfying the need for large-FoV photographic imaging, panoramic imaging instruments are expected to have high resolution, no blind area, miniaturization, and multidimensional intelligent perception and can be combined with artificial intelligence methods toward the next generation of intelligent instruments, enabling deeper understanding and more holistic perception of 360° real-world surrounding environments. Fortunately, recent advances in freeform surfaces, thin-plate optics, and metasurfaces provide innovative approaches to address the human perception of the environment, offering promising ideas beyond conventional optical imaging. In this review, we begin by introducing the basic principles of panoramic imaging systems and then describe the architectures, features, and functions of various panoramic imaging systems. Afterward, we discuss, in detail, the broad application prospects and great design potential of freeform surfaces, thin-plate optics, and metasurfaces in panoramic imaging. We then provide a detailed analysis of how these techniques can help enhance the performance of panoramic imaging systems. We further offer a detailed analysis of applications of panoramic imaging in scene understanding for autonomous driving and robotics, spanning panoramic semantic image segmentation, panoramic depth estimation, panoramic visual localization, and so on. Finally, we cast a perspective on future potential and research directions for panoramic imaging instruments.

engineering, electrical & electronic,instruments & instrumentation
Variable Aperture Panoramic Imaging

Jing Lv,Qiang Zhao,Feng Dai,Yike Ma,Yongdong Zhang

DOI: https://doi.org/10.1007/s11042-018-5884-x

IF: 2.577

2018-01-01

Multimedia Tools and Applications

Abstract:Panoramic imaging has important applications in virtual reality. Current panoramic imaging only can create a 360 ∘ panorama but cannot change the focal surface or support depth cues. In this paper, we present a variable aperture panoramic imaging method based on a two-sphere panorama model (TSPM). Based on this model, we propose a definition of Aperture for TSPM, which can precisely control the depth of field (DOF) of panoramas. With same aperture size and focus distance, two similar panoramas could be synthesized from a range of capture camera configurations. Extensive experiments have been carried out to validate our panoramic imaging method.
Panoramic View Creation using Image Processing

Anmol Raju Deshmukh

DOI: https://doi.org/10.22214/ijraset.2023.53555

2023-06-30

International Journal for Research in Applied Science and Engineering Technology

Abstract:Abstract: The method of integrating many photographs with overlapping fields of view to create a segmented panorama or highresolution image is known as image stitching or photo stitching. The term "stitching" refers to the process of utilising a computer to combine small images into a larger one, ideally without leaving any trace that it was produced artificially. Among the first and most popular in computer vision are algorithms for aligning images and creating seamless photomosaics. The high quality photomosaics utilised to construct today's digital maps and satellite images are made using image stitching algorithms. They may be used to produce stunning extreme wide-angle panoramas and are included with the majority of digital cameras on the market and satellite imagery.
Principles and characteristics of panoramic annular lens

DaoYi Wang,Dawei Huang,Minxian Wu,Yingbai Yan,Guopan Jing

1998-01-01

Guangxue Jishu/Optical Technique

Abstract:Beginning with analysis of traditional central perspective, the basic concept of flat cylinder perspective (FCP) was introduced and the working principles of panoramic annular lens (PAL) were discussed. One of the optical elements of FCP can be realized. PAL has many important characteristics such as linear perspective, direction selection and infinite depth of field. A PAL with diameter of 34mm was designed through optimizing. Simulating calculation proves the characteristics mentioned above.
Multi-Viewpoint Panorama Construction with Wide-Baseline Images

Guofeng Zhang,Yi He,Weifeng Chen,Jiaya Jia,Hujun Bao

DOI: https://doi.org/10.1109/tip.2016.2535225

IF: 10.6

2016-01-01

IEEE Transactions on Image Processing

Abstract:We present a novel image stitching approach, which can produce visually plausible panoramic images with input taken from different viewpoints. Unlike previous methods, our approach allows wide baselines between images and non-planar scene structures. Instead of 3D reconstruction, we design a mesh-based framework to optimize alignment and regularity in 2D. By solving a global objective function consisting of alignment and a set of prior constraints, we construct panoramic images, which are locally as perspective as possible and yet nearly orthogonal in the global view. We improve composition and achieve good performance on misaligned areas. Experimental results on challenging data demonstrate the effectiveness of the proposed method.

Panoramic lens an historical perspective: from sky lens to consumer wide angle freeform optics

A Present and Development of Catadioptric Panoramic Stereo Imaging Technique

Design of Panoramic Stereo Imaging with Single Optical System

Design of a Panoramic Annular Lens System with an Ultra-Wide Angle Via an Annular Gaussian Radial Basis Function Freeform Surface.

A Design Method of the Distortionless Catadioptric Panoramic Imaging Based on Freeform Surface

A Preliminary Study of Panoramic Photography: From Panoramic Painting to Three-dimensional Holographic Image

Design of High Resolution Panoramic Endoscope Imaging System Based on Freeform Surface

Omni-directional Image Unwarping Based on Taylor Model

Panoramic Optical Annular Staring Imaging Technology

A 360-Degree Panoramic Stereo Scanning Measurement System Based on a Panoramic Annular Lens and Omnidirectional Ring Structured Light

Comparison of Two Panoramic Front Unit Arrangements in Design of A Super Wide Angle Panoramic Annular Lens

Design of High Resolution Panoramic Annular Lens System

Design of a Panoramic Annular Lens with a Horizontal Symmetric FOV

Research on Image Processing of Two-Dimensional Plan of the Hemispheric Panoramic Imaging System

Panoramic lens designed with transformation optics

Review on Panoramic Imaging and Its Applications in Scene Understanding

Variable Aperture Panoramic Imaging

Panoramic View Creation using Image Processing

Principles and characteristics of panoramic annular lens

Multi-Viewpoint Panorama Construction with Wide-Baseline Images