Abstract:With the rapid development of high-speed communication and artificial intelligence technologies, human perception of real-world scenes is no longer limited to the use of small Field of View (FoV) and low-dimensional scene detection devices. Panoramic imaging emerges as the next generation of innovative intelligent instruments for environmental perception and measurement. However, while satisfying the need for large-FoV photographic imaging, panoramic imaging instruments are expected to have high resolution, no blind area, miniaturization, and multidimensional intelligent perception and can be combined with artificial intelligence methods toward the next generation of intelligent instruments, enabling deeper understanding and more holistic perception of 360° real-world surrounding environments. Fortunately, recent advances in freeform surfaces, thin-plate optics, and metasurfaces provide innovative approaches to address the human perception of the environment, offering promising ideas beyond conventional optical imaging. In this review, we begin by introducing the basic principles of panoramic imaging systems and then describe the architectures, features, and functions of various panoramic imaging systems. Afterward, we discuss, in detail, the broad application prospects and great design potential of freeform surfaces, thin-plate optics, and metasurfaces in panoramic imaging. We then provide a detailed analysis of how these techniques can help enhance the performance of panoramic imaging systems. We further offer a detailed analysis of applications of panoramic imaging in scene understanding for autonomous driving and robotics, spanning panoramic semantic image segmentation, panoramic depth estimation, panoramic visual localization, and so on. Finally, we cast a perspective on future potential and research directions for panoramic imaging instruments.

Reconnaissance Technology about Reflective Panoramic Vision for Unmanned Platform

Research of reconnaissance technology about reflector based panoramic vision for unmanned platform

A Present and Development of Catadioptric Panoramic Stereo Imaging Technique

Research on high resolution & high sensitivity panoramic surveillance system

PAR<SUP>2</SUP>Net: End-to-End Panoramic Image Reflection Removal

Panoramic Image Reflection Removal

Real-Time Panoramic System for Underwater Cleaning Robot

Capture Of Vehicle Surroundings Using A Pair Of Panoramic Annular Lens Cameras

Panoramic Three-Dimensional Optical Digitization System Assisted by a Bi-Mirror.

Design of a single-sensor gazing panoramic stereo imaging system with no central blind area

Unwrapping and Stereo Rectification for Omnidirectional Images

Research on Design, Calibration and Real-Time Image Expansion Technology of Unmanned System Variable-Scale Panoramic Vision System

Research on Multispectral 3D Panoramic Vision Device

Panoramic SAR Imaging System for Unmanned Ground Vehicles

Ultra-wide angle panoramic imaging system based on a multiplexed reflective surface

Review on Panoramic Imaging and Its Applications in Scene Understanding

Design and Realization of Multi-viewpoint Catadioptric Omnidirectional Imaging System

Panoramic 3D Reconstruction by Fusing Color Intensity and Laser Range Data

Design and Implementation of the UAV Reconnaissance System