Abstract:Communication enables the expansion of human visual perception beyond the limitations of time and distance, while computational imaging overcomes the constraints of depth and breadth. Although impressive achievements have been witnessed with the two types of technologies, the occlusive information flow between the two domains is a bottleneck hindering their ulterior progression. Herein, we propose a novel framework that integrates communication and computational imaging (ICCI) to break through the inherent isolation between communication and computational imaging for remote perception. By jointly considering the sensing and transmitting of remote visual information, the ICCI framework performs a full-link information transfer optimization, aiming to minimize information loss from the generation of the information source to the execution of the final vision tasks. We conduct numerical analysis and experiments to demonstrate the ICCI framework by integrating communication systems and snapshot compressive imaging systems. Compared with straightforward combination schemes, which sequentially execute sensing and transmitting, the ICCI scheme shows greater robustness against channel noise and impairments while achieving higher data compression. Moreover, an 80 km 27-band hyperspectral video perception with a rate of 30 fps is experimentally achieved. This new ICCI remote perception paradigm offers a highefficiency solution for various real-time computer vision tasks.

The Principles and Applications of ICCD

Optical Camera Communication: Principles and Applications

Integrated Circuits for Communications

Research on the Image Processing in InGaAs Near-infrared Camera

Research of CMOS Image Sensor

Modeling and Simulation of LLL Imaging Based on ICCD

Research on X-ray Sensitive ICCD Image Sensor

Application of charge-coupled devices to infrared detection and imaging

Electron multiplying CCD technology: The new ICCD

Comparative research and future tendency between CMOS and CCD image sensor

A Study of the Impact on Telecentricity to the Illumination System Based on Ccd Imaging

Real-time measurement of temperature field with ICCD as sensor (II)

Real-time measurement of temperature field with ICCD as sensor (I)──Principle and method for division of temperature range

Cooled ICCD System for Biochip Detection

Review of research progress and development trend of digital image correlation

The development and application of CMOS image sensor

Key Technologies and Research Development of CMOS Image Sensors

Analysis of MCP gain selection for underwater range-gated imaging applications based on ICCD

The Status and Development Trend of Infrared Image Processing Technology

Integration of Communication and Computational Imaging

Compressive Sensing Theory and Its Application in Imaging Technology