An Encoded Photodetector Array for High-frame-rate Compressed Sensing and Computational Imaging

Wen Pan,Zhaolong Yang,Zhibiao Hao,Changzheng Sun,Bing Xiong,Jian Wang,Yanjun Han,Hongtao Li,Lin Gan,Yi Luo,Lai Wang
DOI: https://doi.org/10.1109/jsen.2024.3506937
IF: 4.3
2024-01-01
IEEE Sensors Journal
Abstract:Modern imaging technology, by exposure and subsequent readout from image sensors, has limited the existing frame rate in real-time scenes. In this article, we present an architecture based on computing in sensor array that can achieve higher frame rates than conventional cameras. This approach fuses the architecture with neural network algorithms for compressed sensing and computational imaging. It achieves a mean squared error of 10 −2 with fewer weights and sampling numbers (10%~40% of original data). It samples lower data to reconstruct images through fast recovery with an elapsed time of hundred microseconds. The feasibility has been verified through the encoded photodetector array chip consisting of 16×16 dual-gate silicon photodiodes. This type of chips represents a highly promising technology for constructing image sensors that delivers high-speed imaging capability of >10000 fps, which may also show potential superiority in terms of noise resistance and dynamic range.
What problem does this paper attempt to address?