Abstract:Block-based compressive image sensor (BCIS) captures light and represents them as compressed data called measurement. It has potential to revolutionize conventional image and video acquisition system that builds upon high complexity and redundant process. However, by comparing the compression performance between these two systems, BCIS cannot reduce bitrate to similar factor as the compressed media by pixel-based compression algorithms. It still requires enormous amounts of bit to store and transmit data. In this work, we introduce intra prediction based measurement coding algorithm for giving an extra compression performance to measurement. Moreover, importantly, there is a requirement that sensing matrix for BCIS must not be derived from non-uniform distribution in order to control prediction accuracy and quality. Therefore, we use structural sensing matrix made of sequency-ordered Walsh-Hadamard. Furthermore, it allows boundary pixels of adjacent blocks to be accessible through measurement, which helps intra prediction to generate its candidates accurately. The algorithm encodes prediction error between target measurement and multiple prediction candidates, resulting in smaller data size. This work can significantly reduce bpp by 10.90% and simultaneously increase 3.95 dB in PSNR compared to the state-of-the-art works. Moreover, we implemented the proposal on FPGA. It gave 10 times higher throughput than software. The core power consumption is at 50 mW and working at 88 MHz when processing $3840\times2160$ pixels with the sampling rate of 1/4.

A compact digital pixel sensor architecture using predictive coding scheme

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

Architecture of a digital pixel sensor array using 1-bit Hilbert predictive coding

Architecture of a Low Storage Digital Pixel Sensor Array with an On-Line Block-Based Compression.

Digital Pixel Sensor with On-Line Spatial and Temporal Compression Scheme

Block-based compressive sampling for digital pixel sensor array

Compressive Acquisition CMOS Image Sensor: from the Algorithm to Hardware Implementation

Compressive Acquisition CMOS Image Sensor Using On-Line Sorting Scheme

14-Bit Column Readout Circuits with Single-to-differential PGA Using Intentional Offset and Two-Step Scaled-Reference SAR ADC for CMOS Image Sensors

Image Acquisition System Using On Sensor Compressed Sampling Technique

Architecture of a Digital Pixel Sensor Array with Tile-Based Vector Quantization Image Compression Algorithm

Quadrant-Based Online Spatial and Temporal Compressive Acquisition for CMOS Image Sensor

Data Compression for Image Sensor Arrays Using a 15-Bit Two-Step Sigma–Delta ADC

Design of a digital pixel image sensor array with adaptive quantization and pseudo Huffman coding

Pixel-level A/D Conversion Using Voltage Reset Technique

A 51-Pj/pixel 33.7-Db PSNR 4× Compressive CMOS Image Sensor with Column-Parallel Single-Shot Compressive Sensing

Low-power In-pixel Computing with Current-modulated Switched Capacitors

Design of Scalable Hardware-Efficient Compressive Sensing Image Sensors

A Review on Digital Pixel Sensors

Intra Prediction-Based Measurement Coding Algorithm for Block-Based Compressive Sensing Images

An Encoded Photodetector Array for High-frame-rate Compressed Sensing and Computational Imaging