Abstract:This paper presents an FPGA-based lightweight and real-time infrared image processor based on a series of hardware-oriented lightweight algorithms. The two-point correction algorithm based on blackbody radiation is introduced to calibrate the non-uniformity of the sensor. With precomputed gain and offset matrices, the design can achieve real-time non-uniformity correction with a resolution of 640×480. The blind pixel detection algorithm employs the first-level approximation to simplify multiple iterative computations. The blind pixel compensation algorithm in our design is constructed on the side-window-filtering method. The results of eight convolution kernels for side windows are computed simultaneously to improve the processing speed. Due to the proposed side-window-filtering-based blind pixel compensation algorithm, blind pixels can be effectively compensated while details in the image are preserved. Before image output, we also incorporated lightweight histogram equalization to make the processed image more easily observable to the human eyes. The proposed lightweight infrared image processor is implemented on Xilinx XC7A100T-2. Our proposed lightweight infrared image processor costs 10,894 LUTs, 9367 FFs, 4 BRAMs, and 5 DSP48. Under a 50 MHz clock, the processor achieves a speed of 30 frames per second at the cost of 1800 mW. The maximum operating frequency of our proposed processor can reach 186 MHz. Compared with existing similar works, our proposed infrared image processor incurs minimal resource overhead and has lower power consumption.

Field-programmable Gate Array-Based Hardware Architecture for Image Processing with Complementary Metal-Oxide-semiconductor Image Sensor.

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

A wide-spectrum and high-speed CMOS system based on FPGA

Design and implementation of two key image processing techniques for CMOS image sensor based on fpga

Efficient VLSI Architecture for Edge Sensing Anti-Aliasing Demosaicing

Design of On-Chip Image Processing Based on APB Bus with CMOS Image Sensor

Multi-channel high-speed CMOS image acquisition and pre-processing system

Real-time Image Processing System Using FPGA with Hardware Software Collaborative Processing

Design of Image Acquisition and Processing Based on FPGA

Design of CMOS HD Imaging System with Adaptive Dynamic Exposure Control Based on FPGA

FPGA-based Detection Module for the Chromatic Confocal Measurement Sensor

Design of Large-Array CMOS Real-Time Imaging System Based on FPGA

Efficient smart CMOS camera based on FPGAs oriented to embedded image processing

An FPGA-based On-Chip System for Real-Time Single Pixel Imaging.

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

Lightweight and Real-Time Infrared Image Processor Based on FPGA

Color Interpolation Algorithm for Single Chip CIS Using Rolling Exposure

Low Complexity Algorithm and VLSI Design of Joint Demosaicing and Denoising for Digital Still Camera

A real-time high dynamic range intensified complementary metal oxide semiconductor camera based on FPGA

High-speed and high-precision image acquisition system based on FPGA and CIS