Abstract:Digital video stabilization is an important video enhancement technology that aims to remove unwanted camera vibrations from video sequences. Trading off between stabilization performance and real-time hardware implementation feasibility, this paper presents a feature-based full-frame video stabilization method and a novel complete fully pipelined architectural design to implement it on field-programmable gate array (FPGA). In the proposed method, feature points are first extracted with the oriented features from accelerated segment test and rotated binary robust independent elementary features algorithm and matched between consecutive frames. Next, the matched point pairs are fitted to the affine transformation model using a random-sample consensus-based approach to estimate inter-frame motion robustly. Then, the estimated results are accumulated to compute the cumulative motion parameters between the current and reference frames, and the translational components are smoothed by a Kalman filter representing intentional camera movement. Finally, a mosaicked image is constructed based on cumulative motion parameters using an image mosaicking technique, and then a display window is created with the desired frame size according to the computed intentional camera movement to obtain a full motion-compensated frame. Using pipelining and parallel processing strategies, the whole process has been designed using a novel complete fully pipelined architecture and implemented on Altera's Cyclone III FPGA to build a real-time stabilization system. The experimental results have shown that the proposed system can deal with standard PAL video input including arbitrate translation and rotation and can produce full-frame stabilized output providing a better viewing experience at 22.37 ms/frame, thus achieving real-time processing performance.

Design of electronic image stabilization processing system based on DSP and FPGA

Design and Implementation of Visual Processing System Based on FPGA

Design and Implementation of Electronic Image Stabilization System Based on Dual-Core DSP

High speed video signal acquisition and processing system based on FPGA technique

Hardware Design for Image-Stabilization System

FPGA-based Design of Real-time Video Processing Platform

Real-time Image Processing System Using FPGA with Hardware Software Collaborative Processing

Real-Time Feature-Based Video Stabilization on Fpga

Design and Implementation of Digital Image Processing Algorithm Evaluation System Based on DSP + FPGA+USB2.0 Architecture

Design of Real-time Infrared Image Processing System Based on FPGA and DSP Framework

Design of real-time image acquisition and processing platform based on DSP and FPGA

Design and Implementation of Real-time Image Processing System Based on FPGA and DSP

Design of A High-speed Infrared Image Processing Platform Based on the Multi-core DSP and FPGA

Design of Image Acquisition and Processing Based on FPGA

A Real-time Video Processing System Based on FPGA and DSP

Dual-Channel Image Real-Time Processing System Based on FPGA

Design of High-speed Image Processing Platform Based on FPGA

Real-time video processing model for stereoscopic display system based on FPGA

Design of Video Processor Based on the PowerPC + FPGA

An Embedded System for Short Wave Infrared Image Enhancement and 3G-SDI Display

Design and realization of panoramic image processing system based on DSP and FPGA