FPGA realization of video enhancement algorithm in industrial monitoring

LIU Ze,WANG Wen

DOI: https://doi.org/10.3969/j.issn.0258-7998.2008.09.025

2008-01-01

Abstract:A kind of video enhancement algorithm is realized in FPGA by using Verilog HDL.Accessory functions including Video eodec control,SRAM access control and ehroma space transform are also implemented.Parameters of the algorithm are opti- mized by simulation using Madab.

What problem does this paper attempt to address?

Design and Implementation of Visual Processing System Based on FPGA

Liang SHAO,Xin DU,Zhuo-yu YING,Wei-kang GU

DOI: https://doi.org/10.3969/j.issn.1004-1699.2005.01.016

2005-01-01

Abstract:Studied in accordance with computer vision system, this article puts forward the major problems existing in the hardware embodying levels of vision system. Then it explores new ideas in resolving these problems, and puts forward a vision processing system based on FPGA in the need of stereo vision system. As FPGA can be reconstructed freely, it can take charge of some computing work to strengthen the real time issue of visual processing. The system can be well applied to 3-D stereo vision system as a front-end graphic grabbing device and co-processor.
High speed video signal acquisition and processing system based on FPGA technique

Dongming Lu,Qian Chen,Kefeng Weng,Aifeng Zhang

DOI: https://doi.org/10.1109/ICNNSP.2003.1281093

2003-01-01

Abstract:In the past few years, there has been significant progress in the communications and computer technology, which requires stable, clear video image display. On the other hand, conventional analog video processing method, due to its intrinsic limitations, can not meet the requirement of high quality and high speed operation. Meanwhile, the digital video processing technique that integrates with the computer technology is growing rapidly. In this paper, we introduce the art of FPGA (Field Programmable Gate Array) that has been widely used for video signal processing, and develop the video signal acquisition and processing system that based on FPGA, thereby achieve real-time video signal acquiring, processing, and transferring.
Live Video Analytics with FPGA-based Smart Cameras

Shang Wang,Chen Zhang,Yuanchao Shu,Yunxin Liu

DOI: https://doi.org/10.1145/3349614.3356027

2019-01-01

Abstract:Analyzing video feeds from large camera networks requires enormous compute and bandwidth. Edge computing has been proposed to ease the burden by bringing resources to the proximity of data. However, the number of cameras keeps growing and the associated computing resources on edge will again fall in short. To fundamentally solve the resource scarcity problem and make edge-based live video analytics scalable, we present an FPGA-based smart camera design that enables efficient in-situ streaming processing to meet the stringent low-power, energy-efficient, low-latency requirements of edge vision applications. By leveraging FPGA's intrinsic properties of architecture efficiency and exploiting its hardware support for parallelism, we demonstrate a 49x speedup over CPU and 6.4x more energy-efficiency than GPU, verified using a background subtraction algorithm.
FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

Xiaoyan XIE,Yuting ZHANG,Zhentao LIU

DOI: https://doi.org/10.3969/j.issn.1006-7167.2018.01.023

2018-01-01

Abstract:Aiming at the problems that the image processing system in the field of machine vision has high real-time requirement,and the traditional FPGA design needs long development cycle,but high level synthesis (HLS) provides a new way to accelerate the machine vision algorithm.Based on ZC706 development Platform and SDSoC development environment of Xilinx,this paper uses some optimization methods such as pipeline,loop unrolling,parallelism,line buffer and window buffer co-processing to realize hardware acceleration of the Sobel edge detection and Harris corner detection algorithm,which are widely used in the machine vision field.The experimental results show that the speed-up ratios of FPGA implementation based on HLS method for Sobel and Harris can reach 7.37 and 19.41,respectively,compared with software implementation in ARM platform.It can meet the requirements of real-time performance in the field of machine vision.
FPGA Implementation of Non-Parametric Stereo Matching Algorithm

XU Yan-hong,ZHU Yun-fang,DU Xin,LIU Ji-lin

DOI: https://doi.org/10.3785/j.issn.1008-973x.2009.02.011

2009-01-01

Abstract:A solution of stereo matching and hardware architecture based on field programmable gate array(FPGA) was presented to meet the requirement of real-time stereo vision in the unmanned vehicle navigation.A non-parametric algorithm CENSUS was used for stereo matching,overcoming the drawback of traditional methods under the situation of illumination unbalance between stereo cameras.This algorithm requires only simple operations and is suitable for FPGA implementation.Proper pipelines were elaborately designed to improve the capability of the parallel data processing and large data flow.This solution was tested by the synthesized and real data on a stereo vision system.The matching process could be accomplished in 15 ms.The results show that the proposed implementation is fast and robust.
Media SOC Verification Framework Based on FPGA Platform

ZHOU Jian,LIU Peng,CHEN Ke-ming,Mei You-liang

DOI: https://doi.org/10.3969/j.issn.1004-3365.2006.03.008

IF: 1.992

2006-01-01

Microelectronics Journal

Abstract:To meet different requirements of co-simulation and co-verification,a verification framework based on FPGA platform for media SOC is proposed.A hierarchical design method was adopted to make the software reconfigurable.Using improved bus structure method for multimedia processing,reconfigurable and reusable hardware platform was realized.A verification platform based on the framework for an audio decoder SOC has been established and 128 kbps,44.1 kHz stereo AAC LC can be decoded in real-time.
Improved real-time correlation-based FPGA stereo vision system

JingTing Ding,Xin Du,Xinhuan Wang,Jilin Liu

DOI: https://doi.org/10.1109/ICMA.2010.5588008

2010-01-01

Abstract:In this paper, we describe the design and implementation of Field Programmable Gate Array (FPGA) based stereo vision system. Implementation of correlation-based algorithm is well designed to exploit the parallelism in FPGA. The system is capable of running at more than 70 frames per second with 512x512 images. To improve the inherent weakness of simple correlation-based algorithm, two methods have been added. The multi-window approach improves disparity quality at object borders and cross checking reduces possible errors in general. The experimental comparison shows the improvement on final results. © 2010 IEEE.
Design of a Video Processor Based on FPGA

Zhang Qi-gui,Zhang Bo,Zhang Gang

DOI: https://doi.org/10.4028/www.scientific.net/amr.429.190

2012-01-01

Advanced Materials Research

Abstract:The design of a kind of video processor with the function of auto-focusing is introduced in this paper. The video processor receives digital 8-bit YCbCr video signal. With a piece of DDR2 SDRAM as frame buffer, the video processor realizes the function of format conversion, frame up-scaling and color space conversion. The paper proposes an improved gray scale differential auto-focus algorithm and calculates the focus value of the current image real-timely. Applying the mountain climbing searching strategy to control the moving of the focus motor, and realize the function of auto-focusing. The whole design is realized in VHDL and verified with Xilinx XUPV5-LX110T FPGA developing board.
FPGA implementation of full HD real-time depth estimation

Hejian Li,Ping An,Guowei Teng,Zhaoyang Zhang

DOI: https://doi.org/10.1109/ICCE-Berlin.2014.7034325

2014-01-01

Abstract:Depth estimation is a common task in stereo vision system and usually requires a high computational effort. High resolution images offer more details compared to low resolution images and high resolution depth maps are necessary to provide a good image quality on autostereoscopic displays which deliver stereo content without the need for 3D glasses. In this paper, a FPGA architecture for depth estimation is proposed, that is capable of processing full HD content with processing speed of 125fps and a disparity search range of 240 pixels. The resulting architecture is efficient in terms of power consumption and overall performance improvement.
High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

Feng Zhou,Zhiqiang Chen,Qingsheng Xie,Fanzi Kong,Yaohong Chen,Huawei Wang

DOI: https://doi.org/10.1117/1.oe.63.2.023103

IF: 1.3

2024-02-15

Optical Engineering

Abstract:Image detail enhancement is critical to the performance of short-wave infrared (SWIR) imaging systems. Recently, the requirement for real-time processing of high-definition (HD) SWIR video has shown rapid growth. Nevertheless, the research on field programmable gate array (FPGA) implementation of HD SWIR streaming video processing architecture is relatively few. This work proposes a real-time FPGA architecture of SWIR video enhancement by combining the difference of Gaussian filter and plateau equalization. To accelerate the algorithm and reduce memory bandwidth, two efficient key architectures, namely edge information extraction and equalization and remapping architecture, are proposed to sharpen edges and improve dynamic range. The experimental results demonstrated that the proposed architecture achieved a real-time processing of 1280 × 1024@60Hz with 2.7K lookup tables, 2.5K Slice Reg, and about 350 kb of block RAM consumption, and their utilization reached 12.5%, 19.2%, and 12.5% for the XC7A200T FPGA board, respectively. Moreover, the proposed architecture is fully pipelined and synchronized to the pixel clock of output video, meaning that it can be seamlessly integrated into diverse real-time video processing systems.

optics
Real-time video processing model for stereoscopic display system based on FPGA

Kang Ning,Wang Yuanqing,Zhang Zhaoyang,Fan Kefeng

DOI: https://doi.org/10.1109/ICoSP.2012.6491693

2012-01-01

Abstract:A video processing model is presented which is designed for real-time stereoscopic display system based on Field Programmable Gate Array (FPGA). The system makes use of image parallax theory and combines some high speed system design technologies. The hardware platform includes image acquisition, processing and display parts. Viewers need a pair of stereo glasses to experience stereoscopic display technology. This design is verified and has some applicable fields. It features real-time, low-cost and easy-feasibility and fills in a gap of displaying high definition timely stereoscopic image with high refresh rate Liquid Crystal Display (LCD) panel.
FPGA-Based Real-Time Super-Resolution System for Ultra High Definition Videos

Zhuolun He,Hanxian Huang,Ming Jiang,Yuanchao Bai,Guojie Luo

DOI: https://doi.org/10.1109/FCCM.2018.00036

2018-01-01

Abstract:The market benefits from a barrage of Ultra High Definition (Ultra-HD) displays, yet most extant cameras are barely equipped with Full-HD video capturing. In order to upgrade existing videos without extra storage costs, we propose an FPGA-based super-resolution system that enables real-time Ultra-HD upscaling in high quality. Our super-resolution system crops each frame into blocks, measures their total variation values, and dispatches them accordingly to a neural network or an interpolation module for upscaling. This approach balances the FPGA resource utilization, the attainable frame rate, and the image quality. Evaluations demonstrate that the proposed system achieves superior performance in both throughput and reconstruction quality, comparing to current approaches.
A Real-Time Full HD 2D-to-3d Video Conversion System Based on FPGA

Shao-Jun Yao,Liang-Hao Wang,Dongxiao Li,Ming Zhang

DOI: https://doi.org/10.1109/icig.2013.157

2013-01-01

Abstract:The 2D to 3D conversion technique plays an important role in the development and promotion of three-dimensional television (3DTV), because it can provide adequate supply of high-quality 3D program content. This Paper focuses on the real-time implementation of 2D-3D system, of which the major parts are source depth-map generation and depth image-based rendering (DIBR). The depth-map is generated by multi-depth cues, according to the types of the 2D scene, including luminance and color, visual saliency and adaptive depth models. Then the original 2D image or video is converted to stereoscopic one by DIBR with the depth map. The proposed system is accelerated by being designed in new hardware architecture on FPGA. Our method is verified on various sequences and experiment results show that, the system can achieve 30 frames per second for processing full HD (1920×1080) video on Xilinx Virtex IV XC4VSX25 while the resulting image or video is both realistic and visual pleasing.
An Embedded System for Short Wave Infrared Image Enhancement and 3G-SDI Display

Xin Zhang,Hui Liu,Xiangwei Li

DOI: https://doi.org/10.1117/12.2644212

2022-01-01

Abstract:According to the actual requirements of real-time target tracking processing and display of short wave infrared camera with CameraLink interface, an embedded image processing system based on FPGA is designed. The LVDS and GTX ports of FPGA are used to realize CameraLink interface and 3G-SDI interface, it not only improves the integration of the system, but also saves the cost. The adaptive dual platform histogram equalization algorithm is adopted and implemented, which effectively improves the display effect and subsequent processing quality of short wave infrared image. The paper briefly analyzes the algorithm principle of adaptive dual platform histogram, puts forward the adaptive calculation method of dual platform value, studies the implementation method of the algorithm based on Xilinx's FPGA, and gives the solutions of key modules such as adaptive dual platform histogram equalization, image enlarge and 3G-SDI display in FPGA. The experimental results show that the designed embedded image processing system gives consideration to real-time and effectiveness, and realizes the functions of image amplification and high-definition display; The algorithm can calculate and adjust the upper and lower platform values of the histogram in real time according to the scene within 400 mu s, effectively enhance the contrast of the image and suppress the background noise. The system has the advantages of strong algorithm adaptability, simple implementation, high integration and low power consumption. It can also be effectively applied to the image acquisition, processing and display of medium wave and long wave infrared cameras.
Design of H.264/AVC Video Coder Based on Mixed Architecture

ZHANG Wei-bing,LI Xian-hua,SHI Xu-li,TENG Guo-wei,ZHANG Zhao-yang

DOI: https://doi.org/10.3969/j.issn.1002-8692.2007.10.010

2007-01-01

Abstract:A design and implementation method of H.264/AVC encoder based on mixed structure is introduced,in which DSP is used as a main processor and FPGA as an assistant processor to accelerate arithmetic by hardware. In order to meet required real-time performance,hardware engine is designed for the most complicated and time-consuming module. According to the engine,it constitutes a software and hardware communication agreement,which makes control and data transporting easily,and realizes the real-time performances which H.264/AVC D1 coder needs.
Design and Implementation of an Improved Unsharp Masking Real-Time Image Enhancement Method Based on FPGA

Hao Yukun,Yu Feihong

DOI: https://doi.org/10.1117/12.2579738

2020-01-01

Abstract:The unsharp masking algorithm is an effective method for image spatial domain enhancement. The improved unsharp masking algorithm can achieve the sharpening effect of edge enhancement while suppressing noise. However, it is difficult to implement in real-time image processing systems due to the need to perform multiple spatial domain filtering and a large amount of calculation. In this paper, an improved unsharp masking image enhancement algorithm is implemented on FPGA. Compared with the software implementation, time optimization has been carried out to meet the requirements of real-time processing of video streams, and it can achieve edge enhancement while suppressing noise to meet the performance needs of real-time video processing.
Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

Hejian Li,Ping An,Guowei Teng,Yifan Zuo,Zhaoyang Zhang

DOI: https://doi.org/10.2991/acta-14.2014.16

2014-01-01

Abstract:This paper presents a novel implementation for real-time depth estimation which can support full HD resolution for 3D video stream. We propose a package of solution to address the major difficulties in depth estimation, such as expensive computation, depth accuracy, real-time implementation and high definition progressing. Different from the typical single stereo vision methods, we take fusion strategy which can reduce errors caused by individual measure. The FPGA-based design is selected for real-time implementation which can achieve the maximum processing speed of 125fps, with maximum disparity search range of 240 pixels, full HD (1920 x 1080p) resolution image. Multi-resolution method which includes interpolation method and synthesizers are used for improve the efficiency and stability. The implementation can be included in video system for live 3DTV application and can be used as an independent hardware module in low-power application.
FPGA Implementation and Verification System of H.264/AVC Encoder for HDTV Applications

teng wang,chihkuang chen,qihua yang,xinan wang

DOI: https://doi.org/10.1007/978-3-642-30223-7_54

2012-01-01

Abstract:For huge systems like video processing, FPGA prototyping plays an important role before taping out. In this paper, a verification system for H.264/AVC encoders with FPGA prototyping is proposed and implemented. An H.264 encoder with baseline profile of Level 3.2 was carried out with a clock frequency of 200MHz on a Xilinx Virtex-6 FPGA connected with DDR3 memory, which could satisfy real-time encoding for HDTV applications (720P@60fps) with a PSNR around 34 db. The encoder was finally implemented with SMIC 65nm CMOS technology for silicon verification.
High Efficiency Vlsi Implementation of an Edge-Directed Video Up-Scaler Using High Level Synthesis

Meng Li,Peng Zhang,Chuang Zhu,Huizhu Jia,Xiaodong Xie,Jason Cong,Wen Gao

DOI: https://doi.org/10.1109/icce.2015.7066333

2015-01-01

Abstract:Image scaling is a fundamental algorithm used in a large range of digital image applications. In this paper, we propose an efficient VLSI architecture for a novel edge-directed linear interpolation algorithm. Our VLSI design is implemented using high level synthesis (HLS) tool, which generates RTL modules from C/C++ functions. HLS provides significantly improved design productivity compared to the traditional RTL-based design flow. So we explored a large design space including several fine-grained and coarse-grained optimizations in the pipeline architecture design. Our architecture is verified in a working system based on Xilinx Kintex-7 FPGA. Experiments show that our design can process UHD (3840* 2160) videos at 30fps with moderate resource utilization.
Real Time Controllable Multi Channel HD Digital Video Processing System Based on FPGA and MicroBlaze

Lei Sun,EnChang Sun,YaPing Yu

DOI: https://doi.org/10.1145/3467707.3467734

2021-04-23

Abstract:In order to realize the real-time processing and display control of multi-channel high-definition digital video, this paper proposes an embedded solution for real-time processing of multi-channel high-definition digital video based on FPGA (Field Programmable Gate Array). The overall system design includes three parts: hardware platform design with MicroBlaze as the core controller, software application design and OSD (On Screen Display) display control design. The system proposed in this paper implements the encoding, decoding, scaling and overlay of multiple high-definition video streams in a single FPGA embedded with MicroBlaze, which improves the system integration. Through the design of the OSD control layered architecture, the information interaction between the keystrokes and the OSD image interface is realized, and four video display parameters can be configured on the screen. Experiments show that the system proposed in this paper can process and display four high-definition video streams in real time, with an output frame rate of 60 frames/s. Compared with the current mainstream video fusion system solutions, the system integration level has been improved.

FPGA realization of video enhancement algorithm in industrial monitoring

Design and Implementation of Visual Processing System Based on FPGA

High speed video signal acquisition and processing system based on FPGA technique

Live Video Analytics with FPGA-based Smart Cameras

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

FPGA Implementation of Non-Parametric Stereo Matching Algorithm

Media SOC Verification Framework Based on FPGA Platform

Improved real-time correlation-based FPGA stereo vision system

Design of a Video Processor Based on FPGA

FPGA implementation of full HD real-time depth estimation

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

Real-time video processing model for stereoscopic display system based on FPGA

FPGA-Based Real-Time Super-Resolution System for Ultra High Definition Videos

A Real-Time Full HD 2D-to-3d Video Conversion System Based on FPGA

An Embedded System for Short Wave Infrared Image Enhancement and 3G-SDI Display

Design of H.264/AVC Video Coder Based on Mixed Architecture

Design and Implementation of an Improved Unsharp Masking Real-Time Image Enhancement Method Based on FPGA

Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

FPGA Implementation and Verification System of H.264/AVC Encoder for HDTV Applications

High Efficiency Vlsi Implementation of an Edge-Directed Video Up-Scaler Using High Level Synthesis

Real Time Controllable Multi Channel HD Digital Video Processing System Based on FPGA and MicroBlaze