Abstract:Programmable processors have great advantage over dedicated ASIC design under intense time-to-market pressure. However, real-time encoding of high-definition (HD) H.264 video (up to 1080p) is a challenge to most existing programmable processors. On the other hand, model-based design is widely accepted in developing complex media program. Stream model, an emerging model-based programming method, shows surprising efficiency on many compute-intensive domains especially for media processing. On the basis, this paper proposes a set of streaming techniques for H.264 encoding, and then develops all of the code based on the X264 reference code. Our streaming H.264 encoder is a pure software implementation completely written in high-level language without special hardware/algorithm support. Real execution results show that our encoder achieves significant speedup over the original X264 encoder on various programmable architectures: on X86 Core TM 2 E8200 the speedup is 1.8x, on MIPS 4KEc the speedup is 3.7x, on TMS320 C6416 DSP the speedup is 5.5x, on stream processor STORM-SP16 G220 the speedup is 6.1x. Especially, on STORM processor, the streaming encoder achieves the performance of 30.6 frames per second for a 1080P HD sequence, satisfying the real-time requirement. These indicate that streaming is extremely efficient for this kind of media workload. Our work is also applicable for other media processing applications, and provides architecture insights into dedicated ASIC or FPGA HD H.264 encoders.

High Definition Endoscope Video Processing System Based on Multi-core Processor

Design of Low Latency Video Processing in High Definition Electronic Endoscope System

High Definition Video Processing System for Medical Electronic Endoscope

High speed video signal acquisition and processing system based on FPGA technique

FPGA-Based Image Processing for Seamless Tiled Display System

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

A 4Kx2K@60fps Multifunctional Video Display Processor for High Perceptual Image Quality

A 4k×2k@60fps Multi-format Multi-function Display Processor for High Perceptual Quality

Real Time Controllable Multi Channel HD Digital Video Processing System Based on FPGA and MicroBlaze

Full High-Definition Real-Time Depth Estimation for Three-Dimensional Video System

A Hardware Design of Video Processing System Based on Processor TMS320DM642

Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

A Real-Time Full HD 2D-to-3d Video Conversion System Based on FPGA

Heterogeneous Multi-core Systems for Video Processing

Design of Large-Array CMOS Real-Time Imaging System Based on FPGA

Design and Implementation of High-Performance Video Processor for Head-Mounted Displays

A 530 Mpixels/s 4096x2160@60fps H.264/AVC High Profile Video Decoder Chip

Streaming HD H.264 Encoder on Programmable Processors.

An efficient methodology for transaction-level design of multi-core h.264 video decoder

A "NEAR-THE-BEST" SYSTEM-LEVEL DESIGN METHODOLOGY OF MULTI-CORE H.264 VIDEO DECODER BASED ON THE PARALLELIZED MULTI-CORE SIMULATOR

Real-time 3D Video System Based on FPGA