Algorithm Optimization and Implementation with Custom Instruction of H.264 Integer Transform and Quantization

DU Xue-liang,JIN Xi
2009-01-01
Abstract:A high performance implementation plan with custom instruction of H.264's integer transform algorithm which is based on DCT and quantization algorithm is proposed,through analyzing computation complexity of integer transform and quantization,optimizing scheduling algorithm and reducing stages of critical path,integer transform,inverse transform,quantization and de-quantization algorithms are all implemented with custom instructions.Code and decode algorithms all passed the function test.The design used 12021 NAND gates in UMC's 0.13μm technology.The result of tests with JVT's reference test bit stream demonstrates that,the design fully supports 30fps demand of VGA under 200MHz clock frequency,custom instruction implementation can give flexibility and achieve real time processing goals.
What problem does this paper attempt to address?