Real Time Bayer Raw Video Projective Transformation System Using FPGA

Yongwen Zhuang,Dongmei Li
DOI: https://doi.org/10.1109/isvlsi49217.2020.00081
2020-01-01
Abstract:This paper describes a mesh-based real-time video stream projective transformation processing system. Projective transformation requires both matrix multiplication and division, which brings great challenges to hardware implementation. To reduce the complexity of hardware, the division in projective transformation is converted into multiplication. The processing system is performed on the Bayer raw picture before demosaicing right after the camera sensor. By buffering a fixed number of lines, the delay between input and output is fixed and predictable, and the system is more easily solidified on the chip. This design is implemented on Xilinx Zynq-7000 XC7Z045 SOC as a real-time system with the capability of processing 4k Bayer raw video streams.
What problem does this paper attempt to address?