Abstract:Summary form only given. Future automotive security systems will benefit from visual scene analysis based on a fusion of video, infrared, and radar images. Today we have already functions like lane departure warning and automatic cruise control (ACC) for pretty well defined driving environments, such as highways and primary roads. Recent research activities concentrate on more complex environments, such as city traffic with a wide variety of traffic participants moving in an unpredictable manner, e.g. bikes, pedestrians, children, and even animals, and under changing weather and lighting conditions. The ITRS semiconductor roadmap for microelectronics forecasts a continued doubling of transistor capacity per chip every 2 to 2.5 years enabling billion transistor ASIC designs in the near future. Multi processor system on chip (MPSoC) solutions with 8, 16 or even more standard RISC CPU cores, mega-bytes of fast (ns access latencies) on-chip SRAM memories, giga-byte per second interconnect buses or NoC (network on chip) meshes, high-speed serial I/Os and, last but not least, million gate equivalent dedicated hardware accelerator functions in eFPGA (embedded field programmable gate array) logic are becoming reality on a single silicon substrate. Examples of current research projects shall illustrate our perception on how this tremendous increase in functionality and computational performance per chip area may impact automotive control unit (ACU) architectures for driver assistance applications. The AutoVision processor is a dynamically reconfigurable MPSoC prototype where video-specific pixel processing engines are on-the-fly loaded or exchanged without interrupting regular system operations. For the time being, pixel processing engines cover functions such as object edge detection or luminance segmentation, and are implemented as dedicated hardware accelerators to ensure real-time frame processing capabilities of the AutoVision processor. Dynamic replacement of processing engines ensures an automatic and area efficient adaptation to various driving conditions. Segmented objects are, in a subsequent step, characterized by means of standard MPEG-7 descriptors and entered as search criteria into traffic scene analysis databases. Goal is to obtain a clean distinction between passenger cars, trucks, and big rectangular traffic signs, and to identify pedestrians or bikers in complex traffic situations. The AutoVision processor project is supported by the German Research Foundation (DFG) in the special emphasis research programme “reconfigurable computing”.

Real-time hardware–software embedded vision system for ITS smart camera implemented in Zynq SoC

Embedded Intelligent Camera Algorithm Based on Hardware IP

Design and implementation of shape-based feature extraction engine for vision systems using Zynq SoC

Intelligent Video Surveillance Based on Mobile Edge Networks

Implementation of a perception system for autonomous vehicles using a detection-segmentation network in SoC FPGA

Intelligent Image Sensor System Design Based on Real-Time Visual Analysis Algorithms

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

AutoVision - flexible processor architecture for video-assisted driving

Embedded and Real-Time Vehicle Detection System for Challenging On-Road Scenes

Hardware acceleration of infrared small target detection based on FPGA

Hardware–Software Partitioning for Real-Time Object Detection Using Dynamic Parameter Optimization

Prototype Design of a Time-of-flight Camera Based on Xilinx Zynq7000 SoC Platform

Real-time Implementation of Harris Corner Detection System Based on FPGA

Embedded Vision Intelligence for the Safety of Smart Cities

Robust and High-Performance Machine Vision System for Automatic Quality Inspection in Assembly Processes

Real Time FPGA Implementation of an Efficient High Speed Harris Corner Detection Algorithm Based on High-Level Synthesis

An Embedded Architecture for Implementation of a Video Acquisition Module of a Smart Camera System

A Manycore Vision Processor for Real-Time Smart Cameras

Intelligent Vision Systems for Automotive Applications

A Hardware Architecture of Feature Extraction for Real-Time Visual SLAM.

Sensors on the Move: Onboard Camera-Based Real-Time Traffic Alerts Paving the Way for Cooperative Roads