Abstract:Humans assimilate information from the traffic environment mainly through visual perception. Obviously, the dominant information required to conduct a vehicle can be acquired with visual sensors. However, in contrast to most other sensor principles, video signals contain relevant information in a highly indirect manner and hence visual sensing requires sophisticated machine vision and image understanding techniques. This paper provides an overview on the state of research in the field of machine vision for intelligent vehicles. The functional spectrum addressed covers the range from advanced driver assistance systems to autonomous driving. The organization of the article adopts the typical order in image processing pipelines that successively condense the rich information and vast amount of data in video sequences. Data-intensive low-level early vision techniques first extract features that are later grouped and further processed to obtain information of direct relevance for vehicle guidance. Recognition and classification schemes allow to identify specific objects in a traffic scene. Recently, semantic labeling techniques using convolutional neural networks have achieved impressive results in this field. High-level decisions of intelligent vehicles are often influenced by map data. The emerging role of machine vision in the mapping and localization process is illustrated at the example of autonomous driving. Scene representation methods are discussed that organize the information from all sensors and data sources and thus build the interface between perception and planning. Recently, vision benchmarks have been tailored to various tasks in traffic scene perception that provide a metric for the rich diversity of machine vision methods. Finally, the paper addresses computing architectures suited to real-time implementation. Throughout the paper, numerous specific examples and real world experiments with prototype vehicles are presented.

Multi-Modal Visual Features Perception Technology for Internet of Vehicles (IoV)

Multi-Modal Neural Feature Fusion for Automatic Driving Through Perception-Aware Path Planning

Real-time driver identification in IoV: A deep learning and cloud integration approach

Next Generation Imaging Methodology: An Intelligent Transportation System for Consumer Industry

The Role of Machine Vision for Intelligent Vehicles

Convolutional Neural Network-based Optical Camera Communication System for Internet of Vehicles

Multi-modal Sensor Registration for Vehicle Perception via Deep Neural Networks

Improved Multimedia Object Processing for the Internet of Vehicles

Design and Research of Multi-sensor Detection System for Internet of Vehicles

Autonomous Multi-Sensor Fusion Techniques for Environmental Perception in Self-Driving Vehicles

Automatic Extraction of Relevant Road Infrastructure using Connected vehicle data and Deep Learning Model

Artificial Intelligence (AI)-Empowered Intrusion Detection Architecture for the Internet of Vehicles

NeurAll: Towards a Unified Visual Perception Model for Automated Driving

Cooperative Visual Augmentation Algorithm of Intelligent Vehicle Based on Inter-Vehicle Image Fusion

Tapping in a Remote Vehicle's onboard LLM to Complement the Ego Vehicle's Field-of-View

Emerging Trends in Autonomous Vehicle Perception: Multimodal Fusion for 3D Object Detection

Low-Visibility Vehicle-Road Environment Perception Based on the Multi-Modal Visual Features Fusion of Polarization and Infrared

Technology and Application of Intelligent Driving Based on Visual Perception

Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving

Decisive Data using Multi-Modality Optical Sensors for Advanced Vehicular Systems

Attention-Mechanism-based Tracking Method for Intelligent Internet of Vehicles