Abstract:Humans assimilate information from the traffic environment mainly through visual perception. Obviously, the dominant information required to conduct a vehicle can be acquired with visual sensors. However, in contrast to most other sensor principles, video signals contain relevant information in a highly indirect manner and hence visual sensing requires sophisticated machine vision and image understanding techniques. This paper provides an overview on the state of research in the field of machine vision for intelligent vehicles. The functional spectrum addressed covers the range from advanced driver assistance systems to autonomous driving. The organization of the article adopts the typical order in image processing pipelines that successively condense the rich information and vast amount of data in video sequences. Data-intensive low-level early vision techniques first extract features that are later grouped and further processed to obtain information of direct relevance for vehicle guidance. Recognition and classification schemes allow to identify specific objects in a traffic scene. Recently, semantic labeling techniques using convolutional neural networks have achieved impressive results in this field. High-level decisions of intelligent vehicles are often influenced by map data. The emerging role of machine vision in the mapping and localization process is illustrated at the example of autonomous driving. Scene representation methods are discussed that organize the information from all sensors and data sources and thus build the interface between perception and planning. Recently, vision benchmarks have been tailored to various tasks in traffic scene perception that provide a metric for the rich diversity of machine vision methods. Finally, the paper addresses computing architectures suited to real-time implementation. Throughout the paper, numerous specific examples and real world experiments with prototype vehicles are presented.

What is Wittgenstein's Influence on the Investigation of Machine Vision?

Analysis of Influence of Mechanical Vibration on Ghost Imaging

Inferring Human Vision in a Human-Like Way: Key Factors Influencing the Cognitive Processing of Level-1 Visual Perspective-Taking

Fundamentals of Machine Vision

The Machine Vision Iceberg Explained: Advancing Dynamic Testing by Considering Holistic Environmental Relations

On the Architecture of the Micro Machine Vision System

Vision Language Models See What You Want but not What You See

Machine Vision in the Context of Robotics: A Systematic Literature Review

Machine visions: A corporate imaginary of artificial sight

Morality, Machines and the Interpretation Problem: A Value-based, Wittgensteinian Approach to Building Moral Agents

Probing Mechanical Reasoning in Large Vision Language Models

What Can Artificial Intelligence Learn from Wittgenstein'S on Certainty?

Research on Machine Vision Technology and its Application in Mechanical Manufacturing Automation

The Role of Machine Vision for Intelligent Vehicles

And Then the Hammer Broke: Reflections on Machine Ethics from Feminist Philosophy of Science

Does Wittgenstein Actually Undermine the Foundation of Artificial Intelligence?

Beyond the Doors of Perception: Vision Transformers Represent Relations Between Objects

Intelligent Optoelectronic Devices for Next‐Generation Artificial Machine Vision

Vision and language: from visual perception to content creation

Motion Mapping Cognition: A Nondecomposable Primary Process in Human Vision

Exploring impact and features of machine vision for progressive industry 4.0 culture