Abstract:Over the last decades, the development of Advanced Driver Assistance Systems (ADAS) has become a critical endeavor to attain different objectives: safety enhancement, mobility improvement, energy optimization and comfort. In order to tackle the first three objectives, a considerable amount of research focusing on autonomous driving have been carried out. Most of these works have been conducted within collaborative research programs involving car manufacturers, OEM and research laboratories around the world. Recent research and development on highly autonomous driving aim to ultimately replace the driver's actions with robotic functions. The first successful steps were dedicated to embedded assistance systems such as speed regulation (ACC), obstacle collision avoidance or mitigation (Automatic Emergency Braking), vehicle stability control (ESC), lane keeping or lane departure avoidance. Partially automated driving will require co-pilot applications (which replace the driver on his all driving tasks) involving a combination of the above methods, algorithms and architectures. Such a system is built with complex, distributed and cooperative architectures requiring strong properties such as reliability and robustness. Such properties must be maintained despite complex and degraded working conditions including adverse weather conditions, fog or dust as perceived by sensors. This paper is an overview on reliability and robustness issues related to sensors processing and perception. Indeed, prior to ensuring a high level of safety in the deployment of autonomous driving applications, it is necessary to guarantee a very high level of quality for the perception mechanisms. Therefore, we will detail these critical perception stages and provide a presentation of usable embedded sensors. Furthermore, in this study of state of the art of recent highly automated systems, some remarks and comments about limits of these systems and potential future research ways will be provided. Moreover, we will also give some advice on how to design a co-pilot application with driver modeling. Finally, we discuss a global architecture for the next generation of co-pilot applications. This architecture is based on the use of recent methods and technologies (AI, Quantify self, IoT …) and takes into account the human factors and driver modeling.

Perception in autonomous ground vehicles

Learning-Based Methods of Perception and Navigation for Ground Vehicles in Unstructured Environments: A Review

Perception technology for conversion of off-road vehicles for the purposes of unmanned missions

Toward autonomous driving: the CMU Navlab. I. Perception

A survey on perception, localization, planning, and control of autonomous vehicles: challenges and solutions

The Perception System of Intelligent Ground Vehicles in All Weather Conditions: A Systematic Literature Review

Applications of Computer Vision in Autonomous Vehicles: Methods, Challenges and Future Directions

Collaborative Perception for Autonomous Driving: Current Status and Future Trend

Analysis of State-of-the-art Software Solutions for Unstructured Outdoor Environment Perception in Goal-oriented Navigation of Off-road Unmanned Ground Vehicles

Autonomous Ground Vehicles—Concepts and a Path to the Future

Vision-based intelligent vehicles: State of the art and perspectives

Advancing Autonomous Driving Perception: Analysis of Sensor Fusion and Computer Vision Techniques

A Review of Sensor Technologies for Perception in Automated Driving

The perception systems used in fully automated vehicles: a comparative analysis

Perception, information processing and modeling: Critical stages for autonomous driving applications

Recent Advances in Automated Driving Technologies [From the Guest Editors]

Collaborative Perception-The Missing Piece in Realizing Fully Autonomous Driving

Sensor-Based Environmental Perception Technology for Intelligent Vehicles

Off-Road Detection Analysis for Autonomous Ground Vehicles: A Review

Lidar for Autonomous Driving: The Principles, Challenges, and Trends for Automotive Lidar and Perception Systems