Automatic Rule Learning for Autonomous Driving Using Semantic Memory

Dmitriy Korchev,Aruna Jammalamadaka,Rajan Bhattacharyya

DOI: https://doi.org/10.48550/arXiv.1809.07904

IF: 5.414

2018-09-21

Machine Learning

Abstract:This paper presents a novel approach for automatic rule learning applicable to an autonomous driving system using real driving data.

What problem does this paper attempt to address?

Knowledge Distillation on Driving Intention Generator: Learn Human-like Semantic Reasoning.

Hejun Wang,Jiajun Dong,Yunkai Wang,Yanmei Jiao,Rong Xiong

DOI: https://doi.org/10.1109/rcar58764.2023.10249948

2023-01-01

Abstract:Semantic information plays a significant role in autonomous vehicles. However, it has remained open how to economically compute and efficiently incorporate semantic information into other frequently applied processes, such as construction of local navigation map, driving decision making and trajectories planning. To address this issue, we introduce Knowledge Distillation to convey semantic reasoning capability. Following the existing intention-guided framework, a semantically incorporated module associates given navigation instruction with acquired visual perception to synthesize driving intention. Our major contribution is to teach the driving intention generator how to propagate considering semantics implicitly. Specifically, we construct a semantic supervisor identical to the driving intention generator. The supervisor transfers semantic reasoning ability to the generator during training process, with which the generator is expected to perform stably and reliably even in extremely sophisticated surroundings or under frequently inaccurate navigation instruction. Through exhaustive experimental validation, our model demonstrates a superior robustness and adaptability compared to the state-of-the-art. Finally, we explain the intrinsic mechanism of our model with visualization.
Deep semantic segmentation for automated driving: Taxonomy, roadmap and challenges

Mennatullah Siam,Sara Elkerdawy,Martin Jagersand,Senthil Yogamani

DOI: https://doi.org/10.1109/itsc.2017.8317714

2017-10-01

Abstract:Semantic segmentation was seen as a challenging computer vision problem few years ago. Due to recent advancements in deep learning, relatively accurate solutions are now possible for its use in automated driving. In this paper, the semantic segmentation problem is explored from the perspective of automated driving. Most of the current semantic segmentation algorithms are designed for generic images and do not incorporate prior structure and end goal for automated driving. First, the paper begins with a generic taxonomic survey of semantic segmentation algorithms and then discusses how it fits in the context of automated driving. Second, the particular challenges of deploying it into a safety system which needs high level of accuracy and robustness are listed. Third, different alternatives instead of using an independent semantic segmentation module are explored. Finally, an empirical evaluation of various semantic segmentation architectures was performed on CamVid dataset in terms of accuracy and speed. This paper is a preliminary shorter version of a more detailed survey which is work in progress.
Deep Reinforcement Learning with Enhanced Safety for Autonomous Highway Driving

Ali Baheri,Subramanya Nageshrao,H. Eric Tseng,Ilya Kolmanovsky,Anouck Girard,Dimitar Filev

DOI: https://doi.org/10.48550/arXiv.1910.12905

2020-04-23

Abstract:In this paper, we present a safe deep reinforcement learning system for automated driving. The proposed framework leverages merits of both rule-based and learning-based approaches for safety assurance. Our safety system consists of two modules namely handcrafted safety and dynamically-learned safety. The handcrafted safety module is a heuristic safety rule based on common driving practice that ensure a minimum relative gap to a traffic vehicle. On the other hand, the dynamically-learned safety module is a data-driven safety rule that learns safety patterns from driving data. Specifically, the dynamically-leaned safety module incorporates a model lookahead beyond the immediate reward of reinforcement learning to predict safety longer into the future. If one of the future states leads to a near-miss or collision, then a negative reward will be assigned to the reward function to avoid collision and accelerate the learning process. We demonstrate the capability of the proposed framework in a simulation environment with varying traffic density. Our results show the superior capabilities of the policy enhanced with dynamically-learned safety module.

Systems and Control,Robotics
Semantic Anomaly Detection with Large Language Models

Amine Elhafsi,Rohan Sinha,Christopher Agia,Edward Schmerling,Issa Nesnas,Marco Pavone

2023-09-12

Abstract:As robots acquire increasingly sophisticated skills and see increasingly complex and varied environments, the threat of an edge case or anomalous failure is ever present. For example, Tesla cars have seen interesting failure modes ranging from autopilot disengagements due to inactive traffic lights carried by trucks to phantom braking caused by images of stop signs on roadside billboards. These system-level failures are not due to failures of any individual component of the autonomy stack but rather system-level deficiencies in semantic reasoning. Such edge cases, which we call semantic anomalies, are simple for a human to disentangle yet require insightful reasoning. To this end, we study the application of large language models (LLMs), endowed with broad contextual understanding and reasoning capabilities, to recognize such edge cases and introduce a monitoring framework for semantic anomaly detection in vision-based policies. Our experiments apply this framework to a finite state machine policy for autonomous driving and a learned policy for object manipulation. These experiments demonstrate that the LLM-based monitor can effectively identify semantic anomalies in a manner that shows agreement with human reasoning. Finally, we provide an extended discussion on the strengths and weaknesses of this approach and motivate a research outlook on how we can further use foundation models for semantic anomaly detection.

Robotics
Autonomous Highway Driving using Deep Reinforcement Learning

Subramanya Nageshrao,Eric Tseng,Dimitar Filev

DOI: https://doi.org/10.48550/arXiv.1904.00035

2019-03-30

Abstract:The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers may not be ideal. Similarly, it may not be effective to design an a-priori cost function and then solve the optimal control problem in real-time. In order to address these issues and to avoid peculiar behaviors when encountering unforeseen scenario, we propose a reinforcement learning (RL) based method, where the ego car, i.e., an autonomous vehicle, learns to make decisions by directly interacting with simulated traffic. The decision maker for AV is implemented as a deep neural network providing an action choice for a given system state. In a critical application such as driving, an RL agent without explicit notion of safety may not converge or it may need extremely large number of samples before finding a reliable policy. To best address the issue, this paper incorporates reinforcement learning with an additional short horizon safety check (SC). In a critical scenario, the safety check will also provide an alternate safe action to the agent provided if it exists. This leads to two novel contributions. First, it generalizes the states that could lead to undesirable "near-misses" or "collisions ". Second, inclusion of safety check can provide a safe and stable training environment. This significantly enhances learning efficiency without inhibiting meaningful exploration to ensure safe and optimal learned behavior. We demonstrate the performance of the developed algorithm in highway driving scenario where the trained AV encounters varying traffic density in a highway setting.

Robotics,Machine Learning,Systems and Control
Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactions

Joey Hong,Benjamin Sapp,James Philbin

DOI: https://doi.org/10.48550/arXiv.1906.08945

2019-06-21

Computer Vision and Pattern Recognition

Abstract:We focus on the problem of predicting future states of entities in complex, real-world driving scenarios. Previous research has used low-level signals to predict short time horizons, and has not addressed how to leverage key assets relied upon heavily by industry self-driving systems: (1) large 3D perception efforts which provide highly accurate 3D states of agents with rich attributes, and (2) detailed and accurate semantic maps of the environment (lanes, traffic lights, crosswalks, etc). We present a unified representation which encodes such high-level semantic information in a spatial grid, allowing the use of deep convolutional models to fuse complex scene context. This enables learning entity-entity and entity-environment interactions with simple, feed-forward computations in each timestep within an overall temporal model of an agent's behavior. We propose different ways of modelling the future as a distribution over future states using standard supervised learning. We introduce a novel dataset providing industry-grade rich perception and semantic inputs, and empirically show we can effectively learn fundamentals of driving behavior.
Autonomous Driving Control Based on the Technique of Semantic Segmentation

Jichiang Tsai,Che-Cheng Chang,Tzu Li

DOI: https://doi.org/10.3390/s23020895

2023-01-12

Abstract:Advanced Driver Assistance Systems (ADAS) are only applied to relatively simple scenarios, such as highways. If there is an emergency while driving, the driver should take control of the car to deal properly with the situation at any time. Obviously, this incurs the uncertainty of safety. Recently, in the literature, several studies have been proposed for the above-mentioned issue via Artificial Intelligence (AI). The achievement is exactly the aim that we look forward to, i.e., the autonomous vehicle. In this paper, we realize the autonomous driving control via Deep Reinforcement Learning (DRL) based on the CARLA (Car Learning to Act) simulator. Specifically, we use the ordinary Red-Green-Blue (RGB) camera and semantic segmentation camera to observe the view in front of the vehicle while driving. Then, the captured information is utilized as the input for different DRL models so as to evaluate the performance, where the DRL models include DDPG (Deep Deterministic Policy Gradient) and RDPG (Recurrent Deterministic Policy Gradient). Moreover, we also design an appropriate reward mechanism for these DRL models to realize efficient autonomous driving control. According to the results, only the RDPG strategies can finish the driving mission with the scenario that does not appear/include in the training scenario, and with the help of the semantic segmentation camera, the RDPG control strategy can further improve its efficiency.
Semantic Traffic Law Adaptive Decision-Making for Self-Driving Vehicles

Jiaxin Liu,Hong Wang,Zhong Cao,Wenhao Yu,Chengxiang Zhao,Ding Zhao,Diange Yang,Jun Li

DOI: https://doi.org/10.1109/tits.2023.3294579

IF: 8.5

2023-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Facts proved that obeying traffic laws keeps the promise to promote the safety of self-driving vehicles. Current self-driving vehicles usually have fixed algorithms during autonomous driving, however the traffic laws may differ or change in different regions or times, e.g., tidal lanes. It raises a crucial requirement to make self-driving vehicles adapt to the newly received traffic laws. The challenges are that traffic laws are usually semantic and manually designed, but the original algorithms may not always contain the pre-designed interface to adapt to emerging laws. To this end, this work proposes a traffic law adaptive decision-making platform, which uses the linear temporal logic (LTL) formula to consistently describe the semantic traffic laws. Then, an LTL-based reinforcement learning framework is designed to estimate the probability of illegal behavior under different traffic laws. Finally, a law-specific backup policy is designed to maintain the performance threshold by monitoring the probability of illegal behavior. This work takes three typical scenarios where the traffic laws differ for instance to prove the effectiveness of the proposed approach, i.e., law amendment presented by the government, law difference between different regions, and temporary traffic control. The results show that the proposed method can help the original decision-making algorithms adapt to the traffic laws well without pre-defined interfaces. This method provides a way to administer on-road driving self-driving vehicles.

engineering, electrical & electronic,transportation science & technology, civil
Action-Based Representation Learning for Autonomous Driving

Yi Xiao,Felipe Codevilla,Christopher Pal,Antonio M. Lopez

DOI: https://doi.org/10.48550/arXiv.2008.09417

2020-11-09

Abstract:Human drivers produce a vast amount of data which could, in principle, be used to improve autonomous driving systems. Unfortunately, seemingly straightforward approaches for creating end-to-end driving models that map sensor data directly into driving actions are problematic in terms of interpretability, and typically have significant difficulty dealing with spurious correlations. Alternatively, we propose to use this kind of action-based driving data for learning representations. Our experiments show that an affordance-based driving model pre-trained with this approach can leverage a relatively small amount of weakly annotated imagery and outperform pure end-to-end driving models, while being more interpretable. Further, we demonstrate how this strategy outperforms previous methods based on learning inverse dynamics models as well as other methods based on heavy human supervision (ImageNet).

Computer Vision and Pattern Recognition,Machine Learning,Robotics
Driving with Regulation: Interpretable Decision-Making for Autonomous Vehicles with Retrieval-Augmented Reasoning via LLM

Tianhui Cai,Yifan Liu,Zewei Zhou,Haoxuan Ma,Seth Z. Zhao,Zhiwen Wu,Jiaqi Ma

2024-10-07

Abstract:This work presents an interpretable decision-making framework for autonomous vehicles that integrates traffic regulations, norms, and safety guidelines comprehensively and enables seamless adaptation to different regions. While traditional rule-based methods struggle to incorporate the full scope of traffic rules, we develop a Traffic Regulation Retrieval (TRR) Agent based on Retrieval-Augmented Generation (RAG) to automatically retrieve relevant traffic rules and guidelines from extensive regulation documents and relevant records based on the ego vehicle's situation. Given the semantic complexity of the retrieved rules, we also design a reasoning module powered by a Large Language Model (LLM) to interpret these rules, differentiate between mandatory rules and safety guidelines, and assess actions on legal compliance and safety. Additionally, the reasoning is designed to be interpretable, enhancing both transparency and reliability. The framework demonstrates robust performance on both hypothesized and real-world cases across diverse scenarios, along with the ability to adapt to different regions with ease.

Artificial Intelligence
Decentralized Semantic Traffic Control in AVs Using RL and DQN for Dynamic Roadblocks

Emanuel Figetakis,Yahuza Bello,Ahmed Refaey,Abdallah Shami

2024-06-27

Abstract:Autonomous Vehicles (AVs), furnished with sensors capable of capturing essential vehicle dynamics such as speed, acceleration, and precise location, possess the capacity to execute intelligent maneuvers, including lane changes, in anticipation of approaching roadblocks. Nevertheless, the sheer volume of sensory data and the processing necessary to derive informed decisions can often overwhelm the vehicles, rendering them unable to handle the task independently. Consequently, a common approach in traffic scenarios involves transmitting the data to servers for processing, a practice that introduces challenges, particularly in situations demanding real-time processing. In response to this challenge, we present a novel DL-based semantic traffic control system that entrusts semantic encoding responsibilities to the vehicles themselves. This system processes driving decisions obtained from a Reinforcement Learning (RL) agent, streamlining the decision-making process. Specifically, our framework envisions scenarios where abrupt roadblocks materialize due to factors such as road maintenance, accidents, or vehicle repairs, necessitating vehicles to make determinations concerning lane-keeping or lane-changing actions to navigate past these obstacles. To formulate this scenario mathematically, we employ a Markov Decision Process (MDP) and harness the Deep Q Learning (DQN) algorithm to unearth viable solutions.

Machine Learning,Artificial Intelligence,Networking and Internet Architecture
Deep Learning for Autonomous Driving System

Karuppasamy Pandiyan M,Sreenatha Reddy S,Sainath V

DOI: https://doi.org/10.1109/icesc51422.2021.9532819

2021-08-04

Abstract:Self-driving cars have developed rapidly in the last decade, owing to advances in deep learning. The primary purpose of this research work is to provide an overview on the implementation of deep learning applications in autonomous driving systems. This research work has been initiated by analyzing the self-driving architectures that use deep learning and neural network combinations, as well as the deep reinforcement learning method These methods form the basis for self-driving scene perception, path planning, and algorithm behavior regulated by motion. Also, this research work analyzes how self-driving architecture is perceived, as well as path planning by implying that each module will be built using deep learning technologies and end-to-end systems. This permits all the self-driving directives to be mapped to the sensory data right away. Also, this research work studies the current challenges involved in designing the self-driving cars with AI-based designs. For example: safety standards, training data and computational hardware. The proposed research study also helps in determining the advantages and disadvantages of deep learning and AI techniques for developing autonomous driving systems.
Plants Don't Walk on the Street: Common-Sense Reasoning for Reliable Semantic Segmentation

Linara Adilova,Elena Schulz,Maram Akila,Sebastian Houben,Jan David Schneider,Fabian Hueger,Tim Wirtz

DOI: https://doi.org/10.48550/arXiv.2104.09254

2021-04-19

Abstract:Data-driven sensor interpretation in autonomous driving can lead to highly implausible predictions as can most of the time be verified with common-sense knowledge. However, learning common knowledge only from data is hard and approaches for knowledge integration are an active research area. We propose to use a partly human-designed, partly learned set of rules to describe relations between objects of a traffic scene on a high level of abstraction. In doing so, we improve and robustify existing deep neural networks consuming low-level sensor information. We present an initial study adapting the well-established Probabilistic Soft Logic (PSL) framework to validate and improve on the problem of semantic segmentation. We describe in detail how we integrate common knowledge into the segmentation pipeline using PSL and verify our approach in a set of experiments demonstrating the increase in robustness against several severe image distortions applied to the A2D2 autonomous driving data set.

Computer Vision and Pattern Recognition
Spatial Intelligence of a Self-driving Car and Rule-Based Decision Making

Stanislav Kikot

2023-08-02

Abstract:In this paper we show how rule-based decision making can be combined with traditional motion planning techniques to achieve human-like behavior of a self-driving vehicle in complex traffic situations. We give and discuss examples of decision rules in autonomous driving. We draw on these examples to illustrate that developing techniques for spatial awareness of robots is an exciting activity which deserves more attention from spatial reasoning community that it had received so far.

Robotics,Artificial Intelligence
A Rule-Based Behaviour Planner for Autonomous Driving

Bouchard Frederic,Sedwards Sean,Czarnecki Krzysztof

DOI: https://doi.org/10.1007/978-3-031-21541-4_17

2024-06-29

Abstract:Autonomous vehicles require highly sophisticated decision-making to determine their motion. This paper describes how such functionality can be achieved with a practical rule engine learned from expert driving decisions. We propose an algorithm to create and maintain a rule-based behaviour planner, using a two-layer rule-based theory. The first layer determines a set of feasible parametrized behaviours, given the perceived state of the environment. From these, a resolution function chooses the most conservative high-level maneuver. The second layer then reconciles the parameters into a single behaviour. To demonstrate the practicality of our approach, we report results of its implementation in a level-3 autonomous vehicle and its field test in an urban environment.

Artificial Intelligence,Robotics
Robust AI Driving Strategy for Autonomous Vehicles

Subramanya Nageshrao,Yousaf Rahman,Vladimir Ivanovic,Mrdjan Jankovic,Eric Tseng,Michael Hafner,Dimitar Filev

DOI: https://doi.org/10.48550/arXiv.2207.07829

2022-07-16

Abstract:There has been significant progress in sensing, perception, and localization for automated driving, However, due to the wide spectrum of traffic/road structure scenarios and the long tail distribution of human driver behavior, it has remained an open challenge for an intelligent vehicle to always know how to make and execute the best decision on road given available sensing / perception / localization information. In this chapter, we talk about how artificial intelligence and more specifically, reinforcement learning, can take advantage of operational knowledge and safety reflex to make strategical and tactical decisions. We discuss some challenging problems related to the robustness of reinforcement learning solutions and their implications to the practical design of driving strategies for autonomous vehicles. We focus on automated driving on highway and the integration of reinforcement learning, vehicle motion control, and control barrier function, leading to a robust AI driving strategy that can learn and adapt safely.

Robotics,Systems and Control
Learning a Decision Module by Imitating Driver's Control Behaviors

Junning Huang,Sirui Xie,Jiankai Sun,Qiurui Ma,Chunxiao Liu,Jianping Shi,Dahua Lin,Bolei Zhou

DOI: https://doi.org/10.48550/arXiv.1912.00191

2021-05-06

Abstract:Autonomous driving systems have a pipeline of perception, decision, planning, and control. The decision module processes information from the perception module and directs the execution of downstream planning and control modules. On the other hand, the recent success of deep learning suggests that this pipeline could be replaced by end-to-end neural control policies, however, safety cannot be well guaranteed for the data-driven neural networks. In this work, we propose a hybrid framework to learn neural decisions in the classical modular pipeline through end-to-end imitation learning. This hybrid framework can preserve the merits of the classical pipeline such as the strict enforcement of physical and logical constraints while learning complex driving decisions from data. To circumvent the ambiguous annotation of human driving decisions, our method learns high-level driving decisions by imitating low-level control behaviors. We show in the simulation experiments that our modular driving agent can generalize its driving decision and control to various complex scenarios where the rule-based programs fail. It can also generate smoother and safer driving trajectories than end-to-end neural policies.

Artificial Intelligence,Robotics,Signal Processing
Advancements in Deep Learning for Autonomous Driving in Indian Road Conditions

Abdul Basith Maaz,Abdul Owaise,Adnan Shariff,Mohammed Hamza Rahamathulla,Naheem MR

DOI: https://doi.org/10.46610/joidacs.2024.v01i01.004

2024-04-15

Abstract:Recent advancements in deep learning techniques tailored for autonomous driving in Indian road conditions are crucial for revolutionizing transportation systems. Indian roads present unique challenges, including unpredictable traffic patterns, diverse road infrastructures, and challenging weather conditions. Deep learning is pivotal in addressing these challenges, focusing on perception, decision-making, and control. Various architectures, including Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Deep Reinforcement Learning (DRL), are analyzed for their efficacy in autonomous driving. Sensor fusion techniques enhance perception capabilities, such as lidar, radar, and camera data integration. Additionally, advancements in semantic segmentation and object detection algorithms improve scene understanding and obstacle recognition. Collaborative efforts between academia, industry, and government agencies are essential for accelerating the deployment of autonomous driving technology in Indian road conditions. In conclusion, leveraging cutting-edge deep learning methodologies enables safe and efficient navigation of autonomous vehicles, ushering in a transformative future in transportation systems.
Deep Reinforcement Learning for Autonomous Driving: A Survey

B Ravi Kiran,Ibrahim Sobh,Victor Talpaert,Patrick Mannion,Ahmad A. Al Sallab,Senthil Yogamani,Patrick Pérez

DOI: https://doi.org/10.48550/arXiv.2002.00444

2021-01-24

Abstract:With the development of deep representation learning, the domain of reinforcement learning (RL) has become a powerful learning framework now capable of learning complex policies in high dimensional environments. This review summarises deep reinforcement learning (DRL) algorithms and provides a taxonomy of automated driving tasks where (D)RL methods have been employed, while addressing key computational challenges in real world deployment of autonomous driving agents. It also delineates adjacent domains such as behavior cloning, imitation learning, inverse reinforcement learning that are related but are not classical RL algorithms. The role of simulators in training agents, methods to validate, test and robustify existing solutions in RL are discussed.

Machine Learning,Artificial Intelligence,Robotics
Autonomous Driving using Residual Sensor Fusion and Deep Reinforcement Learning

Amin Jalal Aghdasian,Amirhossein Heydarian Ardakani,Kianoush Aqabakee,Farzaneh Abdollahi

2023-12-27

Abstract:This paper proposes a novel approach by integrating sensor fusion with deep reinforcement learning, specifically the Soft Actor-Critic (SAC) algorithm, to develop an optimal control policy for self-driving cars. Our system employs a two-branch fusion method for vehicle image and tracking sensor data, leveraging the strengths of residual structures and identity mapping to enhance agent training. Through comprehensive comparisons, we demonstrate the efficacy of information fusion and establish the superiority of our selected algorithm over alternative approaches. Our work advances the field of autonomous driving and demonstrates the potential of reinforcement learning in enabling intelligent vehicle decision-making.

Systems and Control

Automatic Rule Learning for Autonomous Driving Using Semantic Memory

Knowledge Distillation on Driving Intention Generator: Learn Human-like Semantic Reasoning.

Deep semantic segmentation for automated driving: Taxonomy, roadmap and challenges

Deep Reinforcement Learning with Enhanced Safety for Autonomous Highway Driving

Semantic Anomaly Detection with Large Language Models

Autonomous Highway Driving using Deep Reinforcement Learning

Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactions

Autonomous Driving Control Based on the Technique of Semantic Segmentation

Semantic Traffic Law Adaptive Decision-Making for Self-Driving Vehicles

Action-Based Representation Learning for Autonomous Driving

Driving with Regulation: Interpretable Decision-Making for Autonomous Vehicles with Retrieval-Augmented Reasoning via LLM

Decentralized Semantic Traffic Control in AVs Using RL and DQN for Dynamic Roadblocks

Deep Learning for Autonomous Driving System

Plants Don't Walk on the Street: Common-Sense Reasoning for Reliable Semantic Segmentation

Spatial Intelligence of a Self-driving Car and Rule-Based Decision Making

A Rule-Based Behaviour Planner for Autonomous Driving

Robust AI Driving Strategy for Autonomous Vehicles

Learning a Decision Module by Imitating Driver's Control Behaviors

Advancements in Deep Learning for Autonomous Driving in Indian Road Conditions

Deep Reinforcement Learning for Autonomous Driving: A Survey

Autonomous Driving using Residual Sensor Fusion and Deep Reinforcement Learning