Abstract:We present a learning-based planner that aims to robustly drive a vehicle by mimicking human drivers' driving behavior. We leverage a mid-to-mid approach that allows us to manipulate the input to our imitation learning network freely. With that in mind, we propose a novel feedback synthesizer for data augmentation. It allows our agent to gain more driving experience in various previously unseen environments that are likely to encounter, thus improving overall performance. This is in contrast to prior works that rely purely on random synthesizers. Furthermore, rather than completely commit to imitating, we introduce task losses that penalize undesirable behaviors, such as collision, off-road, and so on. Unlike prior works, this is done by introducing a differentiable vehicle rasterizer that directly converts the waypoints output by the network into images. This effectively avoids the usage of heavy-weight ConvLSTM networks, therefore, yields a faster model inference time. About the network architecture, we exploit an attention mechanism that allows the network to reason critical objects in the scene and produce better interpretable attention heatmaps. To further enhance the safety and robustness of the network, we add an optional optimization-based post-processing planner improving the driving comfort. We comprehensively validate our method's effectiveness in different scenarios that are specifically created for evaluating self-driving vehicles. Results demonstrate that our learning-based planner achieves high intelligence and can handle complex situations. Detailed ablation and visualization analysis are included to further demonstrate each of our proposed modules' effectiveness in our method.

Stochastic Navigation Command Matching for Imitation Learning of a Driving Policy.

Navigation Command Matching for Vision-based Autonomous Driving

Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

A LiDAR Based End to End Controller for Robot Navigation Using Deep Neural Network

Learning Safety-Aware Policy with Imitation Learning for Context-Adaptive Navigation

End-to-end Driving Deploying Through Uncertainty-Aware Imitation Learning and Stochastic Visual Domain Adaptation.

Autonomous Navigation through intersections with Graph ConvolutionalNetworks and Conditional Imitation Learning for Self-driving Cars

Multi-Task Conditional Imitation Learning for Autonomous Navigation at Crowded Intersections

Mapless Navigation With Safety-Enhanced Imitation Learning

End-to-end Driving via Conditional Imitation Learning

Iterative Imitation Policy Improvement for Interactive Autonomous Driving

Exploring Imitation Learning for Autonomous Driving with Feedback Synthesizer and Differentiable Rasterization

Sam: Squeeze-and-mimic networks for conditional visual driving policy learning

Joint Imitation Learning of Behavior Decision and Control for Autonomous Intersection Navigation

Efficient Multi-agent Cooperative Navigation in Unknown Environments with Interlaced Deep Reinforcement Learning.

What Matters to Enhance Traffic Rule Compliance of Imitation Learning for End-to-End Autonomous Driving

Visual-based Autonomous Driving Deployment from a Stochastic and Uncertainty-aware Perspective

A Benchmark Comparison of Imitation Learning-based Control Policies for Autonomous Racing

Improving the Environmental Adaptability of Conditional Imitation Learning Driving Model