Abstract:This paper proposes a strategy for visual prediction in the context of autonomous driving. Humans, when not distracted or drunk, are still the best drivers you can currently find. For this reason we take inspiration from two theoretical ideas about the human mind and its neural organization. The first idea concerns how the brain uses a hierarchical structure of neuron ensembles to extract abstract concepts from visual experience and code them into compact representations. The second idea suggests that these neural perceptual representations are not neutral but functional to the prediction of the future state of affairs in the environment. Similarly, the prediction mechanism is not neutral but oriented to the current planning of a future action. We identify within the deep learning framework two artificial counterparts of the aforementioned neurocognitive theories. We find a correspondence between the first theoretical idea and the architecture of convolutional autoencoders, while we translate the second theory into a training procedure that learns compact representations which are not neutral but oriented to driving tasks, from two distinct perspectives. From a static perspective, we force groups of neural units in the compact representations to distinctly represent specific concepts crucial to the driving task. From a dynamic perspective, we encourage the compact representations to be predictive of how the current road scenario will change in the future. We successfully learn compact representations that use as few as 16 neural units for each of the two basic driving concepts we consider: car and lane. We prove the efficiency of our proposed perceptual representations on the SYNTHIA dataset. Our source code is available at <a class="link-external link-https" href="https://github.com/3lis/rnn_vae" rel="external noopener nofollow">this https URL</a>

DeepSignals: Predicting Intent of Drivers Through Visual Signals

Toward Driver Intention Prediction for Intelligent Vehicles: A Deep Learning Approach

Looking Inside Out: Anticipating Driver Intent From Videos

Driver Intention Anticipation Based on In-Cabin and Driving Scene Monitoring

Traffic Sign Detection With Event Cameras and DCNN

Anticipating Driving Behavior through Deep Learning-Based Policy Prediction

Deep learning approach for accurate and stable recognition of driver's lateral intentions using naturalistic driving data

Blind Spot Monitoring Using Deep Learning.

Spatiotemporal Feature Enhancement Aids the Driving Intention Inference of Intelligent Vehicles

DeepTake: Prediction of Driver Takeover Behavior using Multimodal Data

An ensemble deep learning approach for driver lane change intention inference

Driver intention prediction based on multi-dimensional cross-modality information interaction

Deep learning approach for unified recognition of driver speed and lateral intentions using naturalistic driving data

On the Road with 16 Neurons: Mental Imagery with Bio-inspired Deep Neural Networks

Intelligent Driver Warning System using Deep Learning-based Facial Expression Recognition

Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving

DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving

A deep neural framework for real-time vehicular accident detection based on motion temporal templates

Video action recognition for lane-change classification and prediction of surrounding vehicles

Deep Lidar CNN to Understand the Dynamics of Moving Vehicles

Learning an Interpretable Model for Driver Behavior Prediction with Inductive Biases