Abstract:As the technical trend of the next generation of high-level autonomous driving, brain-inspired learning is a class of methods that employ deep neural networks（DNN） as the strategy carrier and reinforcement learning（RL） as the training algorithm to realize strategy self evolution through continuous interaction with traffic environments, ultimately obtaining the optimal mapping from the environmental state to execution action. Currently, brain-inspired learning is mainly applied in decision-making and motion control modules of autonomous driving.Its key technologies include how to design its system framework to support interactive training, high-fidelity autonomous driving simulation platform, accurate and flexible representation of environment statues, multiple dimensional evaluation metrics, and effective training algorithm that drives policy updates. This paper systematically summarizes the history and future trends of decision-making and control functionalities in autonomous vehicles, including two main modular architectures（HDC, i.e., hierarchical decision ＆ control and IDC, i.e., integrated decision ＆ control） and three mainstream technical solutions（i.e., rule-based design, supervised learning, and brain-inspired learning）. An overview of autonomous driving simulation platforms are briefly introduced, followed by three effective designing methods for representing traffic environment states（i.e., object-based design, feature-based design, and combined design）. The paper also introduces multiple dimensional evaluation metrics for autonomous vehicles, which can describe self-driving performances including driving safety, regulatory compliance, driving comfort, travel efficiency, energy efficiency. Typical reinforcement learning algorithms, including their design principles, taxonomy, and algorithm performances, are introduced, as well as their application on brain-inspired autonomous driving systems in the systematic design of road-cloud cooperation.

A Brain-Inspired Multibranch Parallel Interactive Vision Mechanism for Advanced Driver Assistance Systems

Autonomous Driving with Human Guided Image Feature Extraction

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Brain Inspired Cognitive Model with Attention for Self-Driving Cars

A Joint Object Detection and Semantic Segmentation Model with Cross-Attention and Inner-Attention Mechanisms

NeurAll: Towards a Unified Visual Perception Model for Automated Driving

Event-Based Neuromorphic Vision for Autonomous Driving: A Paradigm Shift for Bio-Inspired Visual Sensing and Perception.

A Multi-Task Network Based on Dual-Neck Structure for Autonomous Driving Perception

Research on Brain-inspired Vision Based on Dynamic Vision Sensor Cameras

Spatiotemporal Feature Enhancement Aids the Driving Intention Inference of Intelligent Vehicles

Key Technologies of Brain-Inspired Decision and Control Intelligence for Autonomous Driving Systems

Parallel Driving with Big Models and Foundation Intelligence in Cyber-Physical-Social Spaces

Cognitive Map-Based Model: Toward a Developmental Framework for Self-Driving Cars

Technology and Application of Intelligent Driving Based on Visual Perception

A Human-Vehicle Collaborative Simulated Driving System Based on Hybrid Brain-Computer Interfaces and Computer Vision.

Research on Visual Perception Technology of Autonomous Driving Based on Improved Convolutional Neural Network

Driver intention prediction based on multi-dimensional cross-modality information interaction

Object detection and tracking algorithms using brain-inspired model and deep neural networks

Driver Behavior Recognition via Interwoven Deep Convolutional Neural Nets With Multi-Stream Inputs

Human Visual Attention Prediction Boosts Learning & Performance of Autonomous Driving Agents

Joint Semantic Understanding with a Multilevel Branch for Driving Perception