Abstract:Artificial intelligence (AI) plays a crucial role in autonomous driving (AD) research, propelling its development towards intelligence and efficiency. Currently, the development of AD technology follows two main technical paths: modularization and end-to-end. Modularization decompose the driving task into modules such as perception, prediction, planning, and control, and train them separately. Due to the inconsistency of training objectives between modules, the integrated effect suffers from bias. End-to-end attempts to address this issue by utilizing a single model that directly maps from sensor data to control signals. This path has limited learning capabilities in a comprehensive set of features and struggles to handle unpredictable long-tail events and complex urban traffic scenarios. In the face of challenges encountered in both paths, many researchers believe that large language models (LLMs) with powerful reasoning capabilities and extensive knowledge understanding may be the solution, expecting LLMs to provide AD systems with deeper levels of understanding and decision-making capabilities. In light of the challenges faced by both paths, many researchers believe that LLMs, with their powerful reasoning abilities and extensive knowledge, could offer a solution. To understand if LLMs could enhance AD, this paper conducts a thorough analysis of the potential applications of LLMs in AD systems, including exploring their optimization strategies in both modular and end-to-end approaches, with a particular focus on how LLMs can tackle the problems and challenges present in current solutions. Furthermore, we discuss an important question: Can LLM-based artificial general intelligence (AGI) be a key to achieve high-level AD? We further analyze the potential limitations and challenges that LLMs may encounter in promoting the development of AD technology.

Embodied Intelligence in Mining: Leveraging Multi-Modal Large Language Models for Autonomous Driving in Mines

Embodied Intelligence in Mining: Leveraging Multi-modal Large Language Model for Autonomous Driving in Mines

MiningLLM: Towards Mining 5.0 via Large Language Models in Autonomous Driving and Smart Mining

Empowering Autonomous Driving with Large Language Models: A Safety Perspective

Embodied intelligence in manufacturing: leveraging large language models for autonomous industrial robotics

MineAgent: Towards Remote-Sensing Mineral Exploration with Multimodal Large Language Models

LLM4Drive: A Survey of Large Language Models for Autonomous Driving

Receive, Reason, and React: Drive as You Say with Large Language Models in Autonomous Vehicles

Advances in Embodied Navigation Using Large Language Models: A Survey

Receive, Reason, and React: Drive as You Say, With Large Language Models in Autonomous Vehicles

AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learning

Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehicles

A Survey on Large Language Model-empowered Autonomous Driving

A Survey on Multimodal Large Language Models for Autonomous Driving

Large Language Models for Autonomous Driving (LLM4AD): Concept, Benchmark, Simulation, and Real-Vehicle Experiment

Large Language Models for Robotics: Opportunities, Challenges, and Perspectives

LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving

The Development of LLMs for Embodied Navigation

DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving

Embodied Understanding of Driving Scenarios