Abstract:Artificial intelligence (AI) plays a crucial role in autonomous driving (AD) research, propelling its development towards intelligence and efficiency. Currently, the development of AD technology follows two main technical paths: modularization and end-to-end. Modularization decompose the driving task into modules such as perception, prediction, planning, and control, and train them separately. Due to the inconsistency of training objectives between modules, the integrated effect suffers from bias. End-to-end attempts to address this issue by utilizing a single model that directly maps from sensor data to control signals. This path has limited learning capabilities in a comprehensive set of features and struggles to handle unpredictable long-tail events and complex urban traffic scenarios. In the face of challenges encountered in both paths, many researchers believe that large language models (LLMs) with powerful reasoning capabilities and extensive knowledge understanding may be the solution, expecting LLMs to provide AD systems with deeper levels of understanding and decision-making capabilities. In light of the challenges faced by both paths, many researchers believe that LLMs, with their powerful reasoning abilities and extensive knowledge, could offer a solution. To understand if LLMs could enhance AD, this paper conducts a thorough analysis of the potential applications of LLMs in AD systems, including exploring their optimization strategies in both modular and end-to-end approaches, with a particular focus on how LLMs can tackle the problems and challenges present in current solutions. Furthermore, we discuss an important question: Can LLM-based artificial general intelligence (AGI) be a key to achieve high-level AD? We further analyze the potential limitations and challenges that LLMs may encounter in promoting the development of AD technology.

MiningLLM: Towards Mining 5.0 via Large Language Models in Autonomous Driving and Smart Mining

Embodied Intelligence in Mining: Leveraging Multi-Modal Large Language Models for Autonomous Driving in Mines

LLM4Drive: A Survey of Large Language Models for Autonomous Driving

A Survey on Multimodal Large Language Models for Autonomous Driving

Large Language Models for Autonomous Driving (LLM4AD): Concept, Benchmark, Simulation, and Real-Vehicle Experiment

MiningGPT -- A Domain-Specific Large Language Model for the Mining Industry

Empowering Autonomous Driving with Large Language Models: A Safety Perspective

A Survey on Large Language Model-empowered Autonomous Driving

Large-Scale Underground Mine Positioning and Mapping with LiDAR-Based Semantic Intersection Detection

LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving

Scenarios Engineering driven Autonomous Transportation in Open-Pit Mines

Mining 5.0: Concept and Framework for Intelligent Mining Systems in CPSS

Scenario Engineering for Autonomous Transportation: A New Stage in Open-Pit Mines

Large Language Models for Human-like Autonomous Driving: A Survey

DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving

UrbanLLM: Autonomous Urban Activity Planning and Management with Large Language Models

Drive Like a Human: Rethinking Autonomous Driving with Large Language Models

Machine learning for open-pit mining: a systematic review

LLM4RL: Enhancing Reinforcement Learning with Large Language Models

XLM for Autonomous Driving Systems: A Comprehensive Review

DriveMLLM: A Benchmark for Spatial Understanding with Multimodal Large Language Models in Autonomous Driving