A Survey on the Applications of Frontier AI, Foundation Models, and Large Language Models to Intelligent Transportation Systems

Mohamed R. Shoaib,Heba M. Emara,Jun Zhao
2024-01-12
Abstract:This survey paper explores the transformative influence of frontier AI, foundation models, and Large Language Models (LLMs) in the realm of Intelligent Transportation Systems (ITS), emphasizing their integral role in advancing transportation intelligence, optimizing traffic management, and contributing to the realization of smart cities. Frontier AI refers to the forefront of AI technology, encompassing the latest advancements, innovations, and experimental techniques in the field, especially AI foundation models and LLMs. Foundation models, like GPT-4, are large, general-purpose AI models that provide a base for a wide range of applications. They are characterized by their versatility and scalability. LLMs are obtained from finetuning foundation models with a specific focus on processing and generating natural language. They excel in tasks like language understanding, text generation, translation, and summarization. By leveraging vast textual data, including traffic reports and social media interactions, LLMs extract critical insights, fostering the evolution of ITS. The survey navigates the dynamic synergy between LLMs and ITS, delving into applications in traffic management, integration into autonomous vehicles, and their role in shaping smart cities. It provides insights into ongoing research, innovations, and emerging trends, aiming to inspire collaboration at the intersection of language, intelligence, and mobility for safer, more efficient, and sustainable transportation systems. The paper further surveys interactions between LLMs and various aspects of ITS, exploring roles in traffic management, facilitating autonomous vehicles, and contributing to smart city development, while addressing challenges brought by frontier AI and foundation models. This paper offers valuable inspiration for future research and innovation in the transformative domain of intelligent transportation.
Computation and Language,Artificial Intelligence
What problem does this paper attempt to address?
The problems that this paper attempts to solve are to explore the applications and impacts of frontier artificial intelligence (Frontier AI), foundation models, and large - language models (LLMs) in intelligent transportation systems (ITS). Specifically, the paper aims to: 1. **Explore the roles of frontier AI and foundation models in ITS**: Analyze how these technologies can enhance the intelligence level of transportation systems, optimize traffic management, and promote the development of smart cities. 2. **Evaluate the applications of LLMs in ITS**: Research how LLMs can extract key insights by processing a large amount of text data (such as traffic reports, social media interactions, etc.), thereby promoting the development of ITS. 3. **Identify emerging trends and challenges**: Explore the challenges and limitations faced when integrating LLMs into transportation systems, and provide directions for future research and innovation. 4. **Provide inspiration for future research**: By summarizing current research achievements and application cases, provide valuable references for researchers, policymakers, and industry professionals, and promote the progress in the field of intelligent transportation. ### Main contributions of the paper: 1. **Review**: Provide a detailed introduction to the applications of frontier AI, foundation models, and LLMs in ITS, and present practical application cases of these technologies in traffic management, autonomous vehicles, and smart city construction. 2. **Trend identification**: Identify emerging trends and challenges when combining LLMs with transportation systems, and reveal the limitations of these technologies. 3. **Inspiration for future research**: By providing a clear overview of the field and potential research directions, encourage researchers and practitioners to conduct more exploration and innovation in the field of intelligent transportation. ### Specific content: - **Language models**: Outline the development history of language models from early rule - based language models to modern deep - learning - based large - language models (such as GPT - 4). - **Intelligent transportation systems**: Introduce the goals and key components of ITS, including data collection and perception, information processing, communication systems, traffic management, safety and security, environmental sustainability, and user information and feedback. - **Intelligent transportation applications**: Discuss in detail the applications of LLMs in traffic prediction and management, sentiment analysis of social media data, emergency response and disaster management, multi - modal transportation planning, etc. - **Challenges of frontier AI and foundation models**: Explore the regulatory challenges faced when using frontier AI and foundation models in intelligent transportation systems, and put forward preliminary suggestions for safety standards. Through these contents, the paper aims to provide a comprehensive perspective and practical guidance for the future development of intelligent transportation systems.