Abstract:In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional framework that encapsulates the intersection of applications, machine learning methodologies, and hardware devices, particularly emphasizing the role of LLMs. Instead of using multiple machine learning algorithms, our framework uses a single, data-centric LLM architecture that can analyze time series, images, and videos. We explore how LLMs can enhance data interpretation and decision-making in transportation. We apply this LLM framework to different sensor datasets, including time-series data and visual data from sources like Oxford Radar RobotCar, D-Behavior (D-Set), nuScenes by Motional, and Comma2k19. The goal is to streamline data processing workflows, reduce the complexity of deploying multiple models, and make intelligent transportation systems more efficient and accurate. The study was conducted using state-of-the-art hardware, leveraging the computational power of AMD RTX 3060 GPUs and Intel i9-12900 processors. The experimental results demonstrate that our framework achieves an average accuracy of 91.33\% across these datasets, with the highest accuracy observed in time-series data (92.7\%), showcasing the model's proficiency in handling sequential information essential for tasks such as motion planning and predictive maintenance. Through our exploration, we demonstrate the versatility and efficacy of LLMs in handling multimodal data within the transportation sector, ultimately providing insights into their application in real-world scenarios. Our findings align with the broader conference themes, highlighting the transformative potential of LLMs in advancing transportation technologies.

Multimodal Road Network Generation Based on Large Language Model

Large Language Models for Intelligent Transportation: A Review of the State of the Art and Challenges

Beyond Words: Evaluating Large Language Models in Transportation Planning

GenAI-powered Multi-Agent Paradigm for Smart Urban Mobility: Opportunities and Challenges for Integrating Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) with Intelligent Transportation Systems

ChatGPT is on the Horizon: Could a Large Language Model be Suitable for Intelligent Traffic Safety Research and Applications?

Beyond Segmentation: Road Network Generation with Multi-Modal LLMs

Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generation

Network Meets ChatGPT: Intent Autonomous Management, Control and Operation

Large Language Models for Networking: Applications, Enabling Techniques, and Challenges

A Survey on Multimodal Large Language Models for Autonomous Driving

TransportationGames: Benchmarking Transportation Knowledge of (Multimodal) Large Language Models

Multimodal LLM for Intelligent Transportation Systems

CHATATC: Large Language Model-Driven Conversational Agents for Supporting Strategic Air Traffic Flow Management

SurrealDriver: Designing Generative Driver Agent Simulation Framework in Urban Contexts based on Large Language Model

When Large Language Models Meet Optical Networks: Paving the Way for Automation

Multimodal Large Model Technology and Application for Railways

DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving

TrafficGPT: Viewing, Processing and Interacting with Traffic Foundation Models

Toward LLM-Agent-Based Modeling of Transportation Systems: A Conceptual Framework