Abstract:The growth of intelligent vehicular services, like augmented reality (AR) road simulation, underscores the need for rapid, multi-modal content generation. Generative artificial intelligence (GAI) models, known for their swift production of diverse artificial intelligence-generated content (AIGC), stand out as a prime solution. However, integrating cloud-centric GAI models into vehicular networks is fraught with challenges. Notably, to offer specialized generative edge intelligence (EI) and boost vehicular AIGC, GAI models need to tap into user data and utilize significant computation resources. Moreover, their deployment across vehicular networks is essential for proximity-based distributed inferences. Yet, edge devices are resource-limited, and data sharing can raise safety and privacy concerns. Addressing these challenges, this paper introduces GAI-IoV, an EI-enabled GAI framework facilitated through the cooperation between road-side units (RSUs) and vehicles. Subsequently, we propose the workflow for collaborative fine-tuning and distributed inference. On this basis, two pivotal vehicle-centric problems are then formulated: computation and communication resource allocation for federated fine-tuning (FFT) to optimize time and energy cost, and splitting strategy of shared and local inferences to optimize inference latency and content-generation capability. To solve these optimizations, we introduce a self-adaptive global best harmony search (SGHS) algorithm for resource allocation and a backward induction method for determining inference splitting strategy. Our experiments based on the Stable Diffusion v1-4 model vouch for a superior fine-tuning and inference capabilities of GAI-IoV. Furthermore, simulations underscore its resource utilization and distributed inference efficiency in dynamic vehicular scenarios.

GIoV: Achieving Generative AI Services in Internet of Vehicles Via Collaborative Edge Intelligence

GAI-IoV: Bridging Generative AI and Vehicular Networks for Ubiquitous Edge Intelligence

Enhancing Vehicular Edge Intelligence Through Distributed Collaborative Generative AI Inference

Scalable AI Generative Content for Vehicular Network Semantic Communication

Towards Integrated Fine-tuning and Inference when Generative AI meets Edge Intelligence

Generative AI-enabled Vehicular Networks: Fundamentals, Framework, and Case Study

Integration of Mixture of Experts and Multimodal Generative AI in Internet of Vehicles: A Survey

From Generative AI to Generative Internet of Things: Fundamentals, Framework, and Outlooks

GainNet: Coordinates the Odd Couple of Generative AI and 6G Networks

Edge Intelligence for Internet of Vehicles: A Survey

Towards the Vehicular Metaverse: Exploring Distributed Inference with Transformer-Based Diffusion Model

Enhancing Vehicular Networks with Generative AI: Opportunities and Challenges

Multi-Agent RL-Based Industrial AIGC Service Offloading over Wireless Edge Networks

Cloud-Edge-Terminal Collaborative AIGC for Autonomous Driving

User-Centric Interactive AI for Distributed Diffusion Model-based AI-Generated Content

Unleashing the Power of Edge-Cloud Generative AI in Mobile Networks: A Survey of AIGC Services

A Unified Framework for Guiding Generative AI with Wireless Perception in Resource Constrained Mobile Edge Networks

The Roles of Generative Artificial Intelligence in Internet of Electric Vehicles

Intelligent Edge Computing in Internet of Vehicles: A Joint Computation Offloading and Caching Solution

Learning IoV in Edge: Deep Reinforcement Learning for Edge Computing Enabled Vehicular Networks