Abstract:Large language models (LLMs) and foundation models have been recently touted as a game-changer for 6G systems. However, recent efforts on LLMs for wireless networks are limited to a direct application of existing language models that were designed for natural language processing (NLP) applications. To address this challenge and create wireless-centric foundation models, this paper presents a comprehensive vision on how to design universal foundation models that are tailored towards the deployment of artificial intelligence (AI)-native networks. Diverging from NLP-based foundation models, the proposed framework promotes the design of large multi-modal models (LMMs) fostered by three key capabilities: 1) processing of multi-modal sensing data, 2) grounding of physical symbol representations in real-world wireless systems using causal reasoning and retrieval-augmented generation (RAG), and 3) enabling instructibility from the wireless environment feedback to facilitate dynamic network adaptation thanks to logical and mathematical reasoning facilitated by neuro-symbolic AI. In essence, these properties enable the proposed LMM framework to build universal capabilities that cater to various cross-layer networking tasks and alignment of intents across different domains. Preliminary results from experimental evaluation demonstrate the efficacy of grounding using RAG in LMMs, and showcase the alignment of LMMs with wireless system designs. Furthermore, the enhanced rationale exhibited in the responses to mathematical questions by LMMs, compared to vanilla LLMs, demonstrates the logical and mathematical reasoning capabilities inherent in LMMs. Building on those results, we present a sequel of open questions and challenges for LMMs. We then conclude with a set of recommendations that ignite the path towards LMM-empowered AI-native systems.

Towards a Wireless Physical-Layer Foundation Model: Challenges and Strategies

Large Multi-Modal Models (LMMs) as Universal Foundation Models for AI-Native Wireless Systems

Guest Editorial: Sustainable Big AI Model for Wireless Networks

The Role of Federated Learning in a Wireless World with Foundation Models

Deep Learning for Wireless Physical Layer: Opportunities and Challenges

WirelessLLM: Empowering Large Language Models Towards Wireless Intelligence

AI Empowered Wireless Communications: from Bits to Semantics

Toward Intelligent Wireless Communications: Deep Learning - Based Physical Layer Technologies

Large Wireless Model (LWM): A Foundation Model for Wireless Channels

An Overview of Wireless Transmission Technology Utilizing Artificial Intelligence

Adaptive and Flexible Model-Based AI for Deep Receivers in Dynamic Channels

Towards Wireless-Native Big AI Model: Insights into Its Ambitions, Peculiarities and Methodologies

Machine Learning & Wi-Fi: Unveiling the Path Towards AI/ML-Native IEEE 802.11 Networks

Towards an AI/ML-defined Radio for Wi-Fi: Overview, Challenges, and Roadmap

Integrating Pre-Trained Language Model with Physical Layer Communications

Cognitive-LPWAN: Towards Intelligent Wireless Services in Hybrid Low Power Wide Area Networks

Foundation Model Based Native AI Framework in 6G with Cloud-Edge-End Collaboration

Interplay between RIS and AI in Wireless Communications: Fundamentals, Architectures, Applications, and Open Research Problems

Model-Driven Deep Learning for Physical Layer Communications

Wireless 2.0: Towards an Intelligent Radio Environment Empowered by Reconfigurable Meta-Surfaces and Artificial Intelligence

Large Language Model (LLM)-enabled In-context Learning for Wireless Network Optimization: A Case Study of Power Control