Abstract:Large Language Models (LLMs) have demonstrated remarkable capabilities across textual and visual domains but often generate outputs that violate physical laws, revealing a gap in their understanding of the physical world. Inspired by human cognition, where perception is fundamental to reasoning, we explore augmenting LLMs with enhanced perception abilities using Internet of Things (IoT) sensor data and pertinent knowledge for IoT task reasoning in the physical world. In this work, we systematically study LLMs capability to address real-world IoT tasks by augmenting their perception and knowledge base, and then propose a unified framework, IoT-LLM, to enhance such capability. In IoT-LLM, we customize three steps for LLMs: preprocessing IoT data into formats amenable to LLMs, activating their commonsense knowledge through chain-of-thought prompting and specialized role definitions, and expanding their understanding via IoT-oriented retrieval-augmented generation based on in-context learning. To evaluate the performance, We design a new benchmark with five real-world IoT tasks with different data types and reasoning difficulties and provide the benchmarking results on six open-source and close-source LLMs. Experimental results demonstrate the limitations of existing LLMs with naive textual inputs that cannot perform these tasks effectively. We show that IoT-LLM significantly enhances the performance of IoT tasks reasoning of LLM, such as GPT-4, achieving an average improvement of 65% across various tasks against previous methods. The results also showcase LLMs ability to comprehend IoT data and the physical law behind data by providing a reasoning process. Limitations of our work are claimed to inspire future research in this new era.

Reasoning AI Performance Degradation in 6G Networks with Large Language Models

When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment

6G comprehensive intelligence: network operations and optimization based on Large Language Models

Proposed Explainable Interference Control Technique in 6G Networks Using Large Language Models (LLMs)

Efficient Driving Behavior Narration and Reasoning on Edge Device Using Large Language Models

IoT-LLM: Enhancing Real-World IoT Task Reasoning with Large Language Models

When Large Language Models Meet Optical Networks: Paving the Way for Automation

Generative AI-in-the-loop: Integrating LLMs and GPTs into the Next Generation Networks

Large Language Models (LLMs) Assisted Wireless Network Deployment in Urban Settings

Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities

Leveraging Large Language Models for DRL-Based Anti-Jamming Strategies in Zero Touch Networks

Enhancing Reasoning Capacity of SLM using Cognitive Enhancement

Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoning

Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models

Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance

Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewarding

Using Large Language Models to Understand Telecom Standards

Advanced Deep Learning Models for 6G: Overview, Opportunities and Challenges

LLM Agents as 6G Orchestrator: A Paradigm for Task-Oriented Physical-Layer Automation