Abstract:When mobile meets LLMs, mobile app users deserve to have more intelligent usage experiences. For this to happen, we argue that there is a strong need to appl LLMs for the mobile ecosystem. We therefore provide a research roadmap for guiding our fellow researchers to achieve that as a whole. In this roadmap, we sum up six directions that we believe are urgently required for research to enable native intelligence in mobile devices. In each direction, we further summarize the current research progress and the gaps that still need to be filled by our fellow researchers.

What problem does this paper attempt to address?

The paper aims to address several key issues in applying large language models (LLMs) to the mobile device ecosystem. Specifically, the authors believe that current research has not yet clarified how to effectively integrate LLMs into mobile devices to enhance user experience and application development efficiency. Therefore, the paper proposes a preliminary research roadmap to guide researchers in exploring the following 6 main directions: 1. **Prepare dedicated datasets for fine-tuning**: Including datasets of user interactions, software engineering scenarios, and other multimodal data processing scenarios to better adapt LLMs to the application needs of mobile devices. 2. **Apply LLMs to mobile application development and analysis**: Covering the entire development cycle from requirements engineering to code generation, testing, and debugging, and encompassing various aspects such as static code analysis and dynamic application testing. 3. **Deploy LLMs on mobile devices**: Explore how to overcome challenges on resource-constrained devices and optimize the local performance of LLMs through techniques such as model compression and knowledge distillation. 4. **Defend against security threats to on-device LLMs**: Research how to protect LLMs stored on mobile devices from attackers. 5. **Provide LLM-supported framework APIs**: Design framework interfaces that are convenient for application developers to use, simplifying the development process of intelligent applications. 6. **Provide runtime monitoring capabilities**: Utilize LLMs to achieve highly intelligent runtime monitoring technologies to analyze application behavior and optimize performance. Through research in these 6 directions, the paper hopes to fill the current technical gaps in applying LLMs on mobile devices, thereby promoting progress and development in the field of mobile software engineering.

LLM for Mobile: An Initial Roadmap

A First Look at LLM-powered Smartphones

LLM App Store Analysis: A Vision and Roadmap

A Contemporary Overview: Trends and Applications of Large Language Models on Mobile Devices

Mobile Edge Intelligence for Large Language Models: A Contemporary Survey

Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security

LLM as a System Service on Mobile Devices

Navigating LLM Ethics: Advancements, Challenges, and Future Directions

Rethinking Mobile AI Ecosystem in the LLM Era

Large Language Model Performance Benchmarking on Mobile Platforms: A Thorough Evaluation

MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases

All Roads Lead to Rome: Unveiling the Trajectory of Recommender Systems Across the LLM Era

An Empirical Study on Challenges for LLM Application Developers

Deep Learning Towards Mobile Applications

A Survey on Human-Centric LLMs

Large Language Models on Mobile Devices: Measurements, Analysis, and Insights

Empowering LLM to use Smartphone for Intelligent Task Automation

LLM for Test Script Generation and Migration: Challenges, Capabilities, and Opportunities

LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices