Instruction-Driven Game Engines on Large Language Models

Hongqiu Wu,Yan Wang,Xingyuan Liu,Hai Zhao,Min Zhang

2024-08-23

Abstract:The Instruction-Driven Game Engine (IDGE) project aims to democratize game development by enabling a large language model (LLM) to follow free-form game rules and autonomously generate game-play processes. The IDGE allows users to create games by issuing simple natural language instructions, which significantly lowers the barrier for game development. We approach the learning process for IDGEs as a Next State Prediction task, wherein the model autoregressively predicts in-game states given player actions. It is a challenging task because the computation of in-game states must be precise; otherwise, slight errors could disrupt the game-play. To address this, we train the IDGE in a curriculum manner that progressively increases the model's exposure to complex scenarios. Our initial progress lies in developing an IDGE for Poker, a universally cherished card game. The engine we've designed not only supports a wide range of poker variants but also allows for high customization of rules through natural language inputs. Furthermore, it also favors rapid prototyping of new games from minimal samples, proposing an innovative paradigm in game development that relies on minimal prompt and data engineering. This work lays the groundwork for future advancements in instruction-driven game creation, potentially transforming how games are designed and played.

Artificial Intelligence

What problem does this paper attempt to address?

The paper attempts to address the issue of how to lower the threshold for game development and enhance the diversity of games and player engagement through an Instruction-Driven Game Engine (IDGE). Specifically, the paper focuses on the following aspects:

1. **High threshold of game development**: Traditional game engines rely on complex programming languages, making it difficult for many game enthusiasts to realize their game ideas. The paper proposes a game engine based on natural language instructions, allowing anyone to create games through simple natural language commands.

2. **Disconnect between players and developers**: Due to the diversity in players' age, gender, and cultural background, it is challenging for developers to meet all players' needs. The paper attempts to bridge this gap through IDGE, enabling players to customize games via natural language instructions, thereby better meeting their needs.

3. **Challenges in game state prediction**: IDGE needs to accurately predict game states based on player actions and game rules. This is a challenging task because any minor error could disrupt the gaming experience. The paper trains the model using a curriculum learning approach that gradually increases complexity to improve its stability and diversity.

4. **Diversity and flexibility of game scripts**: IDGE supports not only structured game scripts but also game scripts described in natural language. The paper enhances the model's understanding of different forms of game scripts through Segment Rephrasing techniques.

In summary, the paper aims to democratize game development through IDGE, making game development simpler, more flexible, and personalized, thereby enhancing player engagement and satisfaction.