Abstract:AI is gradually receiving more attention as a fundamental feature to increase the immersion in digital games. Among the several AI approaches, player modeling is becoming an important one. The main idea is to understand and model the player characteristics and behaviors in order to develop a better AI. In this work, we discuss several aspects of this new field. We proposed a taxonomy to organize the area, discussing several facets of this topic, ranging from implementation decisions up to what a model attempts to describe. We then classify, in our taxonomy, some of the most important works in this field. We also presented a generic approach to deal with player modeling using ML, and we instantiated this approach to model players' preferences in the game Civilization IV. The instantiation of this approach has several steps. We first discuss a generic representation, regardless of what is being modeled, and evaluate it performing experiments with the strategy game Civilization IV. Continuing the instantiation of the proposed approach we evaluated the applicability of using game score information to distinguish different preferences. We presented a characterization of virtual agents in the game, comparing their behavior with their stated preferences. Once we have characterized these agents, we were able to observe that different preferences generate different behaviors, measured by several game indicators. We then tackled the preference modeling problem as a binary classification task, with a supervised learning approach. We compared four different methods, based on different paradigms (SVM, AdaBoost, NaiveBayes and JRip), evaluating them on a set of matches played by different virtual agents. We conclude our work using the learned models to infer human players' preferences. Using some of the evaluated classifiers we obtained accuracies over 60% for most of the inferred preferences.

Non-player character decision-making in computer games

Ancillary Mechanism for Autonomous Decision-Making Process in Asymmetric Confrontation: a View from Gomoku

APPLICATION OF ARTIFICIAL INTELLIGENCE TECHNIQUES FOR CREATING NON-PLAYABLE CHARACTERS IN THE GAME

Artificial Intelligence (AI)-Based Self-Deciding Character Development Application in Two-Dimensional Video Games

Crosston Tavern: Modulating Autonomous Characters Behaviour through Player-NPC Conversation

Game Interactive Learning: A New Paradigm Towards Intelligent Decision-Making

AI & NPC IN GAMES

Current Status of Applying Artificial Intelligence in Digital Games

Action-based Character AI in Video-games with CogBots Architecture: A Preliminary Report

Understanding Human and Machine Interaction from Decision Perspective: An Empirical Study Based on the Game of Go

Player-Centered AI for Automatic Game Personalization: Open Problems

NPCs as People, Too: The Extreme AI Personality Engine

Can we infer player behavior tendencies from a player's decision-making data? Integrating Theory of Mind to Player Modeling

A Methodology for Player Modeling based on Machine Learning

Player Choices, Game Endings and the Design of Moral Dilemmas in Games

Managing the Personality of NPCs with Your Interactions: A Game Design System Based on Large Language Models

AI in (and for) Games

CAPIR: Collaborative Action Planning with Intention Recognition

AI in Human-computer Gaming: Techniques, Challenges and Opportunities

Implementation of Finite State Machine Models on the Artificial Intelligence System of Characters in The Game "MMORPG" using RPG Maker

An Improved Utility-Based Artificial Intelligence to Capture NPC Behaviour in Fighting Games Using Genetic Algorithm