Abstract:Testing video games is an increasingly difficult task as traditional methods fail to scale with growing software systems. Manual testing is a very labor-intensive process, and therefore quickly becomes cost prohibitive. Using scripts for automated testing is affordable, however scripts are ineffective in non-deterministic environments, and knowing when to run each test is another problem altogether. The modern game's complexity, scope, and player expectations are rapidly increasing where quality control is a big portion of the production cost and delivery risk. Reducing this risk and making production happen is a big challenge for the industry currently. To keep production costs realistic up-to and after release, we are focusing on preventive quality assurance tactics alongside testing and data analysis automation. We present SUPERNOVA (Selection of tests and Universal defect Prevention in External Repositories for Novel Objective Verification of software Anomalies), a system responsible for test selection and defect prevention while also functioning as an automation hub. By integrating data analysis functionality with machine and deep learning capability, SUPERNOVA assists quality assurance testers in finding bugs and developers in reducing defects, which improves stability during the production cycle and keeps testing costs under control. The direct impact of this has been observed to be a reduction in 55% or more testing hours for an undisclosed sports game title that has shipped, which was using these test selection optimizations. Furthermore, using risk scores generated by a semi-supervised machine learning model, we are able to detect with 71% precision and 77% recall the probability of a change-list being bug inducing, and provide a detailed breakdown of this inference to developers. These efforts improve workflow and reduce testing hours required on game titles in development.

Assessing Video Game Balance using Autonomous Agents

Towards Automated Video Game Testing: Still a Long Way to Go

A Survey of Video Game Testing

Exploring Gameplay With AI Agents

Metagame Autobalancing for Competitive Multiplayer Games

Cooperative Multi-agent Approach for Automated Computer Game Testing

It might be balanced, but is it actually good? An Empirical Evaluation of Game Level Balancing

Evaluation of Systematically Developed Gamification Strategies with Game-Balance Simulation Tools

Automated Play-Testing Through RL Based Human-Like Play-Styles Generation

An approach to automated videogame beta testing

Using Reinforcement Learning for Load Testing of Video Games

SUPERNOVA: Automating Test Selection and Defect Prevention in AAA Video Games Using Risk Based Testing and Machine Learning

GUI Testing Arena: A Unified Benchmark for Advancing Autonomous GUI Testing Agent

Challenge balancing for personalised game spaces

Developing and validating interoperable ontology-driven game-based assessments

Configurable Agent With Reward As Input: A Play-Style Continuum Generation

Automatic Emotional Balancing in Game Design: Use of Emotional Response to Increase Player Immersion

RaidEnv: Exploring New Challenges in Automated Content Balancing for Boss Raid Games

Evaluating Environments Using Exploratory Agents

Inspector: Pixel-Based Automated Game Testing via Exploration, Detection, and Investigation

Towards Seamless Integration of AI-Driven Agents in Video Games: Techniques, Challenges, and Implications