Abstract:The steadily increasing popularity of computer games has led to the rise of a multi-billion dollar industry. Due to the scale of the computer game industry, developing a successful game is challenging. In addition, prior studies show that gamers are extremely hard to please, making the quality of games an important issue. Most online game stores allow users to review a game that they bought. Such reviews can make or break a game, as other potential buyers often base their purchasing decisions on the reviews of a game. Hence, studying game reviews can help game developers better understand user concerns, and further improve the user-perceived quality of games. In this paper, we perform an empirical study of the reviews of 6224 games on the Steam platform, one of the most popular digital game delivery platforms, to better understand if game reviews share similar characteristics with mobile app reviews, and thereby understand whether the conclusions and tools from mobile app review studies can be leveraged by game developers. In addition, new insights from game reviews could possibly open up new research directions for research of mobile app reviews. We first conduct a preliminary study to understand the number of game reviews and the complexity to read through them. In addition, we study the relation between several game-specific characteristics and the fluctuations of the number of reviews that are received on a daily basis. We then focus on the useful information that can be acquired from reviews by studying the major concerns that users express in their reviews, and the amount of play time before players post a review. We find that game reviews are different from mobile app reviews along several aspects. Additionally, the number of playing hours before posting a review is a unique and helpful attribute for developers that is not found in mobile app reviews. Future longitudinal studies should be conducted to help developers and researchers leverage this information. Although negative reviews contain more valuable information about the negative aspects of the game, such as mentioned complaints and bug reports, developers and researchers should also not ignore the potentially useful information in positive reviews. Our study on game reviews serves as a starting point for other game review researchers, and suggests that prior studies on mobile app reviews may need to be revisited.

An Empirical Analysis of Compatibility Issues for Industrial Mobile Games (Practical Experience Report)

A Cross-Platform Analysis of Bugs and Bug-Fixing in Open Source Projects: Desktop Vs. Android Vs. Ios

Demystifying Device-specific Compatibility Issues in Android Apps

Automatically Detecting API-induced Compatibility Issues in Android Apps: A Comparative Analysis (Replicability Study)

An Observational Study on Compatibility-Related API Usage

An Empirical Study of Investigating Mobile Applications Development Challenges

Experience Report: Understanding Cross-Platform App Issues from User Reviews

A Unified Framework for Mini-game Testing: Experience on WeChat

Compatibility Testing Service for Mobile Applications

Understanding and Detecting Fragmentation-Induced Compatibility Issues for Android Apps

A Model Based Compatibility Testing Method for Mobile Application

An Empirical Study of Functional Bugs in Android Apps.

An Empirical Study of Android Test Generation Tools in Industrial Cases.

An empirical study of game reviews on the Steam platform

A Comprehensive Approach to Quality Assurance in a Mobile Game Project

Mobile Game User Research: The World as Your Lab?

Challenges Of Mobile Applications Development: Initial Results

Understanding Gaming Experience in Mobile Multiplayer Online Battle Arena Games.

Mobile Compatibility Testing Using Multi-objective Genetic Algorithm

Analysis of players' experience perceptions of mobile games based on text mining and a complex network

Successes, Challenges, and Rethinking – an Industrial Investigation on Crowdsourced Mobile Application Testing