Abstract:The steadily increasing popularity of computer games has led to the rise of a multi-billion dollar industry. Due to the scale of the computer game industry, developing a successful game is challenging. In addition, prior studies show that gamers are extremely hard to please, making the quality of games an important issue. Most online game stores allow users to review a game that they bought. Such reviews can make or break a game, as other potential buyers often base their purchasing decisions on the reviews of a game. Hence, studying game reviews can help game developers better understand user concerns, and further improve the user-perceived quality of games. In this paper, we perform an empirical study of the reviews of 6224 games on the Steam platform, one of the most popular digital game delivery platforms, to better understand if game reviews share similar characteristics with mobile app reviews, and thereby understand whether the conclusions and tools from mobile app review studies can be leveraged by game developers. In addition, new insights from game reviews could possibly open up new research directions for research of mobile app reviews. We first conduct a preliminary study to understand the number of game reviews and the complexity to read through them. In addition, we study the relation between several game-specific characteristics and the fluctuations of the number of reviews that are received on a daily basis. We then focus on the useful information that can be acquired from reviews by studying the major concerns that users express in their reviews, and the amount of play time before players post a review. We find that game reviews are different from mobile app reviews along several aspects. Additionally, the number of playing hours before posting a review is a unique and helpful attribute for developers that is not found in mobile app reviews. Future longitudinal studies should be conducted to help developers and researchers leverage this information. Although negative reviews contain more valuable information about the negative aspects of the game, such as mentioned complaints and bug reports, developers and researchers should also not ignore the potentially useful information in positive reviews. Our study on game reviews serves as a starting point for other game review researchers, and suggests that prior studies on mobile app reviews may need to be revisited.

The Wisdom of the Gaming Crowd

An empirical study of game reviews on the Steam platform

Mining Insights From Esports Game Reviews With an Aspect-Based Sentiment Analysis Framework

Game Reviews Reviewed: A Game Designer’s Perspective on AI-generated Game Review Analyses

Length and sentiment analysis of reviews about top-level video game genres on the steam platform

Artificial intelligence for video game visualization, advancements, benefits and challenges

Sentiment Analysis of Game Review Using Machine Learning in a Hadoop Ecosystem

Trkic G00gle: Why and How Users Game Translation Algorithms

Analyzing AI and the Impact in Video Games

Characterizing and understanding game reviews

An opinion mining methodology to analyse games for health

Games for Artificial Intelligence Research: A Review and Perspectives

A NLP Approach to "Review Bombing" in Metacritic PC Videogames User Ratings

Subjective and Objective Analysis of Streamed Gaming Videos

Art critic: Multisignal vision and speech interaction system in a gaming context

Serious Games and AI: Challenges and Opportunities for Computational Social Science

Towards Using Gameplay Videos for Detecting Issues in Video Games

Explaining and Predicting Helpfulness and Funniness of Online Reviews on the Steam Platform

A review of artificial intelligence in video games: From preset scripts to self-learning

Analysis of players' experience perceptions of mobile games based on text mining and a complex network

The Ethics of AI in Games