AI in Human-computer Gaming: Techniques, Challenges and Opportunities

Qiyue Yin,Jun Yang,Kaiqi Huang,Meijing Zhao,Wancheng Ni,Bin Liang,Yan Huang,Shu Wu,Liang Wang

DOI: https://doi.org/10.1007/s11633-022-1384-6

2022-08-18

Abstract:With breakthrough of the AlphaGo, human-computer gaming AI has ushered in a big explosion, attracting more and more researchers all around the world. As a recognized standard for testing artificial intelligence, various human-computer gaming AI systems (AIs) have been developed such as the Libratus, OpenAI Five and AlphaStar, beating professional human players. The rapid development of human-computer gaming AIs indicate a big step of decision making intelligence, and it seems that current techniques can handle very complex human-computer games. So, one natural question raises: what are the possible challenges of current techniques in human-computer gaming, and what are the future trends? To answer the above question, in this paper, we survey recent successful game AIs, covering board game AIs, card game AIs, first-person shooting game AIs and real time strategy game AIs. Through this survey, we 1) compare the main difficulties among different kinds of games and the corresponding techniques utilized for achieving professional human level AIs; 2) summarize the mainstream frameworks and techniques that can be properly relied on for developing AIs for complex human-computer gaming; 3) raise the challenges or drawbacks of current techniques in the successful AIs; and 4) try to point out future trends in human-computer gaming AIs. Finally, we hope this brief review can provide an introduction for beginners, and inspire insights for researchers in the field of AI in human-computer gaming.

Artificial Intelligence

What problem does this paper attempt to address?

This paper aims to explore the current technologies, challenges and future trends of artificial intelligence in the field of human - machine games. Specifically, the paper attempts to solve the following problems:

1. **Main difficulties and corresponding technologies in different types of games**: By comparing the main difficulties and technical means faced by the implementation of professional - level artificial intelligence in different types of games (such as board games, card games, first - person shooter games and real - time strategy games), the paper analyzes the characteristics and challenges of these games.

2. **Mainstream frameworks and technologies**: Summarizes the mainstream frameworks and technologies that can be used to develop complex human - machine game AIs, which can support AI systems to reach or even surpass the level of human professional players.

3. **Challenges or shortcomings of existing technologies**: Points out the challenges or deficiencies in existing successful AI technologies, such as problems in dealing with incomplete - information games, long - term decision - making, non - transitive games and multi - agent cooperation.

4. **Future trends**: Tries to point out the future development directions in the field of human - machine game AI, including possible new technologies and research focuses.

Through the analysis of the above four aspects, the paper hopes to provide an introductory guide for beginners and new insights and inspiration for researchers in this field. The paper mainly focuses on the important progress of human - machine game AI published in top journals such as Science and Nature in recent years, covering typical games from Go to e - sports and their corresponding AI systems.