Abstract:Artificial intelligence (AI) has enabled agents to master complex video games, from first-person shooters like Counter-Strike to real-time strategy games such as StarCraft II and racing games like Gran Turismo. While these achievements are notable, applying these AI methods in commercial video game production remains challenging due to computational constraints. In commercial scenarios, the majority of computational resources are allocated to 3D rendering, leaving limited capacity for AI methods, which often demand high computational power, particularly those relying on pixel-based sensors. Moreover, the gaming industry prioritizes creating human-like behavior in AI agents to enhance player experience, unlike academic models that focus on maximizing game performance. This paper introduces a novel methodology for training neural networks via imitation learning to play a complex, commercial-standard, VALORANT-like 2v2 tactical shooter game, requiring only modest CPU hardware during inference. Our approach leverages an innovative, pixel-free perception architecture using a small set of ray-cast sensors, which capture essential spatial information efficiently. These sensors allow AI to perform competently without the computational overhead of traditional methods. Models are trained to mimic human behavior using supervised learning on human trajectory data, resulting in realistic and engaging AI agents. Human evaluation tests confirm that our AI agents provide human-like gameplay experiences while operating efficiently under computational constraints. This offers a significant advancement in AI model development for tactical shooter games and possibly other genres.

Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review

Adaptive Shooting for Bots in First Person Shooter Games Using Reinforcement Learning

Using VizDoom Research Platform Scenarios for Benchmarking Reinforcement Learning Algorithms in First-Person Shooter Games

Evaluating reinforcement learning algorithms in first-person shooter games using VizDoom

On the Development of an Autonomous Agent for a 3D First-Person Shooter Game Using Deep Reinforcement Learning

Playing FPS Games with Deep Reinforcement Learning

Learning to Shoot in First Person Shooter Games by Stabilizing Actions and Clustering Rewards for Reinforcement Learning

Review of artificial neural networks in first-person shooter games

Training Interactive Agent in Large FPS Game Map with Rule-enhanced Reinforcement Learning

Human-like Bots for Tactical Shooters Using Compute-Efficient Sensors

Deep Reinforcement Learning for Doom using Unsupervised Auxiliary Tasks

Training an Agent for FPS Doom Game Using Visual Reinforcement Learning and VizDoom

Implementing First-Person Shooter Game AI in WILD-SCAV with Rule-Enhanced Deep Reinforcement Learning

Arnold: An Autonomous Agent to Play FPS Games

Artificial Intelligence and Deep Learning in Video Games A Brief Review

A Survey of Deep Reinforcement Learning in Video Games

Playing a FPS Doom Video Game with Deep Visual Reinforcement Learning

Playing First-Person-Shooter Games with A3C-Anticipator Network Based Agents Using Reinforcement Learning.

Reinforcement Learning in Game Industry—Review, Prospects and Challenges

Augmenting Automated Game Testing with Deep Reinforcement Learning

DRE-Bot: A Hierarchical First Person Shooter Bot Using Multiple Sarsa(λ) Reinforcement Learners