Abstract:Multi‐agent simulation has attracted much attention in the field of computer animation. However, DRL multi‐agent simulation seldom considers skeleton‐level action spaces as it remains very challenging to generalize high dimensional observations and relate them with high dimensional action spaces. To this end, we present skeleton‐level control for multi‐agent simulation with deep reinforcement learning, with which we are able to procedurally generate real‐time collision‐free simulations directly on individual agents with a high‐dimensional skeleton‐level action space. Multi‐agent simulation has attracted much attention in the field of computer animation in the last decades for its ability to model interaction between autonomous micro level entities. It widely uses deep reinforcement learning (DRL), which allows us to model environments and its agents approaching real‐world and human‐level complexity, with applications in robotics and computer animation, among others. However, DRL multi‐agent simulation faces additional challenges: they have to be able to generalize high‐dimensional observations and relate them with a high‐dimensional action space, maximizing long‐term cumulated reward. Due to this, DRL systems with numerous interacting agents seldom consider skeleton‐level action spaces. To this end, we present skeleton‐level control for multi‐agent simulation with DRL. With our method, we are able to procedurally generate real‐time collision‐free simulations directly on individual agents with a high‐dimensional skeleton‐level action space. The state in our DRL system includes the velocity of the agent, its destination, and the status of its joints, as well as visual‐based information about the environment and other agents. Our reward function encourages motion into the target destinations, and enalizes collision. We provide extensive experimentation to show the ability of agents to reach their goal through its skeleton motion while successfully avoiding inter‐collisions.

EXPLORING THE FUSION OF INTELLIGENT AGENTS AND UNITY ML: A COMPREHENSIVE ANALYSIS OF ROBOT MOTION SIMULATION

HumRoboSim: an Autonomous Humanoid Robot Simulation System

Advancing Behavior Generation in Mobile Robotics through High-Fidelity Procedural Simulations

Creating Intelligent Agents in Game Using Reinforcement Learning

Procedural content generation for VR educational applications: The investigation of AI-based approaches for improving learning experience

Procedural urban environments for FPS games

PCGRL: Procedural Content Generation via Reinforcement Learning

Generative Personas That Behave and Experience Like Humans

Generating intelligent agent behaviors in multi-agent game AI using deep reinforcement learning algorithm

Mechanic Maker 2.0: Reinforcement Learning for Evaluating Generated Rules

Unity: A General Platform for Intelligent Agents

Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models

RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation

Learning to Generate All Feasible Actions

Skeleton‐level control for multi‐agent simulation through deep reinforcement learning

Using Unity to Help Solve Intelligence

Research on robot arm control based on Unity3D machine learning

Character Simulation Using Imitation Learning With Game Engine Physics

Physical Simulation for Multi-agent Multi-machine Tending

MAP3F: a decentralized approach to multi-agent pathfinding and collision avoidance with scalable 1D, 2D, and 3D feature fusion