Abstract:First-person object-interaction tasks in high-fidelity, 3D, simulated environments such as the AI2Thor virtual home-environment pose significant sample-efficiency challenges for reinforcement learning (RL) agents learning from sparse task rewards. To alleviate these challenges, prior work has provided extensive supervision via a combination of reward-shaping, ground-truth object-information, and expert demonstrations. In this work, we show that one can learn object-interaction tasks from scratch without supervision by learning an attentive object-model as an auxiliary task during task learning with an object-centric relational RL agent. Our key insight is that learning an object-model that incorporates object-attention into forward prediction provides a dense learning signal for unsupervised representation learning of both objects and their relationships. This, in turn, enables faster policy learning for an object-centric relational RL agent. We demonstrate our agent by introducing a set of challenging object-interaction tasks in the AI2Thor environment where learning with our attentive object-model is key to strong performance. Specifically, we compare our agent and relational RL agents with alternative auxiliary tasks to a relational RL agent equipped with ground-truth object-information, and show that learning with our object-model best closes the performance gap in terms of both learning speed and maximum success rate. Additionally, we find that incorporating object-attention into an object-model's forward predictions is key to learning representations which capture object-category and object-state.

Playing FPS Games with Environment-Aware Hierarchical Reinforcement Learning

Playing FPS Games with Deep Reinforcement Learning

Implementing First-Person Shooter Game AI in WILD-SCAV with Rule-Enhanced Deep Reinforcement Learning

Learning to Shoot in First Person Shooter Games by Stabilizing Actions and Clustering Rewards for Reinforcement Learning

Combo-Action: Training Agent for FPS Game with Auxiliary Tasks.

Training Interactive Agent in Large FPS Game Map with Rule-enhanced Reinforcement Learning

Hierarchical Reinforcement Learning in Complex 3D Environments

Using VizDoom Research Platform Scenarios for Benchmarking Reinforcement Learning Algorithms in First-Person Shooter Games

Hierarchical Deep Reinforcement Learning Agent with Counter Self-play on Competitive Games

Path Planning for Robots Combined with Zero-Shot and Hierarchical Reinforcement Learning in Novel Environments

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

Learning to Design Games: Strategic Environments in Reinforcement Learning

On the Development of an Autonomous Agent for a 3D First-Person Shooter Game Using Deep Reinforcement Learning

Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation

Room Clearance with Feudal Hierarchical Reinforcement Learning

Hierarchical Reinforcement Learning for Multi-agent MOBA Game

Self-play Decision-making Method of Deep Reinforcement Learning Guided by Behavior Tree under Complex Environment

Reinforcement Learning for Sparse-Reward Object-Interaction Tasks in a First-person Simulated 3D Environment

Data-Efficient Hierarchical Reinforcement Learning for Robotic Assembly Control Applications

Scaling intelligent agent combat behaviors through hierarchical reinforcement learning

Hierarchical reinforcement learning with natural language subgoals