Abstract:Text-based games present an exciting test-bed for reinforcement learning algorithms in the natural language environment.In these adventure games, an agent must learn to interact with the environment through text in order to accomplish tasks, facing large and combinational action space as well as partial observability issues.However, existing solutions fail to decompose the task and abstract the action autonomously, which either pre-specify the subtasks or pretrain on the human gameplay dataset.In this work, we introduce a novel skill-centric reinforcement learning framework, which is capable of abstracting the action in an end-to-end manner.To learn a more disentangled skill, we focus on the informativeness and distinguishability of the skill in accordance with the information bottleneck principle.Specifically, we introduce a discriminator to enable the skill to reflect the trajectory and push their representations onto the unit hypersphere to distribute uniformly.Moreover, a self-predictive mechanism is employed to learn inverse and forward dynamics, and a self-recovery mechanism is leveraged to refine the action representation, thus resulting in a more comprehensive perception of dynamics and more effective representations of textual state and action.Empirical experiments are carried out on the Jericho environment and the results validate the superiority against state-of-the-art baselines.

Enhancing Text-based Reinforcement Learning Agents with Commonsense Knowledge

EXPLORER: Exploration-guided Reasoning for Textual Reinforcement Learning

Learning Symbolic Rules over Abstract Meaning Representations for Textual Reinforcement Learning

Evaluating Commonsense in Pre-trained Language Models

Revisiting the Roles of "Text" in Text Games

Language Understanding for Text-based Games Using Deep Reinforcement Learning

Building a commonsense knowledge base for context-awareness inference

Augmenting End-to-End Dialogue Systems with Commonsense Knowledge

An Analysis of Deep Reinforcement Learning Agents for Text-based Games

Using reinforcement learning to learn how to play text-based games

Abstract then Play: A Skill-centric Reinforcement Learning Framework for Text-based Games.

On the Effects of Fine-tuning Language Models for Text-Based Reinforcement Learning

Toward Collaborative Reinforcement Learning Agents that Communicate Through Text-Based Natural Language

CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning

Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformation

Commonsense Knowledge Transfer for Pre-trained Language Models

Transfer in Deep Reinforcement Learning using Knowledge Graphs

Perceiving the World: Question-guided Reinforcement Learning for Text-based Games

Learning to Play Text-based Adventure Games with Maximum Entropy Reinforcement Learning

Don't just listen, use your imagination: Leveraging visual common sense for non-visual tasks

Knowledge-driven Natural Language Understanding of English Text and its Applications