Abstract:Large-scale knowledge discovery and decision-making based on textual data are crucial in consumer electronics. For instance, intelligent home robots analyze textual data to tailor household tasks to user preferences, enhancing smart home convenience and comfort. Text-based games offer a research platform for testing and developing artificial intelligence algorithms. These games rely on written narratives and textual interactions while presenting large and combinational action space, and partial observability issues to agents. However, previous methods relied on pre-specifying the subtasks or pre-training on datasets derived from human gameplay, requiring prior knowledge and manual configuration. In this paper, we introduce a novel action abstraction method to free our hands based on the option framework, which uses temporally extended macro-actions to encapsulate relevant long-horizon behaviors. Through leveraging options, our framework decomposes complex tasks autonomously without pre-specified subtasks or demonstrations, thereby partially alleviating the obstacles posed by large and combinatorial action spaces. Moreover, for partial observability issue, we employ a bi-directional attention mechanism to estimate state-action value accurately, strengthening the interdependence between state and action. We conduct extensive experiments on text-based games and the results show the effectiveness of our proposed framework, highlighting its potential in enhancing intelligence in consumer electronics.

Generalization in Text-based Games via Hierarchical Reinforcement Learning

Deep Reinforcement Learning with Stacked Hierarchical Attention for Text-based Games

Hierarchical reinforcement learning with natural language subgoals

Transfer in Deep Reinforcement Learning using Knowledge Graphs

An Analysis of Deep Reinforcement Learning Agents for Text-based Games

Abstract then Play: A Skill-centric Reinforcement Learning Framework for Text-based Games.

Language Understanding for Text-based Games Using Deep Reinforcement Learning

Perceiving the World: Question-guided Reinforcement Learning for Text-based Games

Deep Reinforcement Learning for NLP.

Learning Two-Step Hybrid Policy for Graph-Based Interpretable Reinforcement Learning

Advances in Hierarchical Reinforcement Learning

Boosting Reinforcement Learning via Hierarchical Game Playing With State Relay

A Game-Theoretic Perspective of Generalization in Reinforcement Learning

Learning to Play Text-based Adventure Games with Maximum Entropy Reinforcement Learning

Hands-Free: Action Abstraction with Hierarchical Reinforcement Learning in Text-Based Games

Using reinforcement learning to learn how to play text-based games

Scalable and Transferable Reinforcement Learning for Multi-Agent Mixed Cooperative–Competitive Environments Based on Hierarchical Graph Attention

A Survey Analyzing Generalization in Deep Reinforcement Learning

$\epsilon$-Invariant Hierarchical Reinforcement Learning for Building Generalizable Policy

Hierarchical Reinforcement Learning Based on Continuous Subgoal Space

Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation