Abstract:Large-scale knowledge discovery and decision-making based on textual data are crucial in consumer electronics. For instance, intelligent home robots analyze textual data to tailor household tasks to user preferences, enhancing smart home convenience and comfort. Text-based games offer a research platform for testing and developing artificial intelligence algorithms. These games rely on written narratives and textual interactions while presenting large and combinational action space, and partial observability issues to agents. However, previous methods relied on pre-specifying the subtasks or pre-training on datasets derived from human gameplay, requiring prior knowledge and manual configuration. In this paper, we introduce a novel action abstraction method to free our hands based on the option framework, which uses temporally extended macro-actions to encapsulate relevant long-horizon behaviors. Through leveraging options, our framework decomposes complex tasks autonomously without pre-specified subtasks or demonstrations, thereby partially alleviating the obstacles posed by large and combinatorial action spaces. Moreover, for partial observability issue, we employ a bi-directional attention mechanism to estimate state-action value accurately, strengthening the interdependence between state and action. We conduct extensive experiments on text-based games and the results show the effectiveness of our proposed framework, highlighting its potential in enhancing intelligence in consumer electronics.

Object-Oriented State Abstraction in Reinforcement Learning for Video Games

Learning Efficient Representations for Goal-conditioned Reinforcement Learning Via Tabu Search

Object-sensitive Deep Reinforcement Learning

Learning to Play Video Games with Intuitive Physics Priors

Reinforcement Learning with Dual-Observation for General Video Game Playing

Reinforcement Learning with Action-Specific Focuses in Video Games

State Representation Learning for Effective Deep Reinforcement Learning.

Unsupervised Video Object Segmentation for Deep Reinforcement Learning

Reinforcement Learning and Video Games

State of the Art Control of Atari Games Using Shallow Reinforcement Learning

Role‐based Attention in Deep Reinforcement Learning for Games

A Survey of Deep Reinforcement Learning in Video Games

Investigating Simple Object Representations in Model-Free Deep Reinforcement Learning

Hands-Free: Action Abstraction with Hierarchical Reinforcement Learning in Text-Based Games

Using deep reinforcement learning to reveal how the brain encodes abstract state-space representations in high-dimensional environments

State Abstraction via Deep Supervised Hash Learning

Learning Markov State Abstractions for Deep Reinforcement Learning

Learning to Identify Critical States for Reinforcement Learning from Videos

An object-oriented representation for efficient reinforcement learning

Efficient Exploration and Discriminative World Model Learning with an Object-Centric Abstraction