Abstract:In real-world scenarios, making navigation decisions for autonomous driving involves a sequential set of steps. These judgments are made based on partial observations of the environment, while the underlying model of the environment remains unknown. A prevalent method for resolving such issues is reinforcement learning, in which the agent acquires knowledge through a succession of rewards in addition to fragmentary and noisy observations. This study introduces an algorithm named deep reinforcement learning navigation via decision transformer (DRLNDT) to address the challenge of enhancing the decision-making capabilities of autonomous vehicles operating in partially observable urban environments. The DRLNDT framework is built around the Soft Actor-Critic (SAC) algorithm. DRLNDT utilizes Transformer neural networks to effectively model the temporal dependencies in observations and actions. This approach aids in mitigating judgment errors that may arise due to sensor noise or occlusion within a given state. The process of extracting latent vectors from high-quality images involves the utilization of a variational autoencoder (VAE). This technique effectively reduces the dimensionality of the state space, resulting in enhanced training efficiency. The multimodal state space consists of vector states, including velocity and position, which the vehicle's intrinsic sensors can readily obtain. Additionally, latent vectors derived from high-quality images are incorporated to facilitate the Agent's assessment of the present trajectory. Experiments demonstrate that DRLNDT may achieve a superior optimal policy without prior knowledge of the environment, detailed maps, or routing assistance, surpassing the baseline technique and other policy methods that lack historical data.

DODT: Enhanced Online Decision Transformer Learning through Dreamer's Actor-Critic Trajectory Forecasting

Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modeling

Rethinking Decision Transformer via Hierarchical Reinforcement Learning

TransDreamer: Reinforcement Learning with Transformer World Models

Solving time-delay issues in reinforcement learning via transformers

Predictive Coding for Decision Transformer

ACT: Empowering Decision Transformer with Dynamic Programming via Advantage Conditioning

An Intelligent Maneuver Decision-Making Approach for Air Combat Based on Deep Reinforcement Learning and Transformer Networks

Online Decision MetaMorphFormer: A Casual Transformer-Based Reinforcement Learning Framework of Universal Embodied Intelligence

Decision Transformer: Reinforcement Learning via Sequence Modeling

Integrating Multi-Modal Input Token Mixer Into Mamba-Based Decision Models: Decision MetaMamba

Learning to View: Decision Transformers for Active Object Detection

Elastic Decision Transformer

Sample-efficient Imitative Multi-token Decision Transformer for Real-world Driving

Meta-DT: Offline Meta-RL as Conditional Sequence Modeling with World Model Disentanglement

SPformer: A Transformer Based DRL Decision Making Method for Connected Automated Vehicles

Deep reinforcement learning navigation via decision transformer in autonomous driving

Critic-Guided Decision Transformer for Offline Reinforcement Learning

Solving Multi-Goal Robotic Tasks with Decision Transformer

Mamba as Decision Maker: Exploring Multi-scale Sequence Modeling in Offline Reinforcement Learning