Abstract:How to accurately learn task-relevant state representations from high-dimensional observations with visual distractions is a realistic and challenging problem in visual reinforcement learning. Recently, unsupervised representation learning methods based on bisimulation metrics, contrast, prediction, and reconstruction have shown the ability for task-relevant information extraction. However, due to the lack of appropriate mechanisms for the extraction of task information in the prediction, contrast, and reconstruction-related approaches and the limitations of bisimulation-related methods in domains with sparse rewards, it is still difficult for these methods to be effectively extended to environments with distractions. To alleviate these problems, in the paper, the action sequences, which contain task-intensive signals, are incorporated into representation learning. Specifically, we propose a Sequential Action--induced invariant Representation (SAR) method, in which the encoder is optimized by an auxiliary learner to only preserve the components that follow the control signals of sequential actions, so the agent can be induced to learn the robust representation against distractions. We conduct extensive experiments on the DeepMind Control suite tasks with distractions while achieving the best performance over strong baselines. We also demonstrate the effectiveness of our method at disregarding task-irrelevant information by deploying SAR to real-world CARLA-based autonomous driving with natural distractions. Finally, we provide the analysis results of generalization drawn from the generalization decay and t-SNE visualization. Code and demo videos are available at <a class="link-external link-https" href="https://github.com/DMU-XMU/SAR.git" rel="external noopener nofollow">this https URL</a>.

Differentiable SAR Renderer Embedded Reinforcement Learning for View Angles Inversion in SAR Images

Reinforcement Learning for SAR View Angle Inversion with Differentiable SAR Renderer

Reinforcement Learning for SAR Target Orientation Inference with the Differentiable SAR Renderer

SAR Image Generation by Integrating Differentiable SAR Renderer with Neural Networks

Differentiable SAR Renderer and Image-Based Target Reconstruction

Differentiable SAR Renderer and SAR Target Reconstruction

Differentiable Rendering for Synthetic Aperture Radar Imagery

A Reinforcement Learning Framework for Scattering Feature Extraction and SAR Image Interpretation

Learning Surface Scattering Parameters From SAR Images Using Differentiable Ray Tracing

SAR-NeRF: Neural Radiance Fields for Synthetic Aperture Radar Multi-View Representation

Extension of Differentiable SAR Renderer for Ground Target Reconstruction from Multiview Images and Shadows

DeepRED Based Sparse SAR Imaging

Reciprocal translation between SAR and optical remote sensing images with cascaded-residual adversarial networks

Active Reconfigurable Intelligent Surface Empowered Synthetic Aperture Radar Imaging

Sequential Action-Induced Invariant Representation for Reinforcement Learning

Differentially Deep Subspace Representation for Unsupervised Change Detection of SAR Images

ISAR-NeRF: Neural Radiance Fields for 3D Imaging of Space Target from Multi-view ISAR Images

A brain-inspired approach for SAR-to-optical image translation based on diffusion models

Residual-Based Implicit Neural Representation for Synthetic Aperture Radar Images

Conditional Diffusion for SAR to Optical Image Translation