Abstract:Identifying an appropriate task space that simplifies control solutions is important for solving robotic manipulation problems. One approach to this problem is learning an appropriate low-dimensional action space. Linear and nonlinear action mapping methods have trade-offs between simplicity on the one hand and the ability to express motor commands outside of a single low-dimensional subspace on the other. We propose that learning local linear action representations that adapt based on the current configuration of the robot achieves both of these benefits. Our state-conditioned linear maps ensure that for any given state, the high-dimensional robotic actuations are linear in the low-dimensional action. As the robot state evolves, so do the action mappings, ensuring the ability to represent motions that are immediately necessary. These local linear representations guarantee desirable theoretical properties by design, and we validate these findings empirically through two user studies. Results suggest state-conditioned linear maps outperform conditional autoencoder and PCA baselines on a pick-and-place task and perform comparably to mode switching in a more complex pouring task.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to solve the problem of simplifying high - dimensional control commands in robotic manipulation. Specifically, the authors focus on how to simplify the control of multi - degree - of - freedom (DOF) robotic arms by learning a low - dimensional action space, thereby improving control efficiency and performance. #### Main problems: 1. **Complexity of high - dimensional control commands**: Robotic manipulation tasks usually involve simultaneously controlling multiple actuators or degrees of freedom (DOFs), which makes direct control very complex. 2. **Limitations of existing methods**: - **Linear mapping methods**: Although simple and easy to analyze, they assume that all task - related high - dimensional commands exist in a single low - dimensional subspace, which limits their expressive power. - **Non - linear mapping methods**: Such as conditional auto - encoders (CAE), have stronger expressive power, but are difficult to analyze and require additional loss terms to ensure certain desired properties. #### Proposed solution: The authors propose a new method - **State Conditioned Linear Maps (SCL maps)**. This method combines the analytical advantages of linear mapping and the flexibility of non - linear neural networks. SCL maps use neural networks to predict local linear bases, which can be adjusted according to the current state of the robot, thus ensuring that at any given state, high - dimensional robot execution is a linear function of low - dimensional actions. #### Specific goals: - **Simplify control**: By mapping low - dimensional actions to high - dimensional control commands, reduce the cognitive burden on human operators and improve the learning efficiency of artificial intelligence agents. - **Ensure theoretical properties**: Design SCL maps to ensure desirable properties such as proportionality and soft invertibility. - **Empirical verification**: Verify the effectiveness of SCL maps through two user studies, showing that it outperforms PCA and CAE baselines in grasping and placing tasks and performs comparably to mode - switching in more complex pouring tasks. ### Summary: The main goal of this paper is to develop a new low - dimensional action mapping method to simplify the control of multi - degree - of - freedom robotic arms while maintaining good theoretical properties and demonstrating its superiority through experiments.

Learning State Conditioned Linear Mappings for Low-Dimensional Control of Robotic Manipulators

Variable Force Tracking Control Via Online Learning

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

A Comparative Study on State-Action Spaces for Learning Viewpoint Selection and Manipulation with Diffusion Policy

State Representation Learning for Task and Motion Planning in Robot Manipulation

Investigating the Benefits of Nonlinear Action Maps in Data-Driven Teleoperation

An Approach for Robotic Leaning Inspired by Biomimetic Adaptive Control

Learning-Based Control for Soft Robot–Environment Interaction with Force/Position Tracking Capability

Learning Latent Actions to Control Assistive Robots

Learning Reduced-Order Soft Robot Controller

A Comparison of Action Spaces for Learning Manipulation Tasks

Learning of Long-Horizon Sparse-Reward Robotic Manipulator Tasks With Base Controllers

Learning Force Control for Contact-Rich Manipulation Tasks With Rigid Position-Controlled Robots

Learning Task Planning from Multi-Modal Demonstration for Multi-Stage Contact-Rich Manipulation

Robotic Manipulation with Reinforcement Learning, State Representation Learning, and Imitation Learning (Student Abstract)

Learning From Human Demonstrations for Wheel Mobile Manipulator: An Unscented Model Predictive Control Approach

Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware

Arm-Constrained Curriculum Learning for Loco-Manipulation of the Wheel-Legged Robot

State- and context-dependent robotic manipulation and grasping via uncertainty-aware imitation learning

Learning Latent Object-Centric Representations for Visual-Based Robot Manipulation

Learning Fish-Like Swimming with a Cpg-Based Locomotion Controller