Abstract:Autonomous manipulation in everyday tasks requires flexible action generation to handle complex, diverse real-world environments, such as objects with varying hardness and softness. Imitation Learning (IL) enables robots to learn complex tasks from expert demonstrations. However, a lot of existing methods rely on position/unilateral control, leaving challenges in tasks that require force information/control, like carefully grasping fragile or varying-hardness objects. As the need for diverse controls increases, there are demand for low-cost bimanual robots that consider various motor inputs. To address these challenges, we introduce Bilateral Control-Based Imitation Learning via Action Chunking with Transformers(Bi-ACT) and"A" "L"ow-cost "P"hysical "Ha"rdware Considering Diverse Motor Control Modes for Research in Everyday Bimanual Robotic Manipulation (ALPHA-$\alpha$). Bi-ACT leverages bilateral control to utilize both position and force information, enhancing the robot's adaptability to object characteristics such as hardness, shape, and weight. The concept of ALPHA-$\alpha$ is affordability, ease of use, repairability, ease of assembly, and diverse control modes (position, velocity, torque), allowing researchers/developers to freely build control systems using ALPHA-$\alpha$. In our experiments, we conducted a detailed analysis of Bi-ACT in unimanual manipulation tasks, confirming its superior performance and adaptability compared to Bi-ACT without force control. Based on these results, we applied Bi-ACT to bimanual manipulation tasks. Experimental results demonstrated high success rates in coordinated bimanual operations across multiple tasks. The effectiveness of the Bi-ACT and ALPHA-$\alpha$ can be seen through comprehensive real-world experiments. Video available at: <a class="link-external link-https" href="https://mertcookimg.github.io/alpha-biact/" rel="external noopener nofollow">this https URL</a>

Unilateral Manipulability Quality Indices: Generalized Manipulability Measures for Unilaterally Actuated Robots

A Unified Weighted Least Norm Method For Redundant Manipulator Control

Torque Limitation Control of Industrial Manipulators Based on General Weighted Least Norm Method

Manipulability measure of dual-arm space robot and its application to design an optimal configuration

Singularity Analysis of Actuation Coordination and New Indices for Optimal Design of Redundantly Actuated Parallel Manipulators

Manipulability Optimization Control of a Serial Redundant Robot for Robot-assisted Minimally Invasive Surgery

Formulating an Invariant Manipulability Index of Gough-Stewart Platform

Manipulability maximization in constrained inverse kinematics of surgical robots

A New Actuation Approach for Human Friendly Robot Design

Sensor Observability Index: Evaluating Sensor Alignment for Task-Space Observability in Robotic Manipulators

Preliminary Studies on Force/Motion Control of Intelligent Mechanical Systems

Motion/Force Constrainability Analysis of Lower-Mobility Parallel Manipulators

Dynamic Manipulability and Optimization of A Two Dof Parallel Mechanism

On the Manipulability of the Center of Mass of Humanoid Robots: Application to Design

Dynamic Manipulability and Optimization of a Redundant Three DOF Planar Parallel Manipulator

A Riemannian Metric for Geometry-Aware Singularity Avoidance by Articulated Robots

ALPHA-$α$ and Bi-ACT Are All You Need: Importance of Position and Force Information/Control for Imitation Learning of Unimanual and Bimanual Robotic Manipulation with Low-Cost System

Manipulability Analysis for Cable-Driven Hyper-Redundant Manipulators

Dimension optimization of an orientation fine-tuning manipulator for segment assembly robots in shield tunneling machines

Robust Pivoting Manipulation Using Contact Implicit Bilevel Optimization

Dimensional synthesis of spatial manipulators for velocity and force transmission for operation around a specified task point