Abstract:Simulation modeling of robots, objects, and environments is the backbone for all model-based control and learning. It is leveraged broadly across dynamic programming and model-predictive control, as well as data generation for imitation, transfer, and reinforcement learning. In addition to fidelity, key features of models in these control and learning contexts are speed, stability, and native differentiability. However, many popular simulation platforms for robotics today lack at least one of the features above. More recently, position-based dynamics (PBD) has become a very popular simulation tool for modeling complex scenes of rigid and non-rigid object interactions, due to its speed and stability, and is starting to gain significant interest in robotics for its potential use in model-based control and learning. Thus, in this paper, we present a mathematical formulation for coupling position-based dynamics (PBD) simulation and optimal robot design, model-based motion control and system identification. Our framework breaks down PBD definitions and derivations for various types of joint-based articulated rigid bodies. We present a back-propagation method with automatic differentiation, which can integrate both positional and angular geometric constraints. Our framework can critically provide the native gradient information and perform gradient-based optimization tasks. We also propose articulated joint model representations and simulation workflow for our differentiable framework. We demonstrate the capability of the framework in efficient optimal robot design, accurate trajectory torque estimation and supporting spring stiffness estimation, where we achieve minor errors. We also implement impedance control in real robots to demonstrate the potential of our differentiable framework in human-in-the-loop applications.

Differentiable Physics: A Position Piece

A Review of Differentiable Simulators

Differentiable Implicit Soft-Body Physics

Differentiable Physics Simulations with Contacts: Do They Have Correct Gradients w.r.t. Position, Velocity and Control?

Differentiable programming across the PDE and Machine Learning barrier

Fast and Feature-Complete Differentiable Physics for Articulated Rigid Bodies with Contact

Differentiable Programming for Differential Equations: A Review

Interactive Differentiable Simulation

DiffPD: Differentiable Projective Dynamics

Differentiable programming for particle physics simulations

Differentiable and Learnable Robot Models

DiffXPBD : Differentiable Position-Based Simulation of Compliant Constraint Dynamics

Challenges with Differentiable Quantum Dynamics

Deluca -- A Differentiable Control Library: Environments, Methods, and Benchmarking

DiffFR: Differentiable SPH-Based Fluid-Rigid Coupling for Rigid Body Control

A Differentiable Physics Engine for Deep Learning in Robotics

Parameter Identification and Motion Control for Articulated Rigid Body Robots Using Differentiable Position-based Dynamics

A Differentiable Newton-Euler Algorithm for Real-World Robotics

A differentiable programming framework for spin models

Differentiable Molecular Simulations for Control and Learning

Differentiable modelling to unify machine learning and physical models for geosciences