Abstract:Unrolling training trajectories over time strongly influences the inference accuracy of neural network-augmented physics simulators. We analyze this in three variants of training neural time-steppers. In addition to one-step setups and fully differentiable unrolling, we include a third, less widely used variant: unrolling without temporal gradients. Comparing networks trained with these three modalities disentangles the two dominant effects of unrolling, training distribution shift and long-term gradients. We present detailed study across physical systems, network sizes and architectures, training setups, and test scenarios. It also encompasses two simulation modes: In prediction setups, we rely solely on neural networks to compute a trajectory. In contrast, correction setups include a numerical solver that is supported by a neural network. Spanning these variations, our study provides the empirical basis for our main findings: Non-differentiable but unrolled training with a numerical solver in a correction setup can yield substantial improvements over a fully differentiable prediction setup not utilizing this solver. The accuracy of models trained in a fully differentiable setup differs compared to their non-differentiable counterparts. Differentiable ones perform best in a comparison among correction networks as well as among prediction setups. For both, the accuracy of non-differentiable unrolling comes close. Furthermore, we show that these behaviors are invariant to the physical system, the network architecture and size, and the numerical scheme. These results motivate integrating non-differentiable numerical simulators into training setups even if full differentiability is unavailable. We show the convergence rate of common architectures to be low compared to numerical algorithms. This motivates correction setups combining neural and numerical parts which utilize benefits of both.

Augmenting Differentiable Simulators with Neural Networks to Close the Sim2Real Gap

Differentiable Physics Simulation of Dynamics-Augmented Neural Objects

Interactive Differentiable Simulation

Sim-to-Real Transfer with Neural-Augmented Robot Simulation

Bridging the Sim-to-Real Gap with Bayesian Inference

Differentiable Multi-Fidelity Fusion: Efficient Learning of Physics Simulations with Neural Architecture Search and Transfer Learning

End-to-End and Highly-Efficient Differentiable Simulation for Robotics

Differentiable Implicit Soft-Body Physics

A Differentiable Newton-Euler Algorithm for Real-World Robotics

Equivariant Neural Simulators for Stochastic Spatiotemporal Dynamics

Differentiability in Unrolled Training of Neural Physics Simulators on Transient Dynamics

A Review of Differentiable Simulators

Evolution and learning in differentiable robots

Leveraging Reward Gradients For Reinforcement Learning in Differentiable Physics Simulations

Probabilistic Surrogate Networks for Simulators with Unbounded Randomness

Closing the loop between neural network simulators and the OpenAI Gym

One-Shot Real-to-Sim via End-to-End Differentiable Simulation and Rendering

Physical Design using Differentiable Learned Simulators

Neurally Integrated Finite Elements for Differentiable Elasticity on Evolving Domains

Neural Operators for Accelerating Scientific Simulations and Design

Learn to Augment Network Simulators Towards Digital Network Twins