Abstract:Diffusion Policy is a powerful technique tool for learning end-to-end visuomotor robot control. It is expected that Diffusion Policy possesses scalability, a key attribute for deep neural networks, typically suggesting that increasing model size would lead to enhanced performance. However, our observations indicate that Diffusion Policy in transformer architecture (\DP) struggles to scale effectively; even minor additions of layers can deteriorate training outcomes. To address this issue, we introduce Scalable Diffusion Transformer Policy for visuomotor learning. Our proposed method, namely \textbf{\methodname}, introduces two modules that improve the training dynamic of Diffusion Policy and allow the network to better handle multimodal action distribution. First, we identify that \DP~suffers from large gradient issues, making the optimization of Diffusion Policy unstable. To resolve this issue, we factorize the feature embedding of observation into multiple affine layers, and integrate it into the transformer blocks. Additionally, our utilize non-causal attention which allows the policy network to \enquote{see} future actions during prediction, helping to reduce compounding errors. We demonstrate that our proposed method successfully scales the Diffusion Policy from 10 million to 1 billion parameters. This new model, named \methodname, can effectively scale up the model size with improved performance and generalization. We benchmark \methodname~across 50 different tasks from MetaWorld and find that our largest \methodname~outperforms \DP~with an average improvement of 21.6\%. Across 7 real-world robot tasks, our ScaleDP demonstrates an average improvement of 36.25\% over DP-T on four single-arm tasks and 75\% on three bimanual tasks. We believe our work paves the way for scaling up models for visuomotor learning. The project page is available at <a class="link-external link-http" href="http://scaling-diffusion-policy.github.io" rel="external noopener nofollow">this http URL</a>.

Scaling Up Influence Functions

Revisiting inverse Hessian vector products for calculating influence functions

HyperINF: Unleashing the HyperPower of the Schulz's Method for Data Influence Estimation

Revisit, Extend, and Enhance Hessian-Free Influence Functions

Influence Functions for Scalable Data Attribution in Diffusion Models

Scalify: scale propagation for efficient low-precision LLM training

Revisiting Neural Scaling Laws in Language and Vision

Beyond Uniform Scaling: Exploring Depth Heterogeneity in Neural Architectures

Influence Functions in Deep Learning Are Fragile

Scaling Vision Transformers

Scaling Diffusion Policy in Transformer to 1 Billion Parameters for Robotic Manipulation

Studying Large Language Model Generalization with Influence Functions

Efficiently Scaling Transformer Inference

Deeper Understanding of Black-box Predictions via Generalized Influence Functions

Scaling Laws for Autoregressive Generative Modeling

DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models

The Mirrored Influence Hypothesis: Efficient Data Influence Estimation by Harnessing Forward Passes

Towards Precise Scaling Laws for Video Diffusion Transformers

Inverse Scaling: When Bigger Isn't Better

Scaling Laws for Transfer