Abstract:Recent years have witnessed the rapid progress and broad application of diffusion probabilistic models (DPMs). Sampling from DPMs can be viewed as solving an ordinary differential equation (ODE). Despite the promising performance, the generation of DPMs usually consumes much time due to the large number of function evaluations (NFE). Though recent works have accelerated the sampling to around 20 steps with high-order solvers, the sample quality with less than 10 NFE can still be improved. In this paper, we propose a unified sampling framework (USF) to study the optional strategies for solver. Under this framework, we further reveal that taking different solving strategies at different timesteps may help further decrease the truncation error, and a carefully designed \emph{solver schedule} has the potential to improve the sample quality by a large margin. Therefore, we propose a new sampling framework based on the exponential integral formulation that allows free choices of solver strategy at each step and design specific decisions for the framework. Moreover, we propose $S^3$, a predictor-based search method that automatically optimizes the solver schedule to get a better time-quality trade-off of sampling. We demonstrate that $S^3$ can find outstanding solver schedules which outperform the state-of-the-art sampling methods on CIFAR-10, CelebA, ImageNet-64, and LSUN-Bedroom datasets. Specifically, we achieve 3.09 FID with 9 NFE and 7.65 FID with 5 NFE on CIFAR-10 dataset, outperforming the SOTA method significantly. We further apply $S^3$ to Stable-Diffusion model and get an acceleration ratio of 2$\times$, showing the feasibility of sampling in very few steps without retraining of the neural network.

Optimizing Few-Step Sampler for Diffusion Probabilistic Model

Multi-Step Denoising Scheduled Sampling: Towards Alleviating Exposure Bias for Diffusion Models

Accelerating Diffusion Sampling with Optimized Time Steps

DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps.

DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models

A Unified Sampling Framework for Solver Searching of Diffusion Probabilistic Models

OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Models

Fast Diffusion Probabilistic Model Sampling through the lens of Backward Error Analysis

Diffusion Sampling Correction via Approximately 10 Parameters

DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics

Align Your Steps: Optimizing Sampling Schedules in Diffusion Models

Improvement of DPM Solver Based on Pade Approximation

Learning to Schedule in Diffusion Probabilistic Models

DPM-OT: A New Diffusion Probabilistic Model Based on Optimal Transport

Optimizing DDPM Sampling with Shortcut Fine-Tuning

Sampler Scheduler for Diffusion Models

PFDiff: Training-free Acceleration of Diffusion Models through the Gradient Guidance of Past and Future

Learning to Discretize Denoising Diffusion ODEs

Pseudo Numerical Methods for Diffusion Models on Manifolds

Boosting Diffusion Models with an Adaptive Momentum Sampler

On Accelerating Diffusion-Based Sampling Process via Improved Integration Approximation