Abstract:Recent years have witnessed the rapid progress and broad application of diffusion probabilistic models (DPMs). Sampling from DPMs can be viewed as solving an ordinary differential equation (ODE). Despite the promising performance, the generation of DPMs usually consumes much time due to the large number of function evaluations (NFE). Though recent works have accelerated the sampling to around 20 steps with high-order solvers, the sample quality with less than 10 NFE can still be improved. In this paper, we propose a unified sampling framework (USF) to study the optional strategies for solver. Under this framework, we further reveal that taking different solving strategies at different timesteps may help further decrease the truncation error, and a carefully designed \emph{solver schedule} has the potential to improve the sample quality by a large margin. Therefore, we propose a new sampling framework based on the exponential integral formulation that allows free choices of solver strategy at each step and design specific decisions for the framework. Moreover, we propose $S^3$, a predictor-based search method that automatically optimizes the solver schedule to get a better time-quality trade-off of sampling. We demonstrate that $S^3$ can find outstanding solver schedules which outperform the state-of-the-art sampling methods on CIFAR-10, CelebA, ImageNet-64, and LSUN-Bedroom datasets. Specifically, we achieve 3.09 FID with 9 NFE and 7.65 FID with 5 NFE on CIFAR-10 dataset, outperforming the SOTA method significantly. We further apply $S^3$ to Stable-Diffusion model and get an acceleration ratio of 2$\times$, showing the feasibility of sampling in very few steps without retraining of the neural network.

Align Your Steps: Optimizing Sampling Schedules in Diffusion Models

Multi-Step Denoising Scheduled Sampling: Towards Alleviating Exposure Bias for Diffusion Models

$\textit{Jump Your Steps}$: Optimizing Sampling Schedule of Discrete Diffusion Models

Accelerating Diffusion Sampling with Optimized Time Steps

Sampler Scheduler for Diffusion Models

A Unified Sampling Framework for Solver Searching of Diffusion Probabilistic Models

Score-Optimal Diffusion Schedules

OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Models

DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models

SEEDS: Exponential SDE Solvers for Fast High-Quality Sampling from Diffusion Models

S$^{2}$-DMs:Skip-Step Diffusion Models

A Practical Diffusion Path for Sampling

Fast ODE-based Sampling for Diffusion Models in Around 5 Steps

DC-Solver: Improving Predictor-Corrector Diffusion Sampler via Dynamic Compensation

Elucidating the Solution Space of Extended Reverse-Time SDE for Diffusion Models.

Adaptive Non-Uniform Timestep Sampling for Diffusion Model Training

Optimizing DDPM Sampling with Shortcut Fine-Tuning

Gradient-based Discrete Sampling with Automatic Cyclical Scheduling

A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Models

One Step Diffusion via Shortcut Models