Abstract:Diffusion models (DMs) are capable of generating remarkably high-quality samples by iteratively denoising a random vector, a process that corresponds to moving along the probability flow ordinary differential equation (PF ODE). Interestingly, DMs can also invert an input image to noise by moving backward along the PF ODE, a key operation for downstream tasks such as interpolation and image editing. However, the iterative nature of this process restricts its speed, hindering its broader application. Recently, Consistency Models (CMs) have emerged to address this challenge by approximating the integral of the PF ODE, largely reducing the number of iterations. Yet, the absence of an explicit ODE solver complicates the inversion process. To resolve this, we introduce Bidirectional Consistency Model (BCM), which learns a single neural network that enables both forward and backward traversal along the PF ODE, efficiently unifying generation and inversion tasks within one framework. We can train BCM from scratch or tune it using a pretrained consistency model, wh ich reduces the training cost and increases scalability. We demonstrate that BCM enables one-step generation and inversion while also allowing the use of additional steps to enhance generation quality or reduce reconstruction error. We further showcase BCM's capability in downstream tasks, such as interpolation, inpainting, and blind restoration of compressed images. Notably, when the number of function evaluations (NFE) is constrained, BCM surpasses domain-specific restoration methods, such as I$^2$SB and Palette, in a fully zero-shot manner, offering an efficient alternative for inversion problems. Our code and weights are available at <a class="link-external link-https" href="https://github.com/Mosasaur5526/BCM-iCT-torch" rel="external noopener nofollow">this https URL</a>.

Phased Consistency Models

Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference

VideoLCM: Video Latent Consistency Model

Chasing Consistency in Text-to-3D Generation from a Single Image.

Multi-scale Latent Point Consistency Models for 3D Shape Generation

TLCM: Training-efficient Latent Consistency Model for Image Generation with 2-8 Steps

CCM: Real-Time Controllable Visual Content Creation Using Text-to-Image Consistency Models

MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model

DreamLCM: Towards High-Quality Text-to-3D Generation via Latent Consistency Model

Consistency Models Made Easy

Bidirectional Consistency Models

AudioLCM: Text-to-Audio Generation with Latent Consistency Models

Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models

Efficient Text-driven Motion Generation via Latent Consistency Training

CCM: Adding Conditional Controls to Text-to-Image Consistency Models

Truncated Consistency Models

Consistency^2: Consistent and Fast 3D Painting with Latent Consistency Models

RL for Consistency Models: Faster Reward Guided Text-to-Image Generation

Simplifying, Stabilizing and Scaling Continuous-Time Consistency Models

FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing

Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better