Abstract:The most advanced diffusion models have recently adopted increasingly deep stacked networks (e.g., U-Net or Transformer) to promote the generative emergence capabilities of vision generation models similar to large language models (LLMs). However, progressively deeper stacked networks will intuitively cause numerical propagation errors and reduce noisy prediction capabilities on generative data, which hinders massively deep scalable training of vision generation models. In this paper, we first uncover the nature that neural networks being able to effectively perform generative denoising lies in the fact that the intrinsic residual unit has consistent dynamic property with the input signal's reverse diffusion process, thus supporting excellent generative abilities. Afterwards, we stand on the shoulders of two common types of deep stacked networks to propose a unified and massively scalable Neural Residual Diffusion Models framework (Neural-RDM for short), which is a simple yet meaningful change to the common architecture of deep generative networks by introducing a series of learnable gated residual parameters that conform to the generative dynamics. Experimental results on various generative tasks show that the proposed neural residual models obtain state-of-the-art scores on image's and video's generative benchmarks. Rigorous theoretical proofs and extensive experiments also demonstrate the advantages of this simple gated residual mechanism consistent with dynamic modeling in improving the fidelity and consistency of generated content and supporting large-scale scalable training. Code is available at <a class="link-external link-https" href="https://github.com/Anonymous/Neural-RDM" rel="external noopener nofollow">this https URL</a>.

Fully Spiking Denoising Diffusion Implicit Models

Spiking-Diffusion: Vector Quantized Discrete Diffusion Model with Spiking Neural Networks

Spiking Diffusion Models

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

SDiT: Spiking Diffusion Model with Transformer

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Spiking Deep Residual Networks.

Denoising Diffusion Step-aware Models

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Semi-Implicit Denoising Diffusion Models (SIDDMs)

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Neural Residual Diffusion Models for Deep Scalable Vision Generation

Diffusion Models Without Attention

Flexiffusion: Segment-wise Neural Architecture Search for Flexible Denoising Schedule

An overview of diffusion models for generative artificial intelligence

Ultra-low Latency Spiking Neural Networks with Spatio-Temporal Compression and Synaptic Convolutional Block

Think While You Generate: Discrete Diffusion with Planned Denoising

RISSOLE: Parameter-efficient Diffusion Models via Block-wise Generation and Retrieval-Guidance

Enhancing Diffusion Models for High-Quality Image Generation

Semantic Image Synthesis Via Diffusion Models

The Uncanny Valley: A Comprehensive Analysis of Diffusion Models