Abstract:Time series generation is a crucial research topic in the area of decision-making systems, which can be particularly important in domains like autonomous driving, healthcare, and, notably, robotics. Recent approaches focus on learning in the data space to model time series information. However, the data space often contains limited observations and noisy features. In this paper, we propose TimeLDM, a novel latent diffusion model for high-quality time series generation. TimeLDM is composed of a variational autoencoder that encodes time series into an informative and smoothed latent content and a latent diffusion model operating in the latent space to generate latent information. We evaluate the ability of our method to generate synthetic time series with simulated and real-world datasets and benchmark the performance against existing state-of-the-art methods. Qualitatively and quantitatively, we find that the proposed TimeLDM persistently delivers high-quality generated time series. For example, TimeLDM achieves new state-of-the-art results on the simulated benchmarks and an average improvement of 55% in Discriminative score with all benchmarks. Further studies demonstrate that our method yields more robust outcomes across various lengths of time series data generation. Especially, for the Context-FID score and Discriminative score, TimeLDM realizes significant improvements of 80% and 50%, respectively. The code will be released after publication.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the limitations faced by existing methods when directly learning in the data space in the field of time - series generation. Specifically, the data space usually contains limited observations and noisy features, which limit the quality and generalization ability of the generative model. To solve these problems, the paper proposes a new latent diffusion model (TimeLDM) for high - quality time - series generation. ### Specific description of the problem 1. **Limitations of the data space**: - The information in the data space is limited and contains noisy features. - These limitations make it difficult for existing generative models to capture the complex dynamics and patterns of time - series. 2. **Deficiencies of existing methods**: - Methods that directly model in the data space are often affected by data quality, and the quality of the generated time - series is not high. - Existing generative models perform unstably when dealing with time - series of different lengths. ### Proposed solution The paper proposes a new method named **TimeLDM**, which solves the above problems through the following steps: 1. **Variational auto - encoder (VAE)**: - Encode the original time - series data into an information - rich and smooth latent space. - Use the encoder of VAE to convert the time - series into a latent representation \( z \), and convert the latent representation back to the time - series through the decoder. 2. **Latent diffusion model (LDM)**: - Apply the diffusion model in the latent space to generate latent information. - The diffusion model generates high - quality time - series by gradually adding noise and reverse - denoising. 3. **Training and sampling process**: - First, train the VAE to obtain latent space information. - Then, train the diffusion model in the latent space. - Finally, generate a new time - series through the reverse diffusion process, and use the VAE decoder to convert it back to the data space. ### Main contributions - **Innovation**: It is the first to explore the application of the latent diffusion model in unconditional time - series generation. - **Performance improvement**: It has achieved results significantly better than existing methods on multiple benchmark datasets, especially achieving 55% and 80% improvements in Discriminative score and Context - FID score respectively. - **Robustness**: It shows superior performance in time - series generation tasks of different lengths. Through these improvements, TimeLDM aims to provide a more flexible and higher - quality time - series generation framework, which is suitable for decision - making systems in fields such as autonomous driving, healthcare, and robotics.

TimeLDM: Latent Diffusion Model for Unconditional Time Series Generation

Multimodal Latent Language Modeling with Next-Token Diffusion

Latent Diffusion Transformer for Probabilistic Time Series Forecasting

Latent Space Score-based Diffusion Model for Probabilistic Multivariate Time Series Imputation

A Novel Time Diffusion Model for Industrial Time Series Data Generation

TimeAutoDiff: Combining Autoencoder and Diffusion model for time series tabular data synthesizing

DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models

Diffusion-TS: Interpretable Diffusion for General Time Series Generation

AutoTimes: Autoregressive Time Series Forecasters via Large Language Models

Non-autoregressive Conditional Diffusion Models for Time Series Prediction

Generating Time Series by Using Latent Space

Predict, Refine, Synthesize: Self-Guiding Diffusion Models for Probabilistic Time Series Forecasting

Latent diffusion models for generative precipitation nowcasting with accurate uncertainty quantification

TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Model

TimeDRL: Disentangled Representation Learning for Multivariate Time-Series

Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Models

Diffusion Auto-regressive Transformer for Effective Self-supervised Time Series Forecasting

Latent Dynamical Implicit Diffusion Processes

Latent-based Diffusion Model for Long-tailed Recognition