Abstract:Generative Flow Networks (GFlowNets) are amortized samplers that learn stochastic policies to sequentially generate compositional objects from a given unnormalized reward distribution. They can generate diverse sets of high-reward objects, which is an important consideration in scientific discovery tasks. However, as they are typically trained from a given extrinsic reward function, it remains an important open challenge about how to leverage the power of pre-training and train GFlowNets in an unsupervised fashion for efficient adaptation to downstream tasks. Inspired by recent successes of unsupervised pre-training in various domains, we introduce a novel approach for reward-free pre-training of GFlowNets. By framing the training as a self-supervised problem, we propose an outcome-conditioned GFlowNet (OC-GFN) that learns to explore the candidate space. Specifically, OC-GFN learns to reach any targeted outcomes, akin to goal-conditioned policies in reinforcement learning. We show that the pre-trained OC-GFN model can allow for a direct extraction of a policy capable of sampling from any new reward functions in downstream tasks. Nonetheless, adapting OC-GFN on a downstream task-specific reward involves an intractable marginalization over possible outcomes. We propose a novel way to approximate this marginalization by learning an amortized predictor enabling efficient fine-tuning. Extensive experimental results validate the efficacy of our approach, demonstrating the effectiveness of pre-training the OC-GFN, and its ability to swiftly adapt to downstream tasks and discover modes more efficiently. This work may serve as a foundation for further exploration of pre-training strategies in the context of GFlowNets.

Network Flow Generation Based on Reinforcement Learning Powered Generative Adversarial Network

FlowGANAnomaly: Flow-Based Anomaly Network Intrusion Detection with Adversarial Learning

Flow-based Network Traffic Generation using Generative Adversarial Networks

Generative Flow Networks as Entropy-Regularized RL

Generative Flow Networks for Precise Reward-Oriented Active Learning on Graphs

Network Traffic Prediction for Intelligent Transportation Systems: A Reinforcement Learning Approach

Stochastic Generative Flow Networks

GFlowNet Training by Policy Gradients

Generative Multi-Flow Networks: Centralized, Independent and Conservation

NetFlowGen: Leveraging Generative Pre-training for Network Traffic Dynamics

NFlowGAN: High-Utility Privacy-Preserving Network Flow Synthesis Based on GAN.

On Generalization for Generative Flow Networks

FlowGAN: A Conditional Generative Adversarial Network for Flow Prediction in Various Conditions

A Theory of Non-Acyclic Generative Flow Networks

Investigating Generalization Behaviours of Generative Flow Networks

Generative Flow Network for Listwise Recommendation

A Standardized ICS Network Data Processing Flow with Generative Model in Anomaly Detection

Generative adversarial networks for network traffic feature generation

Bifurcated Generative Flow Networks

Pre-Training and Fine-Tuning Generative Flow Networks

Generative Modeling with Flow-Guided Density Ratio Learning