Abstract:We propose a novel data augmentation approach, DistractFlow, for training optical flow estimation models by introducing realistic distractions to the input frames. Based on a mixing ratio, we combine one of the frames in the pair with a distractor image depicting a similar domain, which allows for inducing visual perturbations congruent with natural objects and scenes. We refer to such pairs as distracted pairs. Our intuition is that using semantically meaningful distractors enables the model to learn related variations and attain robustness against challenging deviations, compared to conventional augmentation schemes focusing only on low-level aspects and modifications. More specifically, in addition to the supervised loss computed between the estimated flow for the original pair and its ground-truth flow, we include a second supervised loss defined between the distracted pair's flow and the original pair's ground-truth flow, weighted with the same mixing ratio. Furthermore, when unlabeled data is available, we extend our augmentation approach to self-supervised settings through pseudo-labeling and cross-consistency regularization. Given an original pair and its distracted version, we enforce the estimated flow on the distracted pair to agree with the flow of the original pair. Our approach allows increasing the number of available training pairs significantly without requiring additional annotations. It is agnostic to the model architecture and can be applied to training any optical flow estimation models. Our extensive evaluations on multiple benchmarks, including Sintel, KITTI, and SlowFlow, show that DistractFlow improves existing models consistently, outperforming the latest state of the art.

Data Augmentation for Discharging Time Prediction of Particle Flow: A Deep Learning and Style Transfer Approach

Practical Framework for Data-Driven RANS Modeling with Data Augmentation

Recurrent Graph Optimal Transport for Learning 3D Flow Motion in Particle Tracking

Accelerating Dataset Distillation Via Model Augmentation

Data augmentation in microscopic images for material data mining

Machine learning for full spatiotemporal acceleration of gas-particle flow simulations

StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfer

Insight into Microdispersion Flows with a Novel Video Deep Learning Method.

A deep learning perspective on electro-hydrodynamic micro-droplet interface deformation characteristics

Dynamics-disentangled deep learning model for multi-cycle prediction of unsteady flow field

Prediction of Water Transport Properties on an Anisotropic Wetting Surface Via Deep Learning.

Data-driven modeling of unsteady flow based on deep operator network

DistractFlow: Improving Optical Flow Estimation via Realistic Distractions and Pseudo-Labeling

DynamicAug: Enhancing Transfer Learning Through Dynamic Data Augmentation Strategies Based on Model State

PD-Flow: A Point Cloud Denoising Framework with Normalizing Flows

PiRD: Physics-informed Residual Diffusion for Flow Field Reconstruction

A generative adversarial network based on an efficient transformer for high-fidelity flow field reconstruction

DiffuseST: Unleashing the Capability of the Diffusion Model for Style Transfer

Prediction of particle-laden pipe flows using deep neural network models

Autoregressive Stylized Motion Synthesis with Generative Flow

NeuralDrop: DNN-based Simulation of Small-Scale Liquid Flows on Solids