Abstract:Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training robust models (min step) under worst-case attacks (max step). However, they often suffer from high computational cost from running several inner maximization iterations (to find an optimal attack) inside every outer minimization iteration. Therefore, it becomes difficult to readily apply such algorithms for moderate to large size real world data sets. To alleviate this, we explore the effectiveness of iterative descent-ascent algorithms where the maximization and minimization steps are executed in an alternate fashion to simultaneously obtain the worst-case attack and the corresponding robust model. Specifically, we propose a novel discrete-time dynamical system-based algorithm that aims to find the saddle point of a min-max optimization problem in the presence of uncertainties. Under the assumptions that the cost function is convex and uncertainties enter concavely in the robust learning problem, we analytically show that our algorithm converges asymptotically to the robust optimal solution under a general adversarial budget constraints as induced by $\ell_p$ norm, for $1\leq p\leq \infty$. Based on our proposed analysis, we devise a fast robust training algorithm for deep neural networks. Although such training involves highly non-convex robust optimization problems, empirical results show that the algorithm can achieve significant robustness compared to other state-of-the-art robust models on benchmark data sets.

Learning Robust Point-to-Point Motions Adversarially: A Stochastic Differential Equation Approach

Robust Real-Time Motion Retargeting Via Neural Latent Prediction

Learning Accurate and Stable Point-to-Point Motions: A Dynamic System Approach

Fast and Stable Learning of Dynamical Systems Based on Extreme Learning Machine.

An adaptive trajectory prediction method for ping-pong robots

Adaptive Model Prediction Control-Based Multi-Terrain Trajectory Tracking Framework for Mobile Spherical Robots

Stabilizing Dynamic Systems through Neural Network Learning: A Robust Approach

Robust Trajectory Prediction against Adversarial Attacks

Robust Deep Reinforcement Learning with Adaptive Adversarial Perturbations in Action Space

Learning Dynamics of a Ball with Differentiable Factor Graph and Roto-Translational Invariant Representations

Stable Motion Primitives via Imitation and Contrastive Learning

Robust Trajectory Optimization Over Uncertain Terrain With Stochastic Complementarity

Adversarial Active Exploration for Inverse Dynamics Model Learning

AdvDO: Realistic Adversarial Attacks for Trajectory Prediction

A Fast Saddle-Point Dynamical System Approach to Robust Deep Learning

Robust Proximal Adversarial Reinforcement Learning under Model Mismatch

Rethinking Robustness Assessment: Adversarial Attacks on Learning-based Quadrupedal Locomotion Controllers

TrueÆdapt: Learning Smooth Online Trajectory Adaptation with Bounded Jerk, Acceleration and Velocity in Joint Space

Learning Deep Dynamical Systems using Stable Neural ODEs

AdvMT: Adversarial Motion Transformer for Long-term Human Motion Prediction

Robust Adaptive Ensemble Adversary Reinforcement Learning