Abstract:Recent work has shown how to embed differentiable optimization problems (that is, problems whose solutions can be backpropagated through) as layers within deep learning architectures. This method provides a useful inductive bias for certain problems, but existing software for differentiable optimization layers is rigid and difficult to apply to new settings. In this paper, we propose an approach to differentiating through disciplined convex programs, a subclass of convex optimization problems used by domain-specific languages (DSLs) for convex optimization. We introduce disciplined parametrized programming, a subset of disciplined convex programming, and we show that every disciplined parametrized program can be represented as the composition of an affine map from parameters to problem data, a solver, and an affine map from the solver's solution to a solution of the original problem (a new form we refer to as affine-solver-affine form). We then demonstrate how to efficiently differentiate through each of these components, allowing for end-to-end analytical differentiation through the entire convex program. We implement our methodology in version 1.1 of CVXPY, a popular Python-embedded DSL for convex optimization, and additionally implement differentiable layers for disciplined convex programs in PyTorch and TensorFlow 2.0. Our implementation significantly lowers the barrier to using convex optimization problems in differentiable programs. We present applications in linear machine learning models and in stochastic control, and we show that our layer is competitive (in execution time) compared to specialized differentiable solvers from past work.

Differentiable Programming à la Moreau

The Elements of Differentiable Programming

Convergence of First-Order Algorithms for Meta-Learning with Moreau Envelopes

Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy

Differentiable programming across the PDE and Machine Learning barrier

Moreau Envelope Based Difference-of-weakly-Convex Reformulation and Algorithm for Bilevel Programs

Differentiable Programming for Differential Equations: A Review

Operational Calculus for Differentiable Programming

Exploiting Problem Structure in Deep Declarative Networks: Two Case Studies

Differentiable Quantum Programming with Unbounded Loops

DiCE: The Infinitely Differentiable Monte-Carlo Estimator

Differentiable Programming of Isometric Tensor Networks

Moreau Envelope ADMM for Decentralized Weakly Convex Optimization

Differentiable Convex Optimization Layers

On First-Order Meta-Reinforcement Learning with Moreau Envelopes

Approximation analysis for the minimization problem of difference-of-convex functions with Moreau envelopes

Pontryagin Differentiable Programming: An End-to-End Learning and Control Framework

Physarum Powered Differentiable Linear Programming Layers and Applications

MoreauGrad: Sparse and Robust Interpretation of Neural Networks via Moreau Envelope

Differentiable Programming & Network Calculus: Configuration Synthesis under Delay Constraints

Uniformly Stable Algorithms for Adversarial Training and Beyond