Abstract:Quadratic programming is a ubiquitous prototype in convex programming. Many combinatorial optimizations on graphs and machine learning problems can be formulated as quadratic programming; for example, Support Vector Machines (SVMs). Linear and kernel SVMs have been among the most popular models in machine learning over the past three decades, prior to the deep learning era. Generally, a quadratic program has an input size of $\Theta(n^2)$, where $n$ is the number of variables. Assuming the Strong Exponential Time Hypothesis ($\textsf{SETH}$), it is known that no $O(n^{2-o(1)})$ algorithm exists (Backurs, Indyk, and Schmidt, NIPS'17). However, problems such as SVMs usually feature much smaller input sizes: one is given $n$ data points, each of dimension $d$, with $d \ll n$. Furthermore, SVMs are variants with only $O(1)$ linear constraints. This suggests that faster algorithms are feasible, provided the program exhibits certain underlying structures. In this work, we design the first nearly-linear time algorithm for solving quadratic programs whenever the quadratic objective has small treewidth or admits a low-rank factorization, and the number of linear constraints is small. Consequently, we obtain a variety of results for SVMs: * For linear SVM, where the quadratic constraint matrix has treewidth $\tau$, we can solve the corresponding program in time $\widetilde O(n\tau^{(\omega+1)/2}\log(1/\epsilon))$; * For linear SVM, where the quadratic constraint matrix admits a low-rank factorization of rank-$k$, we can solve the corresponding program in time $\widetilde O(nk^{(\omega+1)/2}\log(1/\epsilon))$; * For Gaussian kernel SVM, where the data dimension $d = \Theta(\log n)$ and the squared dataset radius is small, we can solve it in time $O(n^{1+o(1)}\log(1/\epsilon))$. We also prove that when the squared dataset radius is large, then $\Omega(n^{2-o(1)})$ time is required.

Thermodynamic Algorithms for Quadratic Programming

Thermodynamic Linear Algebra

Thermodynamic Matrix Exponentials and Thermodynamic Parallelism

Error Mitigation for Thermodynamic Computing

Thermodynamic Computing System for AI Applications

Thermodynamic computing out of equilibrium

Accelerated molecular dynamics force evaluation on graphics processing units for thermal conductivity calculations.

Quantum Semidefinite Programming with Thermal Pure Quantum States

Thermodynamic Computing via Autonomous Quantum Thermal Machines

Kernel-Function Based Quantum Algorithms for Finite Temperature Quantum Simulation

Thermodynamic Analysis of Algorithmic Cooling Protocols: Efficiency Metrics and Improved Designs

Conditions for a quadratic quantum speedup in nonlinear transforms with applications to energy contract pricing

3-Regular 3-XORSAT Planted Solutions Benchmark of Classical and Quantum Heuristic Optimizers

Faster Algorithms for Structured Linear and Kernel Support Vector Machines

Automating GPU Scalability for Complex Scientific Models: Phonon Boltzman Transport Equation

Application of a variational hybrid quantum-classical algorithm to heat conduction equation and analysis of time complexity

A High-Performant Multi-Parametric Quadratic Programming Solver

A quantum annealing-sequential quadratic programming assisted finite element simulation for non-linear and history-dependent mechanical problems

A Fast Tridiagonal Solver for Intel MIC Architecture

Deep Distributed Optimization for Large-Scale Quadratic Programming

A quantum algorithm for heat conduction with symmetrization