Abstract:Due to their flexibility and ability to incorporate non-linear relationships, Mixed-Integer Non-Linear Programming (MINLP) approaches for optimization are commonly presented as a solution tool for real-world problems. Within this context, piecewise linear (PWL) approximations of non-linear continuous functions are useful, as opposed to non-linear machine learning-based approaches, since they enable the application of Mixed-Integer Linear Programming techniques in the MINLP framework, as well as retaining important features of the approximated non-linear functions, such as convexity. In this work, we extend upon fast algorithmic approaches for modeling discrete data using PWL regression by tuning them to allow the modeling of continuous functions. We show that if the input function is convex, then the convexity of the resulting PWL function is guaranteed. An analysis of the runtime of the presented algorithm shows which function characteristics affect the efficiency of the model, and which classes of functions can be modeled very quickly. Experimental results show that the presented approach is significantly faster than five existing approaches for modeling non-linear functions from the literature, at least 11 times faster on the tested functions, and up to a maximum speedup of more than 328,000. The presented approach also solves six benchmark problems for the first time.

A special kind of neural networks: continuous piecewise linear functions

Configuration of Continuous Piecewise-Linear Neural Networks

A Topological Approach to the Existence of Solutions for Nonlinear Differential Equations with Piecewise Constant Argument

Identification Algorithm for Standard Continuous Piecewise Linear Neural Network

A discrete-time neural network for optimization problems with hybrid constraints.

A Canonical Representation of High-Dimensional Continuous Piecewise-Linear Functions

Adaptive Hinging Hyperplane and Its Comparison with High-Level Canonical Piecewise Linear Representation

Training neural networks for solving 1-D optimal piecewise linear approximation

A New Neural Network Model And Its Application

SPINE: Soft Piecewise Interpretable Neural Equations

Approximation And Inverse Control Of Nonlinear System Using Standard Continuous Piecewise Linear Neural Networks

Efficient continuous piecewise linear regression for linearising univariate non-linear functions

Nonlinear system identification with continuous piecewise linear neural network

Approximations of Continuous Functionals by Neural Networks with Application to Dynamic Systems

Continuous piecewise linear identification with moderate number of subregions

A fast algorithm for solving large scale nonlinear optimization problems using RNN

Piecewise Linear Functions Representable with Infinite Width Shallow ReLU Neural Networks

Machine Learning from a Continuous Viewpoint,i

Generalization of hinging hyperplanes

Linearly Constrained Global Optimization Via Piecewise-Linear Approximation

Nonlinear System Identification with Piecewise-Linear Functions