Abstract:In this paper, the efficient hinging hyperplanes (EHH) neural network is proposed, which is basically a single hidden layer neural network. Different from the dominant single hidden layer neural networks, the hidden layer in the EHH neural network can be seen as a directed acyclic graph (DAG) and all the nodes in the DAG contribute to the output. It is proved that for every EHH neural network, there is an equivalent adaptive hinging hyperplanes (AHH) tree, the model of which was proposed based on the hinging hyperplanes (HH) model and finds good applications in system identification. Analog to the proof for the AHH model, the universal approximation ability of the EHH neural network is provided. Different from other neural networks, the EHH neural network has interpretability, which can be easily obtained through its ANOVA decomposition (or interaction matrix). The interpretability can then be used as an indication for the importance of the input variables. The construction of the EHH neural network includes initial network generation and parameter optimization (including the structure and weights parameter optimization). A descent algorithm for searching the locally optimal EHH neural network is proposed and the worst-case complexity of the algorithm is also provided. The EHH neural network is applied in nonlinear system identification, the simulation results show that satisfactory accuracy can be achieved with relatively low computational cost, and at the same time, some insights into the importance of the regressors and the interactions among the regressors can be revealed.

Adaptive Hinging Hyperplanes And Its Applications In Dynamic System Identification

An Improved Coordinate Update Method For The Identification Of Adaptive Hinging Hyperplanes Model

Efficient Hinging Hyperplanes Neural Network and Its Application in Nonlinear System Identification

Model predictive control based on adaptive hinging hyperplanes model

Nonlinear Model Predictive Control Using Adaptive Hinging Hyperplanes Model

Fast Adaptive Hinging Hyperplanes

Urban Traffic Flow Forecasting Based on Adaptive Hinging Hyperplanes

Hierarchical Least-Squares Based Iterative Identification for Multivariable Systems with Moving Average Noises

Generalization of hinging hyperplanes

Optimization based on adaptive hinging hyperplanes and genetic algorithm.

Local optimality for hinging hyperplanes-based model predictive control

Piecewise Linear Approximation and Its Application in Model Predictive Control

An Integrated Algorithm for Hinging Hyperplanes and Its Application in Distillation Process

A Modified Hill Detouring Algorithm For Hinging Hyperplanes Minimization

A Novel Adaptive Harmonic Balance Method with an Asymptotic Harmonic Selection

Parameters Estimation of Hinging Hyperplanes Using Median Squared Error Criterion

Multiple Models Adaptive Controller:Hierarchical Structure and Covering Analysis

Fuzzy Dynamic Characteristic Modeling and Adaptive Control of Nonlinear Systems and Its Application to Hypersonic Vehicles

Improved Adaptive Hinf Control Approach for Piecewise Linear Systems with Application to Air-Breathing Hypersonic Vehicle

Dynamic Modeling of a High-Dynamic Flight Simulator

A Novel Nonlinear Approximation Approach- -Enhanced Hinge-Finding Algorithm