Abstract:In this paper, the efficient hinging hyperplanes (EHH) neural network is proposed, which is basically a single hidden layer neural network. Different from the dominant single hidden layer neural networks, the hidden layer in the EHH neural network can be seen as a directed acyclic graph (DAG) and all the nodes in the DAG contribute to the output. It is proved that for every EHH neural network, there is an equivalent adaptive hinging hyperplanes (AHH) tree, the model of which was proposed based on the hinging hyperplanes (HH) model and finds good applications in system identification. Analog to the proof for the AHH model, the universal approximation ability of the EHH neural network is provided. Different from other neural networks, the EHH neural network has interpretability, which can be easily obtained through its ANOVA decomposition (or interaction matrix). The interpretability can then be used as an indication for the importance of the input variables. The construction of the EHH neural network includes initial network generation and parameter optimization (including the structure and weights parameter optimization). A descent algorithm for searching the locally optimal EHH neural network is proposed and the worst-case complexity of the algorithm is also provided. The EHH neural network is applied in nonlinear system identification, the simulation results show that satisfactory accuracy can be achieved with relatively low computational cost, and at the same time, some insights into the importance of the regressors and the interactions among the regressors can be revealed.

Computational cost improvement of neural network models in black box nonlinear system identification

Balanced simplicity–accuracy neural network model families for system identification

An Improved Partial-Form MFAC Design for Discrete-Time Nonlinear Systems with Neural Networks

Study On Application Of System Identification Of A 6r Serial Manipulator Using Artificial Neural Network

A Neural Network Model For General Minimax Problem

Efficient Identification Of Rbf Neural-Net Models For Nonlinear Discrete-Time Multivariable Dynamical-Systems

Improved genetic programming for system identification

System identification of neural systems: If we got it right, would we know?

Efficient Reconstruction of Neural Mass Dynamics Modeled by Linear-Threshold Networks

Nonlinear Systems Identification Using Deep Dynamic Neural Networks

Identification For Control Based on Neural Networks: Approximately Linearizable Models

An Improved Dynamic Process Neural Network Prediction Model Identification Method

A neural network-based approach to hybrid systems identification for control

Exploiting the capacity of deep networks only at training stage for nonlinear black-box system identification

Deep Subspace Encoders for Nonlinear System Identification

Efficient Hinging Hyperplanes Neural Network and Its Application in Nonlinear System Identification

Automatic Structure and Parameter Training Methods for Modeling of Mechanical System by Recurrent Neural Networks

Comparative study of neural networks for dynamic nonlinear systems identification

Reducing black-box nonlinear state-space models: A real-life case study

Combining Off-White and Sparse Black Models in Multi-step Physics-based Systems Identification -- EXTENDED VERSION

An Attempt to Devise a Pairwise Ising-Type Maximum Entropy Model Integrated Cost Function for Optimizing SNN Deployment