Abstract:In this paper, the efficient hinging hyperplanes (EHH) neural network is proposed, which is basically a single hidden layer neural network. Different from the dominant single hidden layer neural networks, the hidden layer in the EHH neural network can be seen as a directed acyclic graph (DAG) and all the nodes in the DAG contribute to the output. It is proved that for every EHH neural network, there is an equivalent adaptive hinging hyperplanes (AHH) tree, the model of which was proposed based on the hinging hyperplanes (HH) model and finds good applications in system identification. Analog to the proof for the AHH model, the universal approximation ability of the EHH neural network is provided. Different from other neural networks, the EHH neural network has interpretability, which can be easily obtained through its ANOVA decomposition (or interaction matrix). The interpretability can then be used as an indication for the importance of the input variables. The construction of the EHH neural network includes initial network generation and parameter optimization (including the structure and weights parameter optimization). A descent algorithm for searching the locally optimal EHH neural network is proposed and the worst-case complexity of the algorithm is also provided. The EHH neural network is applied in nonlinear system identification, the simulation results show that satisfactory accuracy can be achieved with relatively low computational cost, and at the same time, some insights into the importance of the regressors and the interactions among the regressors can be revealed.

New parallel identification method using neural networks

Neural network system identification based on levenberg-marquardt algorithm

A Legendre Neural Network-Based Approach to Multiparameter Identification of Traffic Loads Across the Full Spatiotemporal Domain

Online Parameter Identification for Surface-mounted Magnet Synchronous Motors Based on Adaptive RBF Neural Network

System Identification Based on NARMAX Model Using Hopfield Networks

Functional Network Method for the Identification of Nonlinear Systems

Neural Network Parameter Identification of Electro-hydraulic Load Simulator

Fuzzy and Neural Network Method of Identification for Closed-Loop and Non-Linear Object

Adaptive Kernel Leaning Networks with Application to Nonlinear System Identification

A New Identification Method for the Nonlinear Systems of Wiener Type Based on Laguerre Functions and Static Neural Networks

A new algorithm of fuzzy on-line identification for nonlinear systems

Decentralized System Identification Method for Large-Scale Networks

Online identification of non-linear dynamic systems by Wiener model using subspace method and neural networks

Efficient Hinging Hyperplanes Neural Network and Its Application in Nonlinear System Identification

Robust Identification for Unknown Nonlinear Multivariable Systems Based on Dynamic Neural Networks

A new fast online identification method for linear time-varying systems

A Novel Linear Recurrent Neural Network for Multivariable System Identification

An Identification Model of Nonlinear Dynamic System Based on Process Neural Network and Its Application

A System Identification Method Based on Multi-Layer Perception and Model Extraction

Neural network-based parametric system identification: a review

Wavelet Networks Based General Multi-variable Non-linear System Identification Arithmetic and Its Application