Abstract:Neural networks are the main strength of modern artificial intelligence; they have demonstrated revolutionary performance in a wide range of applications. In practice, the weights of neural networks are generally obtained indirectly using iterative training methods. Such methods are inefficient and problematic in many respects. Besides, neural networks trained end-to-end by such methods are typical black box models that are hard to interpret. Thus, it would be significantly better if the weights of a neural network could be calculated directly. In this paper, we located the key for calculating the weights of a neural network directly: assigning proper targets to the hidden units. Furthermore, if such targets are assigned, the neural network becomes a white box model that is easy to interpret. Thus, we propose a framework for solving the weights of a neural network and provide a sample implementation of the framework. The implementation was tested in various classification and regression experiments. Compared with neural networks trained using traditional methods, the constructed ones using solved weights had similar or better performance on many tasks, while remaining interpretable. Given the early stage of the proposed approach, many improvements are expectable in future developments.

The Construction and Approximation of the Neural Network with Two Weights

An approximation by neural networkswith a fixed weight

Approximation-Performance and Global-Convergence Analysis of Basis-Function Feedforward Neural Network

The Estimate for Approximation Error of Neural Networks: A Constructive Approach

Constructive Trigonometric Function Approximation of Neural Networks

On the approximation by single hidden layer feedforward neural networks with fixed weights

Approximation error of single hidden layer neural networks with fixed weights

Approximation Capability of a Novel Neural Network Model for Dynamic Systems

Weights and Structure Determination Method of Multiple-Input Sigmoid Activation Function Neural Network

Lp Simultaneous Approximation by Neural Networks with One Hidden Layer

On the Approximation and Complexity of Deep Neural Networks to Invariant Functions

Integral transform and its application to neural network approximation

Pointwise Approximation for Neural Networks

Weighted Sobolev Approximation Rates for Neural Networks on Unbounded Domains

MISO Multivariate Generalized Polynomials Neural Network and Its Weights-Direct-Determination

Universal Approximation by Phase Series and Fixed-Weight Networks

Constructive Approximation Method of Polynomial by Neural Networks

Approximations of Continuous Functionals by Neural Networks with Application to Dynamic Systems

A Novel Method to Compute the Weights of Neural Networks

Weights and Structure Determination of Two-Input Power-Activation Feed-Forward Neural Network

Neural Network Approximations of Compositional Functions With Applications to Dynamical Systems