S. Bajpeyi,A. Sathish Kumar
Abstract:In the present article, we introduce and study the behaviour of the new family of exponential type neural network operators activated by the sigmoidal functions. We establish the point-wise and uniform approximation theorems for these NN (Neural Network) operators in C[a; b]: Further, the quantitative estimates of order of approximation for the proposed NN operators in C(N)[a; b] are established in terms of the modulus of continuity. We also analyze the behaviour of the family of exponential type quasi-interpolation operators in C(R+): Finally, we discuss the multivariate extension of these NN operators and some examples of the sigmoidal functions.
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to research and analyze the behavior and approximation properties of the new exponential - type neural network operators (Exponential Type Neural Network Operators) activated by the sigmoid function. Specifically, the authors established point - wise approximation and uniform approximation theorems for these neural network operators in the continuous function space \(C[a, b]\), and quantitatively estimated the approximation order by means of the modulus of continuity. In addition, they also studied the convergence rate of these operators in the class of logarithmic Holderian functions.
The following are the specific problems and methods involved in the paper:
1. **Introducing a new family of exponential - type neural network operators**:
- The authors defined a new family of exponential - type neural network operators, which are activated by the sigmoid function.
- The form of the operator is:
\[
E_{\chi_\sigma}^n(f, x)=\frac{\sum_{k = \lceil na\rceil}^{\lfloor nb\rfloor} f\left(\frac{e^k}{n}\right)\chi_\sigma(e^{-kx / n})}{\sum_{k = \lceil na\rceil}^{\lfloor nb\rfloor}\chi_\sigma(e^{-kx / n})}, \quad x\in\mathbb{R}^+
\]
2. **Point - wise and uniform approximation theorems**:
- In the continuous function space \(C[a, b]\), the point - wise approximation and uniform approximation theorems for these operators were proved.
- For any bounded function \(f: [a, b]\to\mathbb{R}\), when \(n\to\infty\), \((E_{\chi_\sigma}^n(f, x))\) converges to \(f(x)\) at each continuous point of \(f\).
- If \(f\in C[a, b]\), then:
\[
\lim_{n\to\infty}\|E_{\chi_\sigma}^n(f, \cdot)-f\|_\infty = 0
\]
3. **Quantitative estimation of the approximation order**:
- For functions belonging to the class of logarithmic Holderian functions \(L_\lambda(f)\), a quantitative estimation of the approximation order was given.
- When \(f\in L_\lambda(f)\) and \(M_\lambda(\chi_\sigma)<+\infty\), we have:
\[
\lim_{n\to\infty}\|E_{\chi_\sigma}^n(f, \cdot)-f\|_\infty = O(n^{-\lambda})
\]
4. **Multivariable extension**:
- The concept of the exponential - type neural network operator was extended to the multivariable case, and its point - wise and uniform approximation theorems were studied.
5. **Quasi - interpolation operators**:
- The behavior and approximation properties of the exponential - type quasi - interpolation operator \(Q_n(f, x)\) were defined and studied.
6. **Examples**:
- Some examples of sigmoid functions that satisfy the assumptions were provided, such as the logistic function and the hyperbolic tangent function, and how to construct a sigmoid function that satisfies the conditions using B - spline functions.
Through the research of these problems, the authors aim to provide a new tool and method for understanding and improving the performance of neural networks in function approximation, especially when dealing with specific types of functions (such as logarithmic Holderian functions).