A new deep neural network for forecasting: Deep dendritic artificial neural network

Erol Egrioglu,Eren Bas
DOI: https://doi.org/10.1007/s10462-024-10790-7
IF: 9.588
2024-06-13
Artificial Intelligence Review
Abstract:Deep artificial neural networks have become a good alternative to classical forecasting methods in solving forecasting problems. Popular deep neural networks classically use additive aggregation functions in their cell structures. It is available in the literature that the use of multiplicative aggregation functions in shallow artificial neural networks produces successful results for the forecasting problem. A type of high-order shallow artificial neural network that uses multiplicative aggregation functions is the dendritic neuron model artificial neural network, which has successful forecasting performance. In this study, the transformation of the dendritic neuron model turned into a multi-output architecture. A new dendritic cell based on the multi-output dendritic neuron model and a new deep artificial neural network is proposed. The training of this new deep dendritic artificial neural network is carried out with the differential evolution algorithm. The forecasting performance of the deep dendritic artificial neural network is compared with basic classical forecasting methods and some recent shallow and deep artificial neural networks over stock market time series. As a result, it has been observed that deep dendritic artificial neural network produces very successful forecasting results for the forecasting problem.
computer science, artificial intelligence
What problem does this paper attempt to address?
The paper attempts to address the issue that, in time series forecasting, existing deep neural network methods, although effective, may not fully utilize the advantages of multiplicative aggregation functions. Traditional deep neural networks typically use additive aggregation functions, while the use of multiplicative aggregation functions in shallow neural networks has already shown successful performance in forecasting problems. Therefore, this paper proposes a new deep recurrent artificial neural network based on the dendritic neuron model (DeepDenT), aiming to improve the performance of time series forecasting by introducing a multi-output architecture and an improved training algorithm. Specifically, the main objectives of this study include: 1. **Developing a new dendritic cell structure**: Creating a new "Dendritic Cell" (DnC) structure, similar to LSTM and GRU cells, that can receive multiple inputs and produce multiple outputs. 2. **Constructing a deep recurrent neural network**: Utilizing the aforementioned dendritic cell structure to build a deep recurrent artificial neural network (DeepDenT) to enhance forecasting performance. 3. **Optimizing the training algorithm**: Proposing a training algorithm based on the differential evolution optimization method, which can avoid local optimum traps and does not involve gradient explosion or vanishing problems. 4. **Validating forecasting performance**: Verifying the forecasting performance of DeepDenT using stock market time series data and comparing it with classical forecasting methods and other shallow and deep neural networks. In summary, the goal of this paper is to improve the accuracy of time series forecasting by introducing a new neural network architecture and an optimized training algorithm.