Random Augmentation Technique for Mitigating Overfitting in Neural Networks for Financial Time Series Forecasting

Yeonglong Kwak,Jeong-gyu Huh,
DOI: https://doi.org/10.37727/jkdas.2023.25.5.1653
2023-10-31
The Korean Data Analysis Society
Abstract:Overfitting is one of the major challenges encountered when using neural network models for financial time series forecasting tasks. The nature of financial time series data, often sparser than in other fields, tends to exacerbate the symptoms of overfitting. In this study, we propose a method to alleviate overfitting in neural network-based time series forecasting tasks through a novel data augmentation algorithm. The neural network structure employed in this research is a Long Short-Term Memory (LSTM) recurrent network. The proposed method gradually reduces the learning rate during the training process, whilst randomly augmenting the training data. To validate the performance of the proposed algorithm, we divided the VIX Index, into four sections and performed cross-validation. When compared to a standard LSTM network without the application of our algorithm, we confirmed that the Root Mean Square Error (RMSE) was reduced by 23%, 34%, 32%, and 34% in each cross-validation section respectively.
What problem does this paper attempt to address?