Enhanced LFTSformer: A Novel Long-Term Financial Time Series Prediction Model Using Advanced Feature Engineering and the DS Encoder Informer Architecture

Jianan Zhang,Hongyi Duan
2024-04-18
Abstract:This study presents a groundbreaking model for forecasting long-term financial time series, termed the Enhanced LFTSformer. The model distinguishes itself through several significant innovations: (1) VMD-MIC+FE Feature Engineering: The incorporation of sophisticated feature engineering techniques, specifically through the integration of Variational Mode Decomposition (VMD), Maximal Information Coefficient (MIC), and feature engineering (FE) methods, enables comprehensive perception and extraction of deep-level features from complex and variable financial datasets. (2) DS Encoder Informer: The architecture of the original Informer has been modified by adopting a Stacked Informer structure in the encoder, and an innovative introduction of a multi-head decentralized sparse attention mechanism, referred to as the Distributed Informer. This modification has led to a reduction in the number of attention blocks, thereby enhancing both the training accuracy and speed. (3) GC Enhanced Adam \& Dynamic Loss Function: The deployment of a Gradient Clipping-enhanced Adam optimization algorithm and a dynamic loss function represents a pioneering approach within the domain of financial time series prediction. This novel methodology optimizes model performance and adapts more dynamically to evolving data patterns. Systematic experimentation on a range of benchmark stock market datasets demonstrates that the Enhanced LFTSformer outperforms traditional machine learning models and other Informer-based architectures in terms of prediction accuracy, adaptability, and generality. Furthermore, the paper identifies potential avenues for future enhancements, with a particular focus on the identification and quantification of pivotal impacting events and news. This is aimed at further refining the predictive efficacy of the model.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
The paper primarily focuses on addressing the issue of long-term financial time series forecasting. The research team proposes a new model called "Enhanced LFTSformer," aiming to improve prediction accuracy, adaptability, and generalization capability through advanced feature engineering techniques and an improved encoder structure. Below are the core issues this research attempts to solve: 1. **Advanced Feature Engineering**: - The study introduces a method combining Variational Mode Decomposition (VMD), Maximal Information Coefficient (MIC), and Feature Engineering (FE), referred to as VMD-MIC+FE feature engineering, to extract deep features from complex and volatile financial datasets. 2. **Improved Encoder Architecture**: - A distributed sparse attention mechanism based on a stacked Informer structure (called Distributed Informer) is proposed, which reduces the number of attention blocks, thereby improving training accuracy and speed. 3. **Optimization Algorithm and Dynamic Loss Function**: - The use of a gradient clipping-enhanced Adam optimization algorithm and a dynamic loss function is an innovative approach in the field of financial time series forecasting, optimizing model performance and making the model more dynamically adaptable to changing data patterns. The paper validates the superiority of the Enhanced LFTSformer over traditional machine learning models and other Informer-based architectures in terms of prediction accuracy, adaptability, and generalization capability through systematic experiments on a series of benchmark stock market datasets. It also discusses potential future research directions, particularly regarding the identification and quantification of key impact events and news to further enhance prediction effectiveness.