InvariantStock: Learning Invariant Features for Mastering the Shifting Market

Haiyao Cao,Jinan Zou,Yuhang Liu,Zhen Zhang,Ehsan Abbasnejad,Anton van den Hengel,Javen Qinfeng Shi
2024-09-01
Abstract:Accurately predicting stock returns is crucial for effective portfolio management. However, existing methods often overlook a fundamental issue in the market, namely, distribution shifts, making them less practical for predicting future markets or newly listed stocks. This study introduces a novel approach to address this challenge by focusing on the acquisition of invariant features across various environments, thereby enhancing robustness against distribution shifts. Specifically, we present InvariantStock, a designed learning framework comprising two key modules: an environment-aware prediction module and an environment-agnostic module. Through the designed learning of these two modules, the proposed method can learn invariant features across different environments in a straightforward manner, significantly improving its ability to handle distribution shifts in diverse market settings. Our results demonstrate that the proposed InvariantStock not only delivers robust and accurate predictions but also outperforms existing baseline methods in both prediction tasks and backtesting within the dynamically changing markets of China and the United States.
Computational Engineering, Finance, and Science
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve This paper aims to address a key issue in stock market prediction: distribution shifts. Specifically, existing methods often overlook market distribution changes when predicting future markets or newly listed stocks, leading to reduced practicality. To tackle this challenge, the research team proposes a new framework—InvariantStock, which focuses on capturing invariant features across different environments to enhance robustness against distribution shifts. The main contributions of the paper include: 1. **Proposing a new framework**: Addressing distribution shifts in the stock market by learning invariant features. 2. **Designing two main modules**: An environment-agnostic prediction module and an environment-aware prediction module, which work together to select consistent features across environments. 3. **Experimental validation**: Demonstrating through experiments in the dynamically changing markets of China and the United States that InvariantStock not only provides accurate and robust predictions but also outperforms existing baseline methods. Through these contributions, the paper aims to improve the stability and accuracy of stock prediction models under different market conditions.