Risk of Transfer Learning and its Applications in Finance

Haoyang Cao,Haotian Gu,Xin Guo,Mathieu Rosenbaum
2023-11-07
Abstract:Transfer learning is an emerging and popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. In this paper, we propose a novel concept of transfer risk and and analyze its properties to evaluate transferability of transfer learning. We apply transfer learning techniques and this concept of transfer risk to stock return prediction and portfolio optimization problems. Numerical results demonstrate a strong correlation between transfer risk and overall transfer learning performance, where transfer risk provides a computationally efficient way to identify appropriate source tasks in transfer learning, including cross-continent, cross-sector, and cross-frequency transfer for portfolio optimization.
Mathematical Finance,Machine Learning
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve This paper aims to address the risk issues faced in the application of transfer learning in the financial domain. Specifically, the authors propose a new concept—**transfer risk**—and analyze its properties to assess the transferability of transfer learning. By applying the concept of transfer risk to stock return prediction and portfolio optimization problems, the study finds a strong correlation between transfer risk and the overall performance of transfer learning. Transfer risk provides a computationally efficient method for identifying appropriate source tasks, including portfolio optimization across continents, industries, and frequencies. ### Summary of Main Content 1. **Background of Transfer Learning**: - Transfer learning is a method that utilizes existing knowledge from one task to another similar task and is widely used in fields such as natural language processing, computer vision, and medical data analysis. - In the financial domain, transfer learning can leverage knowledge and patterns from similar tasks or domains to improve prediction accuracy and decision-making capabilities. 2. **Concept of Transfer Risk**: - The concept of transfer risk is proposed to evaluate the potential benefits of transfer learning. - Transfer risk considers the compatibility between output data and input data, as well as the compatibility between the source task and the target task models. 3. **Properties of Transfer Risk**: - The general properties of transfer risk are established, including the continuity of transfer risk concerning the source task. - Two specific forms of transfer risk, based on KL divergence and Wasserstein distance, are analyzed, and boundary analyses and their relationships are provided. 4. **Experimental Validation**: - Transfer learning techniques are applied to two financial problems: stock return prediction and portfolio optimization. - Experimental results show that transfer risk is consistent with classical statistical indicators and that higher prediction accuracy can be achieved under appropriate transfer learning settings compared to direct learning. 5. **Specific Applications**: - **Cross-Continent Transfer**: The performance of transferring from the US stock market to other stock markets varies, for example, transferring from the US market to the German market performs well, but transferring to the Brazilian market performs poorly. - **Cross-Industry Transfer**: Transfer risk across different industries shows a significant negative correlation between the healthcare and information technology industries, while the correlation between the utilities and real estate industries is not significant. - **Cross-Frequency Transfer**: The risk of transferring from low-frequency portfolios to high-frequency domains is higher, while transfers between medium and high-frequency domains are more robust and promising. ### Conclusion By proposing the concept of transfer risk, this paper provides a new method for assessing the applicability of transfer learning in the financial domain. Experimental results validate the effectiveness of transfer risk and provide a computationally efficient indicator for selecting appropriate source tasks. This helps improve prediction accuracy and decision-making capabilities in the financial domain.