Spectral Fluctuations in Financial Systems: an Integrated Random Matrix Theory and Machine Learning Perspective
Amir Jalili,Hadi Sabri,Davood Ahmadian,Ziba Saleki,Yan-An Luo,Ai-Xi Chen
DOI: https://doi.org/10.1140/epjp/s13360-024-05760-5
2024-01-01
The European Physical Journal Plus
Abstract:This study explores the application of random matrix theory (RMT) and machine learning (ML) in the analysis of financial time-series data and market volatility. RMT is used to quantify the level of chaos in financial data, while ML enhances prediction accuracy. We analyze financial data from Bank of America, Bank of China, and Royal Bank of Canada, focusing on spectral statistics and the nearest-neighbor spacing distribution. Using maximum likelihood estimation, we measure the degree of chaos and predict market volatility across daily, weekly, and monthly scales. Our results show that the spectral characteristics of Bank of America and Bank of China align with a Poisson distribution, while the Royal Bank of Canada exhibits a mix of regularity and chaos. Incorporating unfolded prices into the ML model significantly improves predictive accuracy, with the lowest root-mean-square error observed in the Bank of China dataset. Finally, the Cramer–Rao lower bound is applied to minimize estimator variance, confirming the effectiveness of our combined RMT and ML approach. This method bridges statistical physics and advanced data-driven modeling for improved financial predictions.