Forecasting Using Regularized Least-Squares Regression Method

Hongxing Li,Z. Fang,Dongming Zhao

2007-01-01

Abstract:GBP/USD currency exchange rates. A grid search is used to choose the optimal parameters.

What problem does this paper attempt to address?

GBP/USD Currency Exchange Rate Time Series Forecasting Using Regularized Least-Squares Regression Method.

Hongxing Li,Zhaoben Fang,Dongming Zhao

2007-01-01

Abstract:Kernel-based Regularized Least-squares Regression (RLSR) is a technique originally from Statistical Learning (SL) theory. RLSR can deal with non-linear problem through mapping the samples into a higher dimension space using a kernel function. This paper adopts the RLSR to time series forecasting and the resulted model is termed RLS-TS model getting the idea from applying neural network and support vector regression to time series forecasting. This paper applies the RLS-TS model to GBP/USD Exchange Rate forecasting. RLS-TS performs better than random walk, linear regression, autoregression integrated moving average, and artificial neural network model in predicting GBP/USD currency exchange rates. A grid search is used to choose the optimal parameters.
Forecasting foreign exchange rates with regression networks tuned by Bayesian optimization

Linwei Li,Paul-Amaury Matt,Christian Heumann

DOI: https://doi.org/10.48550/arXiv.2204.12914

2022-04-26

Statistical Finance

Abstract:The article is concerned with the problem of multi-step financial time series forecasting of Foreign Exchange (FX) rates. To address this problem, we introduce a regression network termed RegPred Net. The exchange rate to forecast is treated as a stochastic process. It is assumed to follow a generalization of Brownian motion and the mean-reverting process referred to as the generalized Ornstein-Uhlenbeck (OU) process, with time-dependent coefficients. Using past observed values of the input time series, these coefficients can be regressed online by the cells of the first half of the network (Reg). The regressed coefficients depend only on - but are very sensitive to - a small number of hyperparameters required to be set by a global optimization procedure for which, Bayesian optimization is an adequate heuristic. Thanks to its multi-layered architecture, the second half of the regression network (Pred) can project time-dependent values for the OU process coefficients and generate realistic trajectories of the time series. Predictions can be easily derived in the form of expected values estimated by averaging values obtained by Monte Carlo simulation. The forecasting accuracy on a 100 days horizon is evaluated for several of the most important FX rates such as EUR/USD, EUR/CNY, and EUR/GBP. Our experimental results show that the RegPred Net significantly outperforms ARMA, ARIMA, LSTMs, and Autoencoder-LSTM models in terms of metrics measuring the absolute error (RMSE) and correlation between predicted and actual values (Pearson R, R-squared, MDA). Compared to black-box deep learning models such as LSTM, RegPred Net has better interpretability, simpler structure, and fewer parameters.
Study on Exchange Rate Forecasting with Stacked Optimization Based on a Learning Algorithm

Weiwei Xie,Haifeng Wu,Boyu Liu,Shengdong Mu,Nedjah Nadia

DOI: https://doi.org/10.3390/math12040614

IF: 2.4

2024-02-20

Mathematics

Abstract:The time series of exchange rate fluctuations are characterized by non-stationary and nonlinear features, and forecasting using traditional linear or single-machine models can cause significant bias. Based on this, the authors propose the combination of the advantages of the EMD and LSTM models to reduce the complexity by analyzing and decomposing the time series and forming a new model, EMD-LSTM-SVR, with a stronger generalization ability. More than 30,000 units of data on the USD/CNY exchange rate opening price from 2 January 2015 to 30 April 2022 were selected for an empirical demonstration of the model's accuracy. The empirical results showed that the prediction of the exchange rate fluctuation with the EMD-LSTM-SVR model not only had higher accuracy, but also ensured that most of the predicted positions deviated less from the actual positions. The new model had a stronger generalization ability, a concise structure, and a high degree of ability to fit nonlinear features, and it prevented gradient vanishing and overfitting to achieve a higher degree of prediction accuracy.

mathematics
A new LASSO-BiLSTM-based ensemble learning approach for exchange rate forecasting

Siyuan Liu,Qiqian Huang,Mingchen Li,Yunjie Wei

DOI: https://doi.org/10.1016/j.engappai.2023.107305

IF: 8

2023-11-02

Engineering Applications of Artificial Intelligence

Abstract:Foreign exchange rate affects many countries' economic status and development. Therefore, it is essential to find the factors affecting the exchange rate price and make reasonable predictions. This paper proposes the novel LASSO-BiLSTM-based ensemble learning method by integrating least absolute shrinkage and selection operator (LASSO) and bidirectional long short-term memory (LSTM) to predict the USD/CNY exchange rate. First, 29 variables are selected to reflect economic activities on market and macroeconomic levels. Then, LASSO-BiLSTM-based ensemble learning approach is adopted with two steps: 1) LASSO is used to select six highly correlated variables with the exchange rate to reduce noises. 2) BiLSTM is employed to forecast the exchange rate with the six chosen variables. Last, to test the effectiveness of BiLSTM, comparisons with four deep learning algorithms, which are extreme learning machine (ELM), kernel extreme learning machine (KELM), long short-term memory (LSTM), and support vector regression (SVR), are conducted. The result shows that LASSO-BiLSTM outperforms the other models in 1-step forecast (MAE: 0.051, RMSE: 0.072, MDA: 0.777). The same conclusion applies to 3-steps and 6-steps forecasts. Overall, the proposed LASSO-BiLSTM-based ensemble learning method demonstrates high potential in time series forecasting.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
Regularization for electricity price forecasting

Bartosz Uniejewski

2024-04-05

Abstract:The most commonly used form of regularization typically involves defining the penalty function as a L1 or L2 norm. However, numerous alternative approaches remain untested in practical applications. In this study, we apply ten different penalty functions to predict electricity prices and evaluate their performance under two different model structures and in two distinct electricity markets. The study reveals that LQ and elastic net consistently produce more accurate forecasts compared to other regularization types. In particular, they were the only types of penalty functions that consistently produced more accurate forecasts than the most commonly used LASSO. Furthermore, the results suggest that cross-validation outperforms Bayesian information criteria for parameter optimization, and performs as well as models with ex-post parameter selection.

Applications,Statistical Finance
A model with Fuzzy Granulation and Deep Belief Networks for exchange rate forecasting

Ren Zhang,Furao Shen,Jinxi Zhao

DOI: https://doi.org/10.1109/IJCNN.2014.6889448

2014-01-01

Abstract:In recent years, neural networks is increasingly adopted in the prediction of exchange rate. However, most of them predict a specific number, which can not help the speculators too much because small gap between the predicted values and the actual values will lead to disastrous consequences. In our study, our purpose is to present a model to forecast the fluctuation range of the exchange rate by combining Fuzzy Granulation with Continuous-valued Deep Belief Networks (CDBN), and the concept of "Stop Loss" is introduced for making the environment of our profit strategy close to the real foreign exchange trade market. The proposed model is applied to forecasting both Euro/US dollar and British pound/US dollar exchange rate in our experiments. Experimental results show that the proposed method is more profitable in the trading process than other typical models.
LSSVM Forecasting Model Based on GMDH and Its Empirical Study

LI Qiu-min,TIAN Yi-xiang,ZHANG Gao-xun

DOI: https://doi.org/10.3969/j.issn.1000-0984.2013.06.008

2013-01-01

Abstract:Since the least squares support vector machine(LSSVM) method was proposed by Suykens,it has attracted wide attention.This method has fast convergence and high prediction accuracy.In this study,a new hybrid model which combines the LSSVM and the group method of data handling(GMDH) is used to forecast the exchange rate.The empirical results show that the new hybrid algorithm is a useful tool.
Wavelet Denoised-ResNet CNN and LightGBM Method to Predict Forex Rate of Change

Yiqi Zhao,Matloob Khushi

DOI: https://doi.org/10.48550/arXiv.2102.04861

2021-01-29

Statistical Finance

Abstract:Foreign Exchange (Forex) is the largest financial market in the world. The daily trading volume of the Forex market is much higher than that of stock and futures markets. Therefore, it is of great significance for investors to establish a foreign exchange forecast model. In this paper, we propose a Wavelet Denoised-ResNet with LightGBM model to predict the rate of change of Forex price after five time intervals to allow enough time to execute trades. All the prices are denoised by wavelet transform, and a matrix of 30 time intervals is formed by calculating technical indicators. Image features are obtained by feeding the maxtrix into a ResNet. Finally, the technical indicators and image features are fed to LightGBM. Our experiments on 5-minutes USDJPY demonstrate that the model outperforms baseline modles with MAE: 0.240977x10EXP-3 MSE: 0.156x10EXP-6 and RMSE: 0.395185x10EXP-3. An accurate price prediction after 25 minutes in future provides a window of opportunity for hedge funds algorithm trading. The code is available from https://mkhushi.github.io/
Out-of-Sample Forecasts of China’s Economic Growth and Inflation Using Rolling Weighted Least Squares

Yuying Sun,Yongmiao Hong,Shouyang Wang

DOI: https://doi.org/10.1016/j.jmse.2019.03.002

2019-01-01

Journal of Management Science and Engineering

Abstract:Macroeconomic forecasting in China is essential for the government to take proper policy decisions on government expenditure and money supply, among other matters. The existing literature on forecasting Chinas macroeconomic variables is unclear on the crucial issue of how to choose an optimal window to estimate parameters with rolling out-of-sample forecasts. This study fills this gap in forecasting economic growth and inflation in China, by using the rolling weighted least squares (WLS) with the practically feasible cross-validation (CV) procedure of Hong et al. (2018) to choose an optimal estimation window. We undertake an empirical analysis of monthly data on up to 30 candidate indicators (mainly asset prices) for a span of 17 years (2000–2017). It is documented that the forecasting performance of rolling estimation is sensitive to the selection of rolling windows. The empirical analysis shows that the rolling WLS with the CV-based rolling window outperforms other rolling methods on univariate regressions in most cases. One possible explanation for this is that these macroeconomic variables often suffer from structural changes due to changes in institutional reforms, policies, crises, and other factors. Furthermore, we find that, in most cases, asset prices are key variables for forecasting macroeconomic variables, especially output growth rate.
Prediction of Currency Exchange Rate Based on Transformers

Lu Zhao,Wei Qi Yan

DOI: https://doi.org/10.3390/jrfm17080332

2024-01-01

Journal of Risk and Financial Management

Abstract:The currency exchange rate is a crucial link between all countries related to economic and trade activities. With increasing volatility, exchange rate fluctuations have become frequent under the combined effects of global economic uncertainty and political risks. Consequently, accurate exchange rate prediction is significant in managing financial risks and economic instability. In recent years, the Transformer models have attracted attention in the field of time series analysis. Transformer models, such as Informer and TFT (Temporal Fusion Transformer), have also been extensively studied. In this paper, we evaluate the performance of the Transformer, Informer, and TFT models based on four exchange rate datasets: NZD/USD, NZD/CNY, NZD/GBP, and NZD/AUD. The results indicate that the TFT model has achieved the highest accuracy in exchange rate prediction, with an R2 value of up to 0.94 and the lowest RMSE and MAE errors. However, the Informer model offers faster training and convergence speeds than the TFT and Transformer, making it more efficient. Furthermore, our experiments on the TFT model demonstrate that integrating the VIX index can enhance the accuracy of exchange rate predictions.
Forecasting in Data-Rich Environments: An Application to Inflation Rates

Luís Aguiar-Conraria,Yongmiao Hong

2006-01-01

Abstract:Stock and Watson (1998 and 1999) developed a factor-model approach which allows for large data sets to be systematically summarized by to a few explanatory factors. In this paper two other methods are proposed. The first one, Partial Least Squares is imported from the Chemometrics literature. The second one, which is based on the Combination of Forecasts literature is a modification of Stock and Watson's method. We call it Principal Components Combination. These methods are compared in an empirical application to inflation. It is found that overall the Principal Components
A KELM-Based Ensemble Learning Approach for Exchange Rate Forecasting

Yunjie WEI,Shaolong SUN,Kin Keung LAI,Ghulam ABBAS

DOI: https://doi.org/10.21078/jssi-2018-289-13

2018-01-01

Journal of Systems Science and Information

Abstract:Abstract In this paper, a KELM-based ensemble learning approach, integrating Granger causality test, grey relational analysis and KELM (Kernel Extreme Learning Machine), is proposed for the exchange rate forecasting. The study uses a set of sixteen macroeconomic variables including, import, export, foreign exchange reserves, etc. Furthermore, the selected variables are ranked and then three of them, which have the highest degrees of relevance with the exchange rate, are filtered out by Granger causality test and the grey relational analysis, to represent the domestic situation. Then, based on the domestic situation, KELM is utilized for medium-term RMB/USD forecasting. The empirical results show that the proposed KELM-based ensemble learning approach outperforms all other benchmark models in different forecasting horizons, which implies that the KELM-based ensemble learning approach is a powerful learning approach for exchange rates forecasting.
Evolutionary Support Vector Machine for RMB Exchange Rate Forecasting

Sibao Fu,Yongwu Li,Shaolong Sun,Hongtao Li

DOI: https://doi.org/10.1016/j.physa.2019.01.026

2019-01-01

Abstract:The volatility of exchange rate is very important to a country’s trading. Accurately forecasting exchange rate time series appears to be a challenging task for the scientific community on account of its nonstationary and nonlinear structural nature. In order to improve the performance of exchange rate forecasting, this study develops two evolutionary support vector regression models to forecast four typical RMB exchange rates (CNY against USD, EUR, JPY and GBP), and employs four evaluation criteria to assess the performance of out-of-sample exchange rate forecasting. In this study, the evolutionary algorithm optimizes the SVR parameters by balancing search between the global and local optima. However, the inputs of models are selected though phase space reconstruction method from historical data of exchange rate series. The empirical results demonstrate that our proposed evolutionary support vector regression outperforms all other benchmark models in terms of level forecasting accuracy, directional forecasting accuracy and statistical accuracy. As it turns out, our proposed evolutionary support vector regression is a promising approach for RMB exchange rate forecasting.
Forecasting Exchange Rates:A New Nonparametric Support Vector Regression

Shiyi Chen

DOI: https://doi.org/10.3969/j.issn.1000-3894.2007.05.016

2007-01-01

Abstract:This paper applies Support Vector Regression(SVR) to forecast ARI model of the daily exchange rates of four currencies(Swiss Francs,Indian Rupees,South Korean Won and China Renminbi).The forecasting abilities of SVR are compared with MLE and ANN approaches.Theorically,MLE and ANN only focus on fit within-sample,but SVR considers both fit and forecast out-of-sample.Therefore SVR has the strongest forecast ability among all methods.Empirical findings are in favor of SVR.
Econometric Modeling and Economic Forecasting

Zongwu Cai,Yongmiao Hong,Shouyang Wang

DOI: https://doi.org/10.3724/sp.j.1383.304010

2018-01-01

Journal of Management Science and Engineering

Abstract:tail a three-stage estimation procedure to estimate both the parametric constant coefﬁcients nonparametric coefﬁcients. Furthermore, they derive a time series together with a new simple easily of ﬁt test and a bandwidth selector based on deﬁned cross-validatory estimation for the forecasting expectile The proposed is and
Foreign Exchange Rates Prediction Based on Generalized Exponential Predictor Models with Weighted Loss Function

尹伟,严威,缪柏其

DOI: https://doi.org/10.13860/j.cnki.sltj.2012.05.003

2012-01-01

Abstract:The genenralized exponential predictor models for exchange rate forecasting based on weighted loss function is proposed.This method construct some exponential predictors through different smoothing parameters firstly, and then the weighted loss function based on absolute loss and square loss was proposed to select vaxiable,under which we combine exponential predictors to construct genneralized predictor model.At last compare with some existing methods,the models we proposed improves forecast precision.
An interpretable deep learning multi-dimensional integration framework for exchange rate forecasting based on deep and shallow feature selection and snapshot ensemble technology

Jujie Wang,Ying Dong

DOI: https://doi.org/10.1016/j.engappai.2024.108282

IF: 8

2024-03-21

Engineering Applications of Artificial Intelligence

Abstract:Accurate exchange rate forecasting is important for the better realization of international economic transactions and international currency investments. However, it is challenging to forecast exchange rates due to their high volatility, nonlinearity, and noisy characteristics. This paper creatively proposes a novel interpretable deep learning multi-dimensional integration framework for foreign exchange rate forecasting based on shallow and deep feature selection and snapshot ensemble technology. The main factors affecting exchange rates are considered at a deep and shallow level, and the feature selection project is implemented. A cluster-based multidimensional learning paradigm is proposed. The framework clusters data and constructs predictive sub-models and then embeds snapshot ensemble techniques into models to improve the robustness of single models. Finally, the results are nonlinearly integrated by a deep learning model. In addition, three datasets and twelve comparative models were used to demonstrate the performance of the models. The empirical results show that the proposed model has the smallest mean absolute percentage error (0.407859%, 0.47134%, and 0.470167%, respectively).

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
Enhancing Exchange Rate Forecasting with Explainable Deep Learning Models

Shuchen Meng,Andi Chen,Chihang Wang,Mengyao Zheng,Fangyu Wu,Xupeng Chen,Haowei Ni,Panfeng Li

2024-10-25

Abstract:Accurate exchange rate prediction is fundamental to financial stability and international trade, positioning it as a critical focus in economic and financial research. Traditional forecasting models often falter when addressing the inherent complexities and non-linearities of exchange rate data. This study explores the application of advanced deep learning models, including LSTM, CNN, and transformer-based architectures, to enhance the predictive accuracy of the RMB/USD exchange rate. Utilizing 40 features across 6 categories, the analysis identifies TSMixer as the most effective model for this task. A rigorous feature selection process emphasizes the inclusion of key economic indicators, such as China-U.S. trade volumes and exchange rates of other major currencies like the euro-RMB and yen-dollar pairs. The integration of grad-CAM visualization techniques further enhances model interpretability, allowing for clearer identification of the most influential features and bolstering the credibility of the predictions. These findings underscore the pivotal role of fundamental economic data in exchange rate forecasting and highlight the substantial potential of machine learning models to deliver more accurate and reliable predictions, thereby serving as a valuable tool for financial analysis and decision-making.

Machine Learning
An improved ensemble learning method for exchange rate forecasting based on complementary effect of shallow and deep features

Gang Wang,Tao Tao,Jingling Ma,Hui Li,Huimin Fu,Yan Chu

DOI: https://doi.org/10.1016/j.eswa.2021.115569

IF: 8.5

2021-12-01

Expert Systems with Applications

Abstract:<p>In prior studies, either the shallow feature or deep feature has been extracted for accurate exchange rate forecasting. However, the complementary effect and distinguished predictive power of multiple features have rarely been investigated, which limits the utilization of comprehensive predictive information. Therefore, a novel ensemble learning method, Adaptive Linear Sparse Random Subspace (ALS-RS), is proposed based on the complementary effect of shallow and deep features. Concretely, in the first stage, the shallow feature is constructed manually combined with expert knowledge and the deep feature is extracted automatically by Bidirectional Gated Recurrent Units (Bi-GRU), then the features obtained are used as model inputs. After that, the improved RS with a feature weighting mechanism is designed to discriminate the importance of each feature and make an accurate ensemble prediction. The experimental results on four exchange rate datasets validate the superiority of our proposed ALS-RS. Besides, the enhanced forecasting capability of fusing multiple features including shallow and deep features is confirmed.</p>

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
AB-LSTM-GRU: A Novel Ensemble Composite Deep Neural Network Model for Exchange Rate Forecasting

Jincheng Gu,Shiqi Zhang,Yanling Yu,Feng Liu

DOI: https://doi.org/10.1007/s10614-024-10754-7

IF: 1.741

2024-11-23

Computational Economics

Abstract:Exchange rate forecasting is always complex and challenging, with great exploration significance and economic value. This study proposes a novel ensemble composite exchange rate forecasting model called AB-LSTM-GRU to improve the exactness and reliability of exchange rate forecasting. This model combines long short-term memory (LSTM) and the gate recurrent unit (GRU) to form a hybrid deep neural network as a weak learner and uses the adaptive boosting (AdaBoost) framework to integrate each weak learner to construct the final strong learner. In various experiments of this study, we conducted a comparative analysis based on the United States dollar/Chinese yuan renminbi (i.e., USD/CNY) historical data from January 1, 2010, to December 31, 2022. We selected the British pound sterling (GBP)/USD and GBP/CNY data within the same time range to demonstrate the robustness of the proposed model. Experimental results manifest that the predicted results of AB-LSTM-GRU are more accurate, and the fluctuation of its accuracy is less than that of other benchmark models. In verifying GBP/USD and GBP/CNY, we found the model has good robustness, making it applicable to different exchange rate data predictions. Overall, AB-LSTM-GRU combines the advantages of LSTM and GRU, which are good at analyzing long short-term and large-span features and the characteristics of low volatility of AdaBoost's prediction results, and can provide valuable information and reference for decision-making related to investors, enterprises, and countries.

economics,mathematics, interdisciplinary applications,management

Forecasting Using Regularized Least-Squares Regression Method

GBP/USD Currency Exchange Rate Time Series Forecasting Using Regularized Least-Squares Regression Method.

Forecasting foreign exchange rates with regression networks tuned by Bayesian optimization

Study on Exchange Rate Forecasting with Stacked Optimization Based on a Learning Algorithm

A new LASSO-BiLSTM-based ensemble learning approach for exchange rate forecasting

Regularization for electricity price forecasting

A model with Fuzzy Granulation and Deep Belief Networks for exchange rate forecasting

LSSVM Forecasting Model Based on GMDH and Its Empirical Study

Wavelet Denoised-ResNet CNN and LightGBM Method to Predict Forex Rate of Change

Out-of-Sample Forecasts of China’s Economic Growth and Inflation Using Rolling Weighted Least Squares

Prediction of Currency Exchange Rate Based on Transformers

Forecasting in Data-Rich Environments: An Application to Inflation Rates

A KELM-Based Ensemble Learning Approach for Exchange Rate Forecasting

Evolutionary Support Vector Machine for RMB Exchange Rate Forecasting

Forecasting Exchange Rates:A New Nonparametric Support Vector Regression

Econometric Modeling and Economic Forecasting

Foreign Exchange Rates Prediction Based on Generalized Exponential Predictor Models with Weighted Loss Function

An interpretable deep learning multi-dimensional integration framework for exchange rate forecasting based on deep and shallow feature selection and snapshot ensemble technology

Enhancing Exchange Rate Forecasting with Explainable Deep Learning Models

An improved ensemble learning method for exchange rate forecasting based on complementary effect of shallow and deep features

AB-LSTM-GRU: A Novel Ensemble Composite Deep Neural Network Model for Exchange Rate Forecasting