Abstract:Stock market and cryptocurrency forecasting is very important to investors as they aspire to achieve even the slightest improvement to their buy-or-hold strategies so that they may increase profitability. However, obtaining accurate and reliable predictions is challenging, noting that accuracy does not equate to reliability, especially when financial time-series forecasting is applied owing to its complex and chaotic tendencies. To mitigate this complexity, this study provides a comprehensive method for forecasting financial time series based on tactical input–output feature mapping techniques using machine learning (ML) models. During the prediction process, selecting the relevant indicators is vital to obtaining the desired results. In the financial field, limited attention has been paid to this problem with ML solutions. We investigate the use of feature selection with annealing (FSA) for the first time in this field, and we apply the least absolute shrinkage and selection operator (Lasso) method to select the features from more than 1000 candidates obtained from 26 technical classifiers with different periods and lags. Boruta (BOR) feature selection, a wrapper method, is used as a baseline for comparison. Logistic regression (LR), extreme gradient boosting (XGBoost), and long short-term memory are then applied to the selected features for forecasting purposes using 10 different financial datasets containing cryptocurrencies and stocks. The dependent variables consisted of daily logarithmic returns and trends. The mean-squared error for regression, area under the receiver operating characteristic curve, and classification accuracy were used to evaluate model performance, and the statistical significance of the forecasting results was tested using paired t -tests. Experiments indicate that the FSA algorithm increased the performance of ML models, regardless of problem type. The FSA hybrid models showed better performance and outperformed the other BOR models on seven of the 10 datasets for regression and classification. FSA-based models also outperformed Lasso-based models on six of the 10 datasets for regression and four of the 10 datasets for classification. None of the hybrid BOR models outperformed the hybrid FSA models. Lasso-based models, excluding the LR type, were comparable to the best models for six of the 10 datasets for classification. Detailed experimental analysis indicates that the proposed methodology can forecast returns and their movements efficiently and accurately, providing the field with a useful tool for investors.

Assessing Text Mining and Technical Analyses on Forecasting Financial Time Series

Predict financial text sentiment: an empirical examination

Predicting Financial Market Trends using Time Series Analysis and Natural Language Processing

Text Mining of Stocktwits Data for Predicting Stock Prices

Feature selection with annealing for forecasting financial time series

Predicting Stock Prices with FinBERT-LSTM: Integrating News Sentiment Analysis

Financial Text Mining in Twitterland

Is Deep-Learning and Natural Language Processing Transcending the Financial Forecasting? Investigation Through Lens of News Analytic Process

Innovative Sentiment Analysis and Prediction of Stock Price Using FinBERT, GPT-4 and Logistic Regression: A Data-Driven Approach

Forecasting the S&P 500 Index Using Mathematical-Based Sentiment Analysis and Deep Learning Models: A FinBERT Transformer Model and LSTM

Forecasting the Performance of US Stock Market Indices During COVID-19: RF vs LSTM

A survey on machine learning models for financial time series forecasting

The Effect of Data Types' on the Performance of Machine Learning Algorithms for Financial Prediction

From text to treasure: the predictive superiority of a FinTech index in stock market returns

A Systematic Survey of AI Models in Financial Market Forecasting for Profitability Analysis

FinBERT-LSTM: Deep Learning based stock price prediction using News Sentiment Analysis

News-based intelligent prediction of financial markets using text mining and machine learning: A systematic literature review

Sentiment-driven prediction of financial returns: a Bayesian-enhanced FinBERT approach

Text2TimeSeries: Enhancing Financial Forecasting through Time Series Prediction Updates with Event-Driven Insights from Large Language Models

Financial sentiment analysis using FinBERT with application in predicting stock movement