Abstract:Stock comments published by experts are important references for accurate stock trends prediction. How to comprehensively and accurately capture the topic of expert stock comments is an important issue which belongs to text classification. The Bidirectional Encoder Representations from Transformers (BERT) pretrained language model is widely used for text classification, due to its high identification accuracy. However, BERT has some limitations. First , it only utilizes fixed length text, leading to suboptimal performance in long text information exploration. Second , it only relies on the features extracted from the last layer, resulting in incomprehensive classification features. To tackle these issues, we propose a multi-layer features ablation study of BERT model for accurate identification of stock comments' themes. Specifically, we firstly divide the original text to meet the length requirement of the BERT model based on sliding window technology. In this way, we can enlarge the sample size which is beneficial for reducing the over-fitting problem. At the same time, by dividing the long text into multiple short texts, all the information of the long text can be comprehensively captured through the synthesis of the subject information of multiple short texts. In addition , we extract the output features of each layer in the BERT model and apply the ablation strategy to extract more effective information in these features. Experimental results demonstrate that compared with non-intercepted comments, the topic recognition accuracy is improved by intercepting stock comments based on sliding window technology. It proves that intercepting text can improve the performance of text classification. Compared with the BERT, the multi-layer features ablation study we present in the paper further improves the performance in the topic recognition of stock comments, and can provide reference for the majority of investors. Our study has better performance and practicability on stock trend prediction by stock comments topic recognition.

Stock-UniBERT: A News-based Cost-sensitive Ensemble BERT Model for Stock Trading

Stock Movement Prediction with Financial News using Contextualized Embedding from BERT

Predicting Stock Prices with FinBERT-LSTM: Integrating News Sentiment Analysis

Stock price movement prediction based on Stocktwits investor sentiment using FinBERT and ensemble SVM

Incorporating Multi-Source Market Sentiment and Price Data for Stock Price Prediction

Financial sentiment analysis using FinBERT with application in predicting stock movement

Stock Market Sentiment Classification and Backtesting via Fine-tuned BERT

BERT for Stock Market Sentiment Analysis

FinBERT-LSTM: Deep Learning based stock price prediction using News Sentiment Analysis

Application of Machine Learning With News Sentiment in Stock Trading Strategies

BERTopic-Driven Stock Market Predictions: Unraveling Sentiment Insights

BERT-based Financial Sentiment Index and LSTM-based Stock Return Predictability

Astock: A New Dataset and Automated Stock Trading based on Stock-specific News Analyzing Model

Trading Stocks Based on Financial News Using Attention Mechanism

An ensemble model for stock index prediction based on media attention and emotional causal inference

Stock Market Prediction Based on Financial News Text Mining and Investor Sentiment Recognition

A Novel Ensemble Deep Learning Model for Stock Prediction Based on Stock Prices and News

Applying BERT to analyze investor sentiment in stock market

Multi-layer features ablation of BERT model and its application in stock trend prediction

Improved Stock Price Movement Classification Using News Articles Based on Embeddings and Label Smoothing

An interval constraint-based trading strategy with social sentiment for the stock market