Abstract:In the financial sphere, there is a wealth of accumulated unstructured financial data, such as the textual disclosure documents that companies submit on a regular basis to regulatory agencies, such as the Securities and Exchange Commission (SEC). These documents are typically very long and tend to contain valuable soft information about a company’s performance that is not present in quantitative predictors. It is therefore of great interest to learn predictive models from these long textual documents, especially for forecasting numerical key performance indicators (KPIs). In recent years, there has been a great progress in natural language processing via pre-trained language models (LMs) learned from large corpora of textual data. This prompts the important question of whether they can be used effectively to produce representations for long documents, as well as how we can evaluate the effectiveness of representations produced by various LMs. Our work focuses on answering this critical question, namely the evaluation of the efficacy of various LMs in extracting useful soft information from long textual documents for prediction tasks. In this paper, we propose and implement a deep learning evaluation framework that utilizes a sequential chunking approach combined with an attention mechanism. We perform an extensive set of experiments on a collection of 10-K reports submitted annually by US banks, and another dataset of reports submitted by US companies, in order to investigate thoroughly the performance of different types of language models. Overall, our framework using LMs outperforms strong baseline methods for textual modeling as well as for numerical regression. Our work provides better insights into how utilizing pre-trained domain-specific and fine-tuned long-input LMs for representing long documents can improve the quality of representation of textual data, and therefore, help in improving predictive analyses.

Financial Numeric Extreme Labelling: A Dataset and Benchmarking for XBRL Tagging

FiNER: Financial Numeric Entity Recognition for XBRL Tagging

Parameter-Efficient Instruction Tuning of Large Language Models For Extreme Financial Numeral Labelling

Data-Centric Financial Large Language Models

A Data-Centric Approach for Financial Large Language Models with Abductive Augmentation Reasoning

A Scalable Data-Driven Framework for Systematic Analysis of SEC 10-K Filings Using Large Language Models

Numerical Reasoning for Financial Reports

FinQA: A Dataset of Numerical Reasoning over Financial Data

Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency

Extracting Financial Data From Unstructured Sources: Leveraging Large Language Models

FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Models

SEC-QA: A Systematic Evaluation Corpus for Financial QA

FinLLMs: A Framework for Financial Reasoning Dataset Generation with Large Language Models

Numerical Claim Detection in Finance: A New Financial Dataset, Weak-Supervision Model, and Market Analysis

WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domain

FETILDA: An Evaluation Framework for Effective Representations of Long Financial Documents

Extracting Structured Insights from Financial News: An Augmented LLM Driven Approach

Leveraging LLMs for KPIs Retrieval from Hybrid Long-Document: A Comprehensive Framework and Dataset.

FETILDA: An Effective Framework For Fin-tuned Embeddings For Long Financial Text Documents

SynFinTabs: A Dataset of Synthetic Financial Tables for Information and Table Extraction