Abstract:Large language models (LLMs) have become powerful tools for advancing natural language processing applications in the financial industry. However, existing financial LLMs often face challenges such as hallucinations or superficial parameter training, resulting in suboptimal performance, particularly in financial computing and machine reading comprehension (MRC). To address these issues, we propose a novel large language model specifically designed for the Chinese financial domain, named SNFinLLM. SNFinLLM excels in domain-specific tasks such as answering questions, summarizing financial research reports, analyzing sentiment, and executing financial calculations. We then perform the supervised fine-tuning (SFT) to enhance the model's proficiency across various financial domains. Specifically, we gather extensive financial data and create a high-quality instruction dataset composed of news articles, professional papers, and research reports of finance domain. Utilizing both domain-specific and general datasets, we proceed with continuous pre-training on an established open-source base model, resulting in SNFinLLM-base. Following this, we engage in supervised fine-tuning (SFT) to bolster the model's capability across multiple financial tasks. Crucially, we employ a straightforward Direct Preference Optimization (DPO) method to better align the model with human preferences. Extensive experiments conducted on finance benchmarks and our evaluation dataset demonstrate that SNFinLLM markedly outperforms other state-of-the-art financial language models. For more details, check out our demo video here: <a class="link-external link-https" href="https://www.youtube.com/watch?v=GYT-65HZwus" rel="external noopener nofollow">this https URL</a>.

RA-CFGPT: Chinese financial assistant with retrieval-augmented large language model

CFGPT: Chinese Financial Assistant with Large Language Model

Multi-Reranker: Maximizing performance of retrieval-augmented generation in the FinanceRAG challenge

FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models

Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMs

RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback

CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models

Evaluating Retrieval-Augmented Generation Models for Financial Report Question and Answering

SNFinLLM: Systematic and Nuanced Financial Domain Adaptation of Chinese Large Language Models

RETA-LLM: A Retrieval-Augmented Large Language Model Toolkit

Improving Retrieval for RAG based Question Answering Models on Financial Documents

FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models

CFBenchmark: Chinese Financial Assistant Benchmark for Large Language Model

UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models

Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Models

R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models

FinVis-GPT: A Multimodal Large Language Model for Financial Chart Analysis

FAMMA: A Benchmark for Financial Domain Multilingual Multimodal Question Answering

Equipping Language Models with Tool Use Capability for Tabular Data Analysis in Finance

RAFT: Adapting Language Model to Domain Specific RAG