Abstract:Large language models (LLMs) have become powerful tools for advancing natural language processing applications in the financial industry. However, existing financial LLMs often face challenges such as hallucinations or superficial parameter training, resulting in suboptimal performance, particularly in financial computing and machine reading comprehension (MRC). To address these issues, we propose a novel large language model specifically designed for the Chinese financial domain, named SNFinLLM. SNFinLLM excels in domain-specific tasks such as answering questions, summarizing financial research reports, analyzing sentiment, and executing financial calculations. We then perform the supervised fine-tuning (SFT) to enhance the model's proficiency across various financial domains. Specifically, we gather extensive financial data and create a high-quality instruction dataset composed of news articles, professional papers, and research reports of finance domain. Utilizing both domain-specific and general datasets, we proceed with continuous pre-training on an established open-source base model, resulting in SNFinLLM-base. Following this, we engage in supervised fine-tuning (SFT) to bolster the model's capability across multiple financial tasks. Crucially, we employ a straightforward Direct Preference Optimization (DPO) method to better align the model with human preferences. Extensive experiments conducted on finance benchmarks and our evaluation dataset demonstrate that SNFinLLM markedly outperforms other state-of-the-art financial language models. For more details, check out our demo video here: <a class="link-external link-https" href="https://www.youtube.com/watch?v=GYT-65HZwus" rel="external noopener nofollow">this https URL</a>.

DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuning

SNFinLLM: Systematic and Nuanced Financial Domain Adaptation of Chinese Large Language Models

FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models

CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models

Data-Centric Financial Large Language Models

Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications

DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Services

InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuning

DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultation

FinLLMs: A Framework for Financial Reasoning Dataset Generation with Large Language Models

NumLLM: Numeric-Sensitive Large Language Model for Chinese Finance

FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Models

CatMemo at the FinLLM Challenge Task: Fine-Tuning Large Language Models using Data Fusion in Financial Applications

Financial Knowledge Large Language Model

FMDLlama: Financial Misinformation Detection based on Large Language Models

PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Finance

SuperCLUE-Fin: Graded Fine-Grained Analysis of Chinese LLMs on Diverse Financial Tasks and Applications

Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Models

SilverSight: A Multi-Task Chinese Financial Large Language Model Based on Adaptive Semantic Space Learning

Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMs

FinTeamExperts: Role Specialized MOEs For Financial Analysis