Abstract:Traditional banks face increasing competition from FinTechs in the rapidly evolving financial ecosystem. Raising operational efficiency is vital to address this challenge. Our study aims to improve the efficiency of document-intensive business processes in banking. To that end, we first review the landscape of business documents in the retail segment. Banking documents often contain text, layout, and visuals, suggesting that document analytics and process automation require more than plain natural language processing (NLP). To verify this and assess the incremental value of visual cues when processing business documents, we compare a recently proposed multimodal model called LayoutXLM to powerful text classifiers (e.g., BERT) and large language models (e.g., GPT) in a case study related to processing company register extracts. The results confirm that incorporating layout information in a model substantially increases its performance. Interestingly, we also observed that more than 75% of the best model performance (in terms of the F1 score) can be achieved with as little as 30% of the training data. This shows that the demand for data labeled data to set up a multi-modal model can be moderate, which simplifies real-world applications of multimodal document analytics. Our study also sheds light on more specific practices in the scope of calibrating a multimodal banking document classifier, including the need for fine-tuning. In sum, the paper contributes original empirical evidence on the effectiveness and efficiency of multi-model models for document processing in the banking business and offers practical guidance on how to unlock this potential in day-to-day operations.

CatalogBank: A Structured and Interoperable Catalog Dataset with a Semi-Automatic Annotation Tool (DocumentLabeler) for Engineering System Design

An Ontology-Based Domain Modeling Framework for Knowledge Service in Digital Library

An Ontology-Based Automatic Semantic Annotation Approach for Patent Document Retrieval in Product Innovation Design

PDFChatAnnotator: A Human-LLM Collaborative Multi-Modal Data Annotation Tool for PDF-Format Catalogs

Semantics-Based Design Knowledge Annotation And Retrieval

Document Layout Annotation: Database and Benchmark in the Domain of Public Affairs

CED: Catalog Extraction from Documents

User Manual of Automatic Data Curation Tool(ADCT): A bulk data curator software in Library and Information Science

What's in a Name? Evaluating Assembly-Part Semantic Knowledge in Language Models through User-Provided Names in CAD Files

Continuous document layout analysis: Human-in-the-loop AI-based data curation, database, and evaluation in the domain of public affairs

CataAnno: An Ancient Catalog Annotator for Annotation Cleaning by Recommendation

DSDL: Data Set Description Language for Bridging Modalities and Tasks in AI Data

DeepPatent2: A Large-Scale Benchmarking Corpus for Technical Drawing Understanding

DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysis

ChemBrowser: a flexible framework for mining chemical documents

Multimodal Document Analytics for Banking Process Automation

'CADSketchNet' -- An Annotated Sketch dataset for 3D CAD Model Retrieval with Deep Neural Networks

Text2CAD: Generating Sequential CAD Models from Beginner-to-Expert Level Text Prompts

State-of-the-Art and Future Challenges in the Integration of Biobank Catalogues

A Scientific Information Extraction Dataset for Nature Inspired Engineering

AutoMate: A Dataset and Learning Approach for Automatic Mating of CAD Assemblies