Abstract:Objective: Medical laboratory testing is essential in healthcare, providing crucial data for diagnosis and treatment. Nevertheless, patients' lab testing results are often transferred via fax across healthcare organizations and are not immediately available for timely clinical decision making. Thus, it is important to develop new technologies to accurately extract lab testing information from scanned laboratory reports. This study aims to develop an advanced deep learning-based Optical Character Recognition (OCR) method to identify tables containing lab testing results in scanned laboratory reports. Methods: Extracting tabular data from scanned lab reports involves two stages: table detection (i.e., identifying the area of a table object) and table recognition (i.e., identifying and extracting tabular structures and contents). DETR R18 algorithm as well as YOLOv8s were involved for table detection, and we compared the performance of PaddleOCR and the encoder-dual-decoder (EDD) model for table recognition. 650 tables from 632 randomly selected laboratory test reports were annotated and used to train and evaluate those models. For table detection evaluation, we used metrics such as Average Precision (AP), Average Recall (AR), AP50, and AP75. For table recognition evaluation, we employed Tree-Edit Distance (TEDS). Results: For table detection, fine-tuned DETR R18 demonstrated superior performance (AP50: 0.774; AP75: 0.644; AP: 0.601; AR: 0.766). In terms of table recognition, fine-tuned EDD outperformed other models with a TEDS score of 0.815. The proposed OCR pipeline (fine-tuned DETR R18 and fine-tuned EDD), demonstrated impressive results, achieving a TEDS score of 0.699 and a TEDS structure score of 0.764. Conclusions: Our study presents a dedicated OCR pipeline for scanned clinical documents, utilizing state-of-the-art deep learning models for region-of-interest detection and table recognition. The high TEDS scores demonstrate the effectiveness of our approach, which has significant implications for clinical data analysis and decision-making.

An Efficient Method to Extract Data from Bank Statements Based on Image-Based Table Detection

Automated bank cheque verification using image processing and deep learning methods

Financial Table Extraction in Image Documents

ClusTi: Clustering Method for Table Structure Recognition in Scanned Images

Extraction of legal amount from color bank check images

Deep Structured Feature Networks for Table Detection and Tabular Data Extraction from Scanned Financial Document Images

A visual analysis approach for data transformation via domain knowledge and intelligent models

Why do banks fail? An investigation via text mining

Table detection in business document images by message passing networks

An efficient Search Tool for an Anti-Money Laundering Application of an Multi-national Bank's Dataset

Extraction of handwritten areas from colored image of bank checks by an hybrid method

Research on artificial intelligence of accounting information processing based on image processing

Improving tabular data extraction in scanned laboratory reports using deep learning models

Flexible Hybrid Table Recognition and Semantic Interpretation System

Efficient Bank Fraud Detection with Machine Learning

Digitizing Historical Balance Sheet Data: A Practitioner's Guide

Enhanced Bank Check Security: Introducing a Novel Dataset and Transformer-Based Approach for Detection and Verification

Identifying People's Faces in Smart Banking Systems Using Artificial Neural Networks

Table Detection and Extraction using OpenCV and Novel Optimization Methods

An Overview of Data Extraction From Invoices

Realtime Detection of Table Objects and Text Areas for OCR Preprocessing