Abstract:Introduction: In response to the increasing prevalence of electronic medical records (EMRs) stored in databases, healthcare staff are encountering difficulties retrieving these records due to their limited technical expertise in database operations. As these records are crucial for delivering appropriate medical care, there is a need for an accessible method for healthcare staff to access EMRs. Methods: To address this, natural language processing (NLP) for Text-to-SQL has emerged as a solution, enabling non-technical users to generate SQL queries using natural language text. This research assesses existing work on Text-to-SQL conversion and proposes the MedT5SQL model specifically designed for EMR retrieval. The proposed model utilizes the Text-to-Text Transfer Transformer (T5) model, a Large Language Model (LLM) commonly used in various text-based NLP tasks. The model is fine-tuned on the MIMICSQL dataset, the first Text-to-SQL dataset for the healthcare domain. Performance evaluation involves benchmarking the MedT5SQL model on two optimizers, varying numbers of training epochs, and using two datasets, MIMICSQL and WikiSQL. Results: For MIMICSQL dataset, the model demonstrates considerable effectiveness in generating question-SQL pairs achieving accuracy of 80.63%, 98.937%, and 90% for exact match accuracy matrix, approximate string-matching, and manual evaluation, respectively. When testing the performance of the model on WikiSQL dataset, the model demonstrates efficiency in generating SQL queries, with an accuracy of 44.2% on WikiSQL and 94.26% for approximate string-matching. Discussion: Results indicate improved performance with increased training epochs. This work highlights the potential of fine-tuned T5 model to convert medical-related questions written in natural language to Structured Query Language (SQL) in healthcare domain, providing a foundation for future research in this area.

mRAT-SQL+GAP:A Portuguese Text-to-SQL Transformer

DuoRAT: Towards Simpler Text-to-SQL Models

DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL

Transformer Models for Brazilian Portuguese Question Generation: An Experimental Study

From Brazilian Portuguese to European Portuguese

Ar-Spider: Text-to-SQL in Arabic

Advancing Neural Encoding of Portuguese with Transformer Albertina PT-*

MediAlbertina: An European Portuguese medical language model

Cabrita: closing the gap for foreign languages

The Chronicles of RAG: The Retriever, the Chunk and the Generator

AraSpider: Democratizing Arabic-to-SQL

StatBot.Swiss: Bilingual Open Data Exploration in Natural Language

Automatic Spanish Translation of the SQuAD Dataset for Multilingual Question Answering

SQLformer: Deep Auto-Regressive Query Graph Generation for Text-to-SQL Translation

Translating Headers of Tabular Data: A Pilot Study of Schema Translation

Lite Training Strategies for Portuguese-English and English-Portuguese Translation

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL Translation

Automated Multi-Language to English Machine Translation Using Generative Pre-Trained Transformers

PORTULAN ExtraGLUE Datasets and Models: Kick-starting a Benchmark for the Neural Processing of Portuguese

MedT5SQL: a transformers-based large language model for text-to-SQL conversion in the healthcare domain