Abstract:Background: Transformer is an attention-based architecture proven the state-of-the-art model in natural language processing (NLP). To reduce the difficulty of beginning to use transformer-based models in medical language understanding and expand the capability of the scikit-learn toolkit in deep learning, we proposed an easy to learn Python toolkit named transformers-sklearn. By wrapping the interfaces of transformers in only three functions (i.e., fit, score, and predict), transformers-sklearn combines the advantages of the transformers and scikit-learn toolkits. Methods: In transformers-sklearn, three Python classes were implemented, namely, BERTologyClassifier for the classification task, BERTologyNERClassifier for the named entity recognition (NER) task, and BERTologyRegressor for the regression task. Each class contains three methods, i.e., fit for fine-tuning transformer-based models with the training dataset, score for evaluating the performance of the fine-tuned model, and predict for predicting the labels of the test dataset. transformers-sklearn is a user-friendly toolkit that (1) Is customizable via a few parameters (e.g., model_name_or_path and model_type), (2) Supports multilingual NLP tasks, and (3) Requires less coding. The input data format is automatically generated by transformers-sklearn with the annotated corpus. Newcomers only need to prepare the dataset. The model framework and training methods are predefined in transformers-sklearn. Results: We collected four open-source medical language datasets, including TrialClassification for Chinese medical trial text multi label classification, BC5CDR for English biomedical text name entity recognition, DiabetesNER for Chinese diabetes entity recognition and BIOSSES for English biomedical sentence similarity estimation. In the four medical NLP tasks, the average code size of our script is 45 lines/task, which is one-sixth the size of transformers' script. The experimental results show that transformers-sklearn based on pretrained BERT models achieved macro F1 scores of 0.8225, 0.8703 and 0.6908, respectively, on the TrialClassification, BC5CDR and DiabetesNER tasks and a Pearson correlation of 0.8260 on the BIOSSES task, which is consistent with the results of transformers. Conclusions: The proposed toolkit could help newcomers address medical language understanding tasks using the scikit-learn coding style easily. The code and tutorials of transformers-sklearn are available at https://doi.org/10.5281/zenodo.4453803 . In future, more medical language understanding tasks will be supported to improve the applications of transformers_sklearn.

CopiFilter: an Auxiliary Module Adapts Pre-trained Transformers for Medical Dialogue Summarization

Generate Descriptions of Medical Dialogues Through Two-Layers Transformer-Based Summarization

Towards Efficient Medical Dialogue Summarization with Compacting-Abstractive Model.

A Factual Aware Two-Stage Model for Medical Dialogue Summarization.

MedicalSum: A Guided Clinical Abstractive Summarization Model for Generating Medical Reports from Patient-Doctor Conversations

MVP: Optimizing Multi-view Prompts for Medical Dialogue Summarization.

Transformers-sklearn: a toolkit for medical language understanding with transformer-based models

Measurement of Semantic Textual Similarity in Clinical Texts: Comparison of Transformer-Based Models

Enhanced Electronic Health Records Text Summarization Using Large Language Models

Automatic analysis of medical dialogue in the home hemodialysis domain: Structure induction and summarization

Summarizing Medical Conversations via Identifying Important Utterances

Auxiliary signal-guided knowledge encoder-decoder for medical report generation

Dr. Summarize: Global Summarization of Medical Dialogue by Exploiting Local Structures

Paragraph-level Simplification of Medical Texts

Two eyes, Two views, and finally, One summary! Towards Multi-modal Multi-tasking Knowledge-Infused Medical Dialogue Summarization

Generating medically-accurate summaries of patient-provider dialogue: A multi-stage approach using large language models

Harmonising the Clinical Melody: Tuning Large Language Models for Hospital Course Summarisation in Clinical Coding

PULSAR at MEDIQA-Sum 2023: Large Language Models Augmented by Synthetic Dialogue Convert Patient Dialogues to Medical Records

A Speaker-Aware Co-Attention Framework for Medical Dialogue Information Extraction

Healthcare Copilot: Eliciting the Power of General LLMs for Medical Consultation

An Exploratory Study on Long Dialogue Summarization: What Works and What's Next