Abstract:Data science plays a critical role in clinical research, but it requires professionals with expertise in coding and medical data analysis. Large language models (LLMs) have shown great potential in supporting medical tasks and performing well in general coding tests. However, these tests do not assess LLMs' ability to handle data science tasks in medicine, nor do they explore their practical utility in clinical research. To address this, we developed a dataset consisting of 293 real-world data science coding tasks, based on 39 published clinical studies, covering 128 tasks in Python and 165 tasks in R. This dataset simulates realistic clinical research scenarios using patient data. Our findings reveal that cutting-edge LLMs struggle to generate perfect solutions, frequently failing to follow input instructions, understand target data, and adhere to standard analysis practices. Consequently, LLMs are not yet ready to fully automate data science tasks. We benchmarked advanced adaptation methods and found two to be particularly effective: chain-of-thought prompting, which provides a step-by-step plan for data analysis, which led to a 60% improvement in code accuracy; and self-reflection, enabling LLMs to iteratively refine their code, yielding a 38% accuracy improvement. Building on these insights, we developed a platform that integrates LLMs into the data science workflow for medical professionals. In a user study with five medical doctors, we found that while LLMs cannot fully automate coding tasks, they significantly streamline the programming process. We found that 80% of their submitted code solutions were incorporated from LLM-generated code, with up to 96% reuse in some cases. Our analysis highlights the potential of LLMs, when integrated into expert workflows, to enhance data science efficiency in clinical research.

Assessing the Risk of Bias in Randomized Clinical Trials With Large Language Models

CLIMB: A Benchmark of Clinical Bias in Large Language Models

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark

How Can We Diagnose and Treat Bias in Large Language Models for Clinical Decision-Making?

Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Play

Unveiling and Mitigating Bias in Mental Health Analysis with Large Language Models

Ensuring Safety and Trust: Analyzing the Risks of Large Language Models in Medicine

Clinical Risk Prediction Using Language Models: Benefits And Considerations

Scaling Clinical Trial Matching Using Large Language Models: A Case Study in Oncology

Unmasking and Quantifying Racial Bias of Large Language Models in Medical Report Generation

Evaluating large language models in medical applications: a survey

Matching Patients to Clinical Trials with Large Language Models

Transforming clinical trials: the emerging roles of large language models

Evaluating and Addressing Demographic Disparities in Medical Large Language Models: A Systematic Review

Exploring the potential of Claude 2 for risk of bias assessment: Using a large language model to assess randomized controlled trials with RoB 2

Automatically Extracting Numerical Results from Randomized Controlled Trials with Large Language Models

A Clinical Trial Design Approach to Auditing Language Models in Healthcare Setting

Distilling large language models for matching patients to clinical trials

Enhancing Biomarker-Based Oncology Trial Matching Using Large Language Models

The long but necessary road to responsible use of large language models in healthcare research

Can Large Language Models Replace Data Scientists in Clinical Research?