Abstract:Pursuing artificial intelligence for biomedical science, a.k.a. AI Scientist, draws increasing attention, where one common approach is to build a copilot agent driven by Large Language Models (LLMs). However, to evaluate such systems, people either rely on direct Question-Answering (QA) to the LLM itself, or in a biomedical experimental manner. How to precisely benchmark biomedical agents from an AI Scientist perspective remains largely unexplored. To this end, we draw inspiration from one most important abilities of scientists, understanding the literature, and introduce BioKGBench. In contrast to traditional evaluation benchmark that only focuses on factual QA, where the LLMs are known to have hallucination issues, we first disentangle "Understanding Literature" into two atomic abilities, i) "Understanding" the unstructured text from research papers by performing scientific claim verification, and ii) Ability to interact with structured Knowledge-Graph Question-Answering (KGQA) as a form of "Literature" grounding. We then formulate a novel agent task, dubbed KGCheck, using KGQA and domain-based Retrieval-Augmented Generation (RAG) to identify the factual errors of existing large-scale knowledge graph databases. We collect over two thousand data for two atomic tasks and 225 high-quality annotated data for the agent task. Surprisingly, we discover that state-of-the-art agents, both daily scenarios and biomedical ones, have either failed or inferior performance on our benchmark. We then introduce a simple yet effective baseline, dubbed BKGAgent. On the widely used popular knowledge graph, we discover over 90 factual errors which provide scenarios for agents to make discoveries and demonstrate the effectiveness of our approach. The code and data are available at <a class="link-external link-https" href="https://github.com/westlake-autolab/BioKGBench" rel="external noopener nofollow">this https URL</a>.

BioLP-bench: Measuring understanding of biological lab protocols by large language models

LAB-Bench: Measuring Capabilities of Language Models for Biology Research

BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biology

BioKGBench: A Knowledge Graph Checking Benchmark of AI Agent for Biomedical Science

LabSafety Bench: Benchmarking LLMs on Safety Issues in Scientific Labs

Assessing Student Errors in Experimentation Using Artificial Intelligence and Large Language Models: A Comparative Study with Human Raters

NLPBench: Evaluating Large Language Models on Solving NLP Problems

Benchmarking Large Language Models for Bio-Image Analysis Code Generation

CogBench: a large language model walks into a psychology lab

Large language models in biomedical natural language processing: benchmarks, baselines, and recommendations

AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension

A systematic evaluation of large language models for biomedical natural language processing: benchmarks, baselines, and recommendations

Benchmarking Biomedical Relation Knowledge in Large Language Models

ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab

LMentry: A Language Model Benchmark of Elementary Language Tasks

LLF-Bench: Benchmark for Interactive Learning from Language Feedback

A Fine-tuning Dataset and Benchmark for Large Language Models for Protein Understanding

Elsevier Arena: Human Evaluation of Chemistry/Biology/Health Foundational Large Language Models

Benchmarking Large Language Models in Evidence-Based Medicine

AGIBench: A Multi-granularity, Multimodal, Human-referenced, Auto-scoring Benchmark for Large Language Models

Testing the reliability of an AI-based large language model to extract ecological information from the scientific literature