Abstract:Large language models (LLMs) excel at providing general and comprehensive health advice in single-turn dialogues. However, the limited information in single-turn conversations provided by users results in generated advice lacking personalization and specificity. In real-world medical consultations, doctors typically gain a comprehensive understanding of a patient’s condition through a series of iterative inquiries, enabling them to subsequently offer effective and personalized advice. To enhance capabilities similar to those of doctors, existing approaches often learn by increasing multi-turn medical dialogue corpora. In this study, we consider capturing the transitions of medical terms in each turn crucial, as they aid in understanding the flow of the conversation and enhance the accuracy of generating medical term information in the next turn. Therefore, we propose a Term-aware Agent (T-Agent) and develop a corresponding term extraction tool and term prediction model. T-Agent explicitly models the flow of term information in the dialogue by invoking the term extraction tool and the term prediction model. To better learn the term prediction task, we adopt a two-stage training approach. In the first stage, we conduct mixed training on a single large model, simultaneously learning term prediction and the ability of T-Agent to invoke term tools for dialogue. This mixed training in the first stage allows the large model to initially adapt to the term prediction task. In the second stage, we independently train the term prediction model and T-Agent on this basis, enhancing their expertise and performance in their respective tasks. We validated the effectiveness of the proposed method on two Chinese multi-turn medical dialogue datasets, demonstrating significant performance improvements, particularly in the accuracy of term information within dialogues.

MMedAgent: Learning to Use Medical Tools with Multi-modal Agent

MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning

MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making

Med-PMC: Medical Personalized Multi-modal Consultation with a Proactive Ask-First-Observe-Next Paradigm

MGA: Medical generalist agent through text-guided knowledge transformation

RareAgents: Autonomous Multi-disciplinary Team for Rare Disease Diagnosis and Treatment

Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE

MedAide: Towards an Omni Medical Aide via Specialized LLM-based Multi-Agent Collaboration

AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator

MultiMed: Massively Multimodal and Multitask Medical Understanding

MedMax: Mixed-Modal Instruction Tuning for Training Biomedical Assistants

MEDCO: Medical Education Copilots Based on A Multi-Agent Framework

Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models

M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models

Interpretable Bilingual Multimodal Large Language Model for Diverse Biomedical Tasks

T-Agent: A Term-Aware Agent for Medical Dialogue Generation

SemiHVision: Enhancing Medical Multimodal Models with a Semi-Human Annotated Dataset and Fine-Tuned Instruction Generation

ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferences

MedViLaM: A multimodal large language model with advanced generalizability and explainability for medical data understanding and generation

PeFoMed: Parameter Efficient Fine-tuning of Multimodal Large Language Models for Medical Imaging

MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning