Abstract:With the rapid advancement of artificial intelligence and deep learning technologies, large language models (LLMs) such as ChatGPT and GPT-4 have made significant progress in comprehending and responding to human instructions. Acupuncture and moxibustion, therapeutic modalities in Traditional Chinese Medicine (TCM), possess extensive knowledge beneficial for patient treatment. Currently, acupuncture diagnosis relies on the experience and skills of individual acupuncturists, emphasizing the need for research to improve diagnostic accuracy through objective methods. Therefore, the integration of LLMs into the field of acupuncture can facilitate the recommendation of personalized acupuncture treatment programs. However, the application of general LLMs to the field of acupuncture diagnosis often yields suboptimal results. In addition, most LLM evaluation metrics depend solely on literal overlap and fail to capture semantic similarity. To address these challenges, this paper introduces AcupunctureGPT, a specialized large language model for acupuncture diagnosis, aimed at exploring the potential application of LLMs in this field. Patient Diagnostic Acupuncture Data is constructed to enhance the diagnostic capabilities of AcupunctureGPT in acupuncture. The Generated Knowledge Filter Prompting approach is proposed to improve the accuracy of LLMs in identifying similar diseases through the development and filtering of knowledge statements. The Sentence Similarity Evaluation Module (SSEM) is employed to assess the generation quality of LLMs at the semantic level. The Sentence Adaptive Enhancement Fusion Module (SAEFM), proposed within SSEM, enhances the adaptive fusion of output features at various levels. Experimental results demonstrate that AcupunctureGPT outperforms other large language models in diagnosing diseases and devising reasonable treatment plans. Furthermore, the evaluation metrics proposed in this paper have been validated for effectiveness.

Exploring Large Language Models for Acronym, Symbol Sense Disambiguation, and Semantic Similarity and Relatedness Assessment

Disambiguation of acronyms in clinical narratives with large language models

Improving Clinical Expertise in Large Language Models Using Electronic Medical Records

Evaluation of General Large Language Models in Contextually Assessing Semantic Concepts Extracted from Adult Critical Care Electronic Health Record Notes

Leveraging Large Language Models for Clinical Abbreviation Disambiguation

Large Language Models Struggle in Token-Level Clinical Named Entity Recognition

Taming Large Language Models to Implement Diagnosis and Evaluating the Generation of Llms at the Semantic Similarity Level in Acupuncture and Moxibustion

Application Research of Large Language Models in Medicine: Status, Problems, and Future

Is larger always better? Evaluating and prompting large language models for non-generative medical tasks

Large language models in health care: Development, applications, and challenges

Large Language Model Symptom Identification from Clinical Text: A Multi-Center Study

Large language models for biomedicine: foundations, opportunities, challenges, and best practices

Generalizable clinical note section identification with large language models

Large Language Models in Healthcare: A Comprehensive Benchmark

Evaluating large language models in medical applications: a survey

Large language models for science and medicine

A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine

Are Large Language Models Ready for Healthcare? A Comparative Study on Clinical Language Understanding

Comparative Analysis of Large Language Models in Chinese Medical Named Entity Recognition

Demystifying Large Language Models for Medicine: A Primer

Large language models encode clinical knowledge