Abstract:Our team, ECNU-LLM, presents a method of in-context learning for enhancing the performance of large language models without fine-tuning in the 9th China Health Information Processing Conference (CHIP 2023) Open Shared Task PromptCBLUE-v2 evaluation task ( http://www.cips-chip.org.cn/2023/eval1 ). Our method contains the following steps: (1) Initially, we employ text retrieval models to select the top demonstrations from the training set based on the similarity scores. (2) Furthermore, we handle different tasks separately by adding prompts according to their task types. (3) For certain tasks, the chain-of-thought approach is employed to further improve performance. (4) Finally, we improve the post-processing scripts provided by the task organizers, enabling more efficient extraction of information from large model language outputs. Using this approach, we utilize Baichuan-13B-Chat to directly generate predictions on the test set, achieving a score of 39.25 in the CHIP2023-PromptCBLUE-no fine-tuning track.

ECNU-LLM@CHIP-PromptCBLUE: Prompt Optimization and In-Context Learning for Chinese Medical Tasks