Assessing the Proficiency of LLMs with Various Tasks and Evaluators

Tong Min Kim,Youngrong Lee,Chansik Kim,Taehoon Ko
DOI: https://doi.org/10.3233/SHTI240473
2024-08-22
Abstract:Previous studies have been limited to giving one or two tasks to Large Language Models (LLMs) and involved a small number of evaluators within a single domain to evaluate the LLM's answer. We assessed the proficiency of four LLMs by applying eight tasks and evaluating 32 results with 17 evaluators from diverse domains, demonstrating the significance of various tasks and evaluators on LLMs.
What problem does this paper attempt to address?