Search
 
loader loading subjects...
cover
Assessing the Proficiency of LLMs with Various Tasks and Evaluators
Tong Min Kim, Youngrong Lee, Chansik Kim, Taehoon Ko
552 - 553
10.3233/SHTI240473
Research Article
Studies in Health Technology and Informatics
Volume 316: Digital Health and Informatics Innovations for Sustainable Health Care Systems
Abstract

Previous studies have been limited to giving one or two tasks to Large Language Models (LLMs) and involved a small number of evaluators within a single domain to evaluate the LLM’s answer. We assessed the proficiency of four LLMs by applying eight tasks and evaluating 32 results with 17 evaluators from diverse domains, demonstrating the significance of various tasks and evaluators on LLMs.

Download
Creative Commons License