Search
 
loader loading subjects...
cover
Towards Hybrid Evaluation Methodologies for Large Language Models in the Legal Domain
Marco Sanchi, Tereza Novotná
389 - 392
10.3233/FAIA241279
Research Article
Frontiers in Artificial Intelligence and Applications
Volume 395: Legal Knowledge and Information Systems
Abstract

This paper analyses automated and human-driven evaluation approaches for Large Language Models (LLMs) performance in the legal domain, stressing the need to combine both into hybrid evaluation frameworks. This conclusion is reinforced by a qualitative case study that uncovers assessment factors considered by lawyers when using LLMs. The diverse nature of these factors, requiring distinct evaluation approaches, underscores the need for adopting a hybrid methodology.

Download
Creative Commons License