Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?
Identification
- Public canonical key
- radar:r-d09f699eecd5046f9d65ca804bd4c516
- Authors
- Sungeun Kim · Dongsuk Oh
- Reported year
- 2025
- Reported language
- en
- Source type
- article
- First detected
- 2026-11-13T12:38:25.174830+00:00
- Last metadata observation
- 2026-11-13T12:38:25.174830+00:00
- Last HTTP verification
- Not checked
Institutions reported by the source
Kyungpook National University
Reported affiliation countries
KR
Documentary abstract — original language
The evaluation of creative writing has long been a complex and subjective process, made even more intriguing by the rise of advanced Artificial Intelligence (AI) tools like Large Language Models (LLMs). This study evaluates the potential of LLMs as reliable and consistent evaluators of creative texts, directly comparing their performance with traditional human evaluations. The analysis focuses on key creative criteria, including fluency, flexibility, elaboration, originality, usefulness, and specific creativity strategies. Results demonstrate that LLMs provide consistent and objective evaluations, achieving higher Inter-Annotator Agreement (IAA) compared with human evaluators. However, LLMs face limitations in recognizing nuanced, culturally specific, and context-dependent aspects of creativity. Conversely, human evaluators, despite lower consistency and higher subjectivity, exhibit strengths in capturing deeper contextual insights. These findings highlight the need for the further refinement of LLMs to address the complexities of creative writing evaluation.
Identifiers
- OPENALEX
- https://openalex.org/W4408292186
- DOI
- 10.3390/app15062971
Documentary context
- Documentary family
- article
- Source-reported types
- article
- Publishers
- Multidisciplinary Digital Publishing Institute
Entity mentions are not evidence of legal recognition. Jurisdiction studied is separate from author affiliation country.
Sources
OpenAlex · Record 1
Cite this reference
Sungeun Kim; Dongsuk Oh. Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. 2025. https://doi.org/10.3390/app15062971
JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·
APA, Chicago, ISO 690: bibliographic formats using available fields. OSCOLA / Bluebook: structured data only; full legal citation compliance is not claimed without verification of required elements.
- APA
- Sungeun Kim; Dongsuk Oh. (2025). Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. https://doi.org/10.3390/app15062971
- Chicago
- Sungeun Kim; Dongsuk Oh. Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. 2025. https://doi.org/10.3390/app15062971
- ISO 690
- Sungeun Kim; Dongsuk Oh. Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. 2025. https://doi.org/10.3390/app15062971
Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31
UDTR Global Rights of Nature Legal Library. Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. Documentary record: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-d09f699eecd5046f9d65ca804bd4c516/ · Last HTTP verification: not performed
Research dossiers and documentary relations
Source roles
Bibliographic / original publication source · https://doi.org/10.3390/app15062971
An authority link alone does not verify a legal claim. Abstracts and full texts remain subject to their source terms.
Documentary status
Relevance pending
Library
This identity is not yet included in the Legal Library.