UDTR Global Radar

UDTR Global Rights of Nature Radar

Documentary registry of records detected across the scholarly, legal and institutional infrastructures monitored by UDTR.

A global documentary infrastructure designed to achieve the broadest verifiable and scientifically defensible coverage of the Rights of Nature.

← Back to Radar

Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?

Identification

Public canonical key
radar:r-d09f699eecd5046f9d65ca804bd4c516
Authors
Sungeun Kim · Dongsuk Oh
Reported year
2025
Reported language
en
Source type
article
First detected
2026-11-13T12:38:25.174830+00:00
Last metadata observation
2026-11-13T12:38:25.174830+00:00
Last HTTP verification
Not checked

Institutions reported by the source

Kyungpook National University

Reported affiliation countries

KR

Documentary abstract — original language

The evaluation of creative writing has long been a complex and subjective process, made even more intriguing by the rise of advanced Artificial Intelligence (AI) tools like Large Language Models (LLMs). This study evaluates the potential of LLMs as reliable and consistent evaluators of creative texts, directly comparing their performance with traditional human evaluations. The analysis focuses on key creative criteria, including fluency, flexibility, elaboration, originality, usefulness, and specific creativity strategies. Results demonstrate that LLMs provide consistent and objective evaluations, achieving higher Inter-Annotator Agreement (IAA) compared with human evaluators. However, LLMs face limitations in recognizing nuanced, culturally specific, and context-dependent aspects of creativity. Conversely, human evaluators, despite lower consistency and higher subjectivity, exhibit strengths in capturing deeper contextual insights. These findings highlight the need for the further refinement of LLMs to address the complexities of creative writing evaluation.

Identifiers

OPENALEX
https://openalex.org/W4408292186
DOI
10.3390/app15062971

Documentary context

Documentary family
article
Source-reported types
article
Publishers
Multidisciplinary Digital Publishing Institute

Entity mentions are not evidence of legal recognition. Jurisdiction studied is separate from author affiliation country.

Sources

OpenAlex · Record 1

Cite this reference

Sungeun Kim; Dongsuk Oh. Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. 2025. https://doi.org/10.3390/app15062971

JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·

APA, Chicago, ISO 690: bibliographic formats using available fields. OSCOLA / Bluebook: structured data only; full legal citation compliance is not claimed without verification of required elements.

APA
Sungeun Kim; Dongsuk Oh. (2025). Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. https://doi.org/10.3390/app15062971
Chicago
Sungeun Kim; Dongsuk Oh. Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. 2025. https://doi.org/10.3390/app15062971
ISO 690
Sungeun Kim; Dongsuk Oh. Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. 2025. https://doi.org/10.3390/app15062971

Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31

UDTR Global Rights of Nature Legal Library. Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?. Documentary record: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-d09f699eecd5046f9d65ca804bd4c516/ · Last HTTP verification: not performed

Report a correction

Frozen-version metadata

Research dossiers and documentary relations

Source roles

Bibliographic / original publication source · https://doi.org/10.3390/app15062971

An authority link alone does not verify a legal claim. Abstracts and full texts remain subject to their source terms.

Documentary status

Relevance pending

Library

This identity is not yet included in the Legal Library.

UDTR Global Rights of Nature Legal Library