UDTR Global Radar

UDTR Global Rights of Nature Radar

Documentary registry of records detected across the scholarly, legal and institutional infrastructures monitored by UDTR.

A global documentary infrastructure designed to achieve the broadest verifiable and scientifically defensible coverage of the Rights of Nature.

← Back to Radar

Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms

Identification

Public canonical key
radar:r-ab9dcac9ba8649fff8ed7c1c8ace2444
Authors
Eunsong Lee · Hai-Dung Do · Minsu Kim · Dongsuk Oh
Reported year
2025
Reported language
en
Source type
article
First detected
2026-11-13T12:38:25.174830+00:00
Last metadata observation
2026-11-13T12:38:25.174830+00:00
Last HTTP verification
Not checked

Institutions reported by the source

Kyungpook National University

Reported affiliation countries

KR

Documentary abstract — original language

This study proposes a new benchmark to evaluate the cultural understanding and natural language processing capabilities of large language models based on Sino-Korean words and four-character idioms. Those are essential linguistic and cultural assets in Korea. Reflecting the official question types of the Korean Hanja Proficiency Test, we constructed four question categories—four-character idioms, synonyms, antonyms, and homophones—and systematically compared the performance of GPT-based and non-GPT LLMs. GPT-4o showed the highest accuracy and explanation quality. However, challenges remain in distinguishing the subtle nuances of individual characters and in adapting to uniquely Korean meanings as opposed to standard Chinese character interpretations. Our findings reveal a gap in LLMs’ understanding of Korea-specific Hanja culture and underscore the need for evaluation tools reflecting these cultural distinctions.

Identifiers

OPENALEX
https://openalex.org/W4412087575
DOI
10.3390/app15137561

Documentary context

Documentary family
article
Source-reported types
article
Publishers
Multidisciplinary Digital Publishing Institute

Entity mentions are not evidence of legal recognition. Jurisdiction studied is separate from author affiliation country.

Sources

OpenAlex · Record 1

Cite this reference

Eunsong Lee; Hai-Dung Do; Minsu Kim; Dongsuk Oh. Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. 2025. https://doi.org/10.3390/app15137561

JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·

APA, Chicago, ISO 690: bibliographic formats using available fields. OSCOLA / Bluebook: structured data only; full legal citation compliance is not claimed without verification of required elements.

APA
Eunsong Lee; Hai-Dung Do; Minsu Kim; Dongsuk Oh. (2025). Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. https://doi.org/10.3390/app15137561
Chicago
Eunsong Lee; Hai-Dung Do; Minsu Kim; Dongsuk Oh. Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. 2025. https://doi.org/10.3390/app15137561
ISO 690
Eunsong Lee; Hai-Dung Do; Minsu Kim; Dongsuk Oh. Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. 2025. https://doi.org/10.3390/app15137561

Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31

UDTR Global Rights of Nature Legal Library. Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. Documentary record: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-ab9dcac9ba8649fff8ed7c1c8ace2444/ · Last HTTP verification: not performed

Report a correction

Frozen-version metadata

Research dossiers and documentary relations

Source roles

Bibliographic / original publication source · https://doi.org/10.3390/app15137561

An authority link alone does not verify a legal claim. Abstracts and full texts remain subject to their source terms.

Documentary status

Relevance pending

Library

This identity is not yet included in the Legal Library.

UDTR Global Rights of Nature Legal Library