Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms
Identification
- Public canonical key
- radar:r-ab9dcac9ba8649fff8ed7c1c8ace2444
- Authors
- Eunsong Lee · Hai-Dung Do · Minsu Kim · Dongsuk Oh
- Reported year
- 2025
- Reported language
- en
- Source type
- article
- First detected
- 2026-11-13T12:38:25.174830+00:00
- Last metadata observation
- 2026-11-13T12:38:25.174830+00:00
- Last HTTP verification
- Not checked
Institutions reported by the source
Kyungpook National University
Reported affiliation countries
KR
Documentary abstract — original language
This study proposes a new benchmark to evaluate the cultural understanding and natural language processing capabilities of large language models based on Sino-Korean words and four-character idioms. Those are essential linguistic and cultural assets in Korea. Reflecting the official question types of the Korean Hanja Proficiency Test, we constructed four question categories—four-character idioms, synonyms, antonyms, and homophones—and systematically compared the performance of GPT-based and non-GPT LLMs. GPT-4o showed the highest accuracy and explanation quality. However, challenges remain in distinguishing the subtle nuances of individual characters and in adapting to uniquely Korean meanings as opposed to standard Chinese character interpretations. Our findings reveal a gap in LLMs’ understanding of Korea-specific Hanja culture and underscore the need for evaluation tools reflecting these cultural distinctions.
Identifiers
- OPENALEX
- https://openalex.org/W4412087575
- DOI
- 10.3390/app15137561
Documentary context
- Documentary family
- article
- Source-reported types
- article
- Publishers
- Multidisciplinary Digital Publishing Institute
Entity mentions are not evidence of legal recognition. Jurisdiction studied is separate from author affiliation country.
Sources
OpenAlex · Record 1
Cite this reference
Eunsong Lee; Hai-Dung Do; Minsu Kim; Dongsuk Oh. Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. 2025. https://doi.org/10.3390/app15137561
JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·
APA, Chicago, ISO 690: bibliographic formats using available fields. OSCOLA / Bluebook: structured data only; full legal citation compliance is not claimed without verification of required elements.
- APA
- Eunsong Lee; Hai-Dung Do; Minsu Kim; Dongsuk Oh. (2025). Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. https://doi.org/10.3390/app15137561
- Chicago
- Eunsong Lee; Hai-Dung Do; Minsu Kim; Dongsuk Oh. Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. 2025. https://doi.org/10.3390/app15137561
- ISO 690
- Eunsong Lee; Hai-Dung Do; Minsu Kim; Dongsuk Oh. Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. 2025. https://doi.org/10.3390/app15137561
Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31
UDTR Global Rights of Nature Legal Library. Knowing the Words, Missing the Meaning: Evaluating LLMs’ Cultural Understanding Through Sino-Korean Words and Four-Character Idioms. Documentary record: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-ab9dcac9ba8649fff8ed7c1c8ace2444/ · Last HTTP verification: not performed
Research dossiers and documentary relations
Source roles
Bibliographic / original publication source · https://doi.org/10.3390/app15137561
An authority link alone does not verify a legal claim. Abstracts and full texts remain subject to their source terms.
Documentary status
Relevance pending
Library
This identity is not yet included in the Legal Library.