Responses of the GPT-4o mini and Bielik-11B-v2 Large Language Models in Polish Law Tasks, Evaluated for Accuracy, Limitations Signalling, and the Occurrence of Hallucinations
Identification
- Clé publique
- radar:r-c938f25349fe8f44173f1a4240033056
- Auteurs
- Andrzej Porębski · Jakub Figura
- Année déclarée
- 2026
- Langue déclarée
- en
- Type source
- dataset
- Première détection
- 2026-11-13T12:45:05.218966+00:00
- Dernière observation des métadonnées
- 2026-11-13T12:45:05.218966+00:00
- Dernière vérification HTTP
- Non effectuée
Institutions déclarées par la source
Jagiellonian University
Pays d’affiliation déclarés
PL
Résumé documentaire — langue originale
This dataset includes 120 responses to prompts about Polish law provided by two large language models, GPT-4o mini and Bielik-11B-v2-instuct, which were available to users for free in January 2025. The responses were evaluated in terms of their overall accuracy and ability to counter the erroneous assumption present in the prompt, signal limitations in the response, and whether the rulings cited by the models existed or were hallucinated (the latter aspect was not taken into account in the overall evaluation of the correctness of the responses). The dataset contains two final files that form the basis for further research: the first is a database of 120 model responses that were evaluated for overall accuracy and signaling of limitations by the model; the second is a database of 369 rulings cited in the models' responses, which were evaluated in terms of the existence of their signatures, the existence of signatures associated with the correct type of ruling, the authority and date of issue, and the thematic consistency of the cited ruling with the field of law to which the command related. The dataset was created as part of a research project funded by the National Science Centre, Poland, entitled "The Understandability Requirement of Machine Learning Systems Used in the Application of Law" (No. 2022/45/N/HS5/00871).
Identifiants
- OPENALEX
- https://openalex.org/W7134811757
- DOI
- 10.57903/uj/2xpzke
Repères documentaires
- Famille documentaire
- dataset
- Types déclarés par les sources
- dataset
Les mentions d’entités ne constituent pas une preuve de reconnaissance juridique. La juridiction étudiée est distincte du pays d’affiliation des auteurs.
Sources
OpenAlex · Document 1
Citer cette référence
Andrzej Porębski; Jakub Figura. Responses of the GPT-4o mini and Bielik-11B-v2 Large Language Models in Polish Law Tasks, Evaluated for Accuracy, Limitations Signalling, and the Occurrence of Hallucinations. 2026. https://doi.org/10.57903/uj/2xpzke
JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·
APA, Chicago, ISO 690 : formats bibliographiques fondés sur les champs disponibles. OSCOLA / Bluebook : données structurées uniquement ; aucune conformité juridique complète n’est revendiquée sans vérification des éléments nécessaires.
- APA
- Andrzej Porębski; Jakub Figura. (2026). Responses of the GPT-4o mini and Bielik-11B-v2 Large Language Models in Polish Law Tasks, Evaluated for Accuracy, Limitations Signalling, and the Occurrence of Hallucinations. https://doi.org/10.57903/uj/2xpzke
- Chicago
- Andrzej Porębski; Jakub Figura. Responses of the GPT-4o mini and Bielik-11B-v2 Large Language Models in Polish Law Tasks, Evaluated for Accuracy, Limitations Signalling, and the Occurrence of Hallucinations. 2026. https://doi.org/10.57903/uj/2xpzke
- ISO 690
- Andrzej Porębski; Jakub Figura. Responses of the GPT-4o mini and Bielik-11B-v2 Large Language Models in Polish Law Tasks, Evaluated for Accuracy, Limitations Signalling, and the Occurrence of Hallucinations. 2026. https://doi.org/10.57903/uj/2xpzke
Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31
UDTR — Bibliothèque juridique mondiale des droits de la Nature. Responses of the GPT-4o mini and Bielik-11B-v2 Large Language Models in Polish Law Tasks, Evaluated for Accuracy, Limitations Signalling, and the Occurrence of Hallucinations. Notice documentaire: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-c938f25349fe8f44173f1a4240033056/ · Dernière vérification HTTP : non effectuée
Données de cette version figée
Dossiers et relations documentaires
Rôles des sources
Source bibliographique / publication d’origine · https://doi.org/10.57903/uj/2xpzke
Un lien vers une autorité ne prouve pas à lui seul une affirmation juridique. Les résumés et les textes intégraux restent soumis aux conditions de leur source.
Statut documentaire
Pertinence à examiner
Bibliothèque
Cette identité n’est pas encore intégrée à la Bibliothèque juridique.