Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting
Identification
- Clé publique
- radar:r-89817ab6f5cac343b6f09ef46bf8dcea
- Auteurs
- Avijit Ghosh · Anka Reuel · Jenny Chim · Wm. Matthew Kennedy · Srishti Yadav · Jennifer Mickel · Yanan Long · Andrew Tran · Anastassia Kornilova · Damian Stachura · Kevin Klyman · Felix Friedrich · Jeba Sania · Jan Batzner · Anoop Mishra · Eliya Habba · Yixiong Hao · Nathan Heath · Shalaleh Rismani · Usman Gohar · Andrea Loehr · David Manheim · Ruchira Dhar · Sree Harsha Nelaturu · Aarush Sinha · Leshem Choshen · Drishti Sharma · Ishan Khire · Amit Saha · Subramanyam Sahoo · Michael Hardy · Michael Alexander Riegler · Kabir Manghnani · Michelle Lin · Yanan Jiang · Yanan Jiang · Asaf Yehudai · Jessica Ji · Aris Hofmann · Mubashara Akhtar · Max Lamparth · Nuno Moniz · Yacine Jernite · Stella Biderman · Zeerak Talat · Sanmi Koyejo · Mykel J. Kochenderfer · Irene Solaiman
- Année déclarée
- 2026
- Langue déclarée
- en
- Type source
- preprint
- Première détection
- 2026-11-14T02:16:53.707393+00:00
- Dernière observation des métadonnées
- 2026-11-14T02:16:53.707393+00:00
- Dernière vérification HTTP
- Non effectuée
Institutions déclarées par la source
Baden-Wuerttemberg Cooperative State University · Georgetown University · Stanford University · Queen Mary University of London · Technion – Israel Institute of Technology · Technische Universität Darmstadt · Harvard University · Weizenbaum Institute · Technical University of Munich · Amherst College · Hebrew University of Jerusalem · Iowa State University · McGill University · University of Copenhagen · Zuse Institute Berlin · IBM (United States) · Massachusetts Institute of Technology · Georgia Institute of Technology · Mila - Quebec Artificial Intelligence Institute · Université de Montréal · ETH Zurich · University of Notre Dame · University of Edinburgh
Pays d’affiliation déclarés
CA · CH · DE · DK · GB · IL · US
Résumé documentaire — langue originale
AI evaluation results are produced at scale but reported inconsistently across leaderboards, model cards, benchmark papers, and company blogs. The cost is interpretive: readers cannot reliably compare results across sources, identify what a report omits, or trace an aggregate claim to its underlying evidence. Recent efforts address isolated components but leave three gaps: they cover only narrow slices of the evaluation lifecycle and do not compose into a single interpretable record; they specify static representations that do not differentiate the questions different stakeholders bring to the same evidence; and they remain proposals on paper, lacking the extraction infrastructure required for adoption at scale. We present \EvalCards{}, an operational reporting layer that composes benchmark metadata, evaluation run data, and model metadata into a unified record. We (1) derive a reporting schema from a structured review of 52 papers and 10 stakeholder interviews, (2) implement four interpretive signals (reproducibility, documentation completeness, provenance and risk, and score comparability), rendered through reader modes calibrated to research and non-research audiences, and (3) deploy a monitoring tool that applies \EvalCards{} across 5,816 models, 635 benchmarks, and 101,843 results, surfacing systematic gaps in current reporting practice.
Identifiants
- OPENALEX
- https://openalex.org/W7164018997
- DOI
- 10.48550/arxiv.2606.09809
Repères documentaires
- Famille documentaire
- preprint
- Types déclarés par les sources
- preprint
Les mentions d’entités ne constituent pas une preuve de reconnaissance juridique. La juridiction étudiée est distincte du pays d’affiliation des auteurs.
Sources
OpenAlex · Document 1
Citer cette référence
Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. 2026. https://doi.org/10.48550/arxiv.2606.09809
JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·
APA, Chicago, ISO 690 : formats bibliographiques fondés sur les champs disponibles. OSCOLA / Bluebook : données structurées uniquement ; aucune conformité juridique complète n’est revendiquée sans vérification des éléments nécessaires.
- APA
- Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. (2026). Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. https://doi.org/10.48550/arxiv.2606.09809
- Chicago
- Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. 2026. https://doi.org/10.48550/arxiv.2606.09809
- ISO 690
- Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. 2026. https://doi.org/10.48550/arxiv.2606.09809
Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31
UDTR — Bibliothèque juridique mondiale des droits de la Nature. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. Notice documentaire: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-89817ab6f5cac343b6f09ef46bf8dcea/ · Dernière vérification HTTP : non effectuée
Données de cette version figée
Dossiers et relations documentaires
Rôles des sources
Source bibliographique / publication d’origine · https://arxiv.org/abs/2606.09809
Un lien vers une autorité ne prouve pas à lui seul une affirmation juridique. Les résumés et les textes intégraux restent soumis aux conditions de leur source.
Statut documentaire
Pertinence à examiner
Bibliothèque
Cette identité n’est pas encore intégrée à la Bibliothèque juridique.