Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting
Identification
- Public canonical key
- radar:r-89817ab6f5cac343b6f09ef46bf8dcea
- Authors
- Avijit Ghosh · Anka Reuel · Jenny Chim · Wm. Matthew Kennedy · Srishti Yadav · Jennifer Mickel · Yanan Long · Andrew Tran · Anastassia Kornilova · Damian Stachura · Kevin Klyman · Felix Friedrich · Jeba Sania · Jan Batzner · Anoop Mishra · Eliya Habba · Yixiong Hao · Nathan Heath · Shalaleh Rismani · Usman Gohar · Andrea Loehr · David Manheim · Ruchira Dhar · Sree Harsha Nelaturu · Aarush Sinha · Leshem Choshen · Drishti Sharma · Ishan Khire · Amit Saha · Subramanyam Sahoo · Michael Hardy · Michael Alexander Riegler · Kabir Manghnani · Michelle Lin · Yanan Jiang · Yanan Jiang · Asaf Yehudai · Jessica Ji · Aris Hofmann · Mubashara Akhtar · Max Lamparth · Nuno Moniz · Yacine Jernite · Stella Biderman · Zeerak Talat · Sanmi Koyejo · Mykel J. Kochenderfer · Irene Solaiman
- Reported year
- 2026
- Reported language
- en
- Source type
- preprint
- First detected
- 2026-11-14T02:16:53.707393+00:00
- Last metadata observation
- 2026-11-14T02:16:53.707393+00:00
- Last HTTP verification
- Not checked
Institutions reported by the source
Baden-Wuerttemberg Cooperative State University · Georgetown University · Stanford University · Queen Mary University of London · Technion – Israel Institute of Technology · Technische Universität Darmstadt · Harvard University · Weizenbaum Institute · Technical University of Munich · Amherst College · Hebrew University of Jerusalem · Iowa State University · McGill University · University of Copenhagen · Zuse Institute Berlin · IBM (United States) · Massachusetts Institute of Technology · Georgia Institute of Technology · Mila - Quebec Artificial Intelligence Institute · Université de Montréal · ETH Zurich · University of Notre Dame · University of Edinburgh
Reported affiliation countries
CA · CH · DE · DK · GB · IL · US
Documentary abstract — original language
AI evaluation results are produced at scale but reported inconsistently across leaderboards, model cards, benchmark papers, and company blogs. The cost is interpretive: readers cannot reliably compare results across sources, identify what a report omits, or trace an aggregate claim to its underlying evidence. Recent efforts address isolated components but leave three gaps: they cover only narrow slices of the evaluation lifecycle and do not compose into a single interpretable record; they specify static representations that do not differentiate the questions different stakeholders bring to the same evidence; and they remain proposals on paper, lacking the extraction infrastructure required for adoption at scale. We present \EvalCards{}, an operational reporting layer that composes benchmark metadata, evaluation run data, and model metadata into a unified record. We (1) derive a reporting schema from a structured review of 52 papers and 10 stakeholder interviews, (2) implement four interpretive signals (reproducibility, documentation completeness, provenance and risk, and score comparability), rendered through reader modes calibrated to research and non-research audiences, and (3) deploy a monitoring tool that applies \EvalCards{} across 5,816 models, 635 benchmarks, and 101,843 results, surfacing systematic gaps in current reporting practice.
Identifiers
- OPENALEX
- https://openalex.org/W7164018997
- DOI
- 10.48550/arxiv.2606.09809
Documentary context
- Documentary family
- preprint
- Source-reported types
- preprint
Entity mentions are not evidence of legal recognition. Jurisdiction studied is separate from author affiliation country.
Sources
OpenAlex · Record 1
Cite this reference
Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. 2026. https://doi.org/10.48550/arxiv.2606.09809
JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·
APA, Chicago, ISO 690: bibliographic formats using available fields. OSCOLA / Bluebook: structured data only; full legal citation compliance is not claimed without verification of required elements.
- APA
- Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. (2026). Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. https://doi.org/10.48550/arxiv.2606.09809
- Chicago
- Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. 2026. https://doi.org/10.48550/arxiv.2606.09809
- ISO 690
- Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. 2026. https://doi.org/10.48550/arxiv.2606.09809
Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31
UDTR Global Rights of Nature Legal Library. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. Documentary record: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-89817ab6f5cac343b6f09ef46bf8dcea/ · Last HTTP verification: not performed
Research dossiers and documentary relations
Source roles
Bibliographic / original publication source · https://arxiv.org/abs/2606.09809
An authority link alone does not verify a legal claim. Abstracts and full texts remain subject to their source terms.
Documentary status
Relevance pending
Library
This identity is not yet included in the Legal Library.